Aug 27 06:32:25 user nova-compute[73258]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 27 06:32:28 user nova-compute[73258]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73258) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 27 06:32:28 user nova-compute[73258]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73258) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 27 06:32:28 user nova-compute[73258]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73258) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 27 06:32:28 user nova-compute[73258]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 27 06:32:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:32:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:32:29 user nova-compute[73258]: INFO nova.virt.driver [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 27 06:32:29 user nova-compute[73258]: INFO nova.compute.provider_config [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] Acquiring lock "singleton_lock" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] Acquired lock "singleton_lock" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] Releasing lock "singleton_lock" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] Full set of CONF: {{(pid=73258) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ******************************************************************************** {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] Configuration options gathered from: {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ================================================================================ {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] allow_resize_to_same_host      = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] arq_binding_timeout            = 300 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] backdoor_port                  = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] backdoor_socket                = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] block_device_allocate_retries  = 300 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] block_device_allocate_retries_interval = 5 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cert                           = self.pem {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] compute_monitors               = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] config_dir                     = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] config_drive_format            = iso9660 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] config_source                  = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] console_host                   = user {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] control_exchange               = nova {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cpu_allocation_ratio           = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] daemon                         = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] debug                          = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] default_access_ip_network_name = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] default_availability_zone      = nova {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] default_ephemeral_format       = ext4 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] default_green_pool_size        = 1000 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] default_schedule_zone          = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] disk_allocation_ratio          = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] enable_new_services            = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] enabled_ssl_apis               = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] flat_injected                  = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] force_config_drive             = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] force_raw_images               = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] graceful_shutdown_timeout      = 5 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] heal_instance_info_cache_interval = 60 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] host                           = user {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] instance_build_timeout         = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] instance_delete_interval       = 300 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] instance_name_template         = instance-%08x {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] instance_usage_audit           = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] instance_usage_audit_period    = month {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] internal_service_availability_zone = internal {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] key                            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] live_migration_retry_count     = 30 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] log_config_append              = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] log_dir                        = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] log_file                       = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] log_options                    = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] log_rotate_interval            = 1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] log_rotate_interval_type       = days {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] log_rotation_type              = none {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] long_rpc_timeout               = 1800 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] max_concurrent_builds          = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] max_concurrent_live_migrations = 1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] max_concurrent_snapshots       = 5 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] max_local_block_devices        = 3 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] max_logfile_count              = 30 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] max_logfile_size_mb            = 200 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] maximum_instance_delete_attempts = 5 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] metadata_listen                = 0.0.0.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] metadata_listen_port           = 8775 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] metadata_workers               = 3 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] migrate_max_retries            = -1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] mkisofs_cmd                    = genisoimage {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] my_ip                          = 10.0.0.210 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] network_allocate_retries       = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] osapi_compute_listen_port      = 8774 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] osapi_compute_unique_server_name_scope =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] osapi_compute_workers          = 3 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] password_length                = 12 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] periodic_enable                = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] periodic_fuzzy_delay           = 60 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] pointer_model                  = ps2mouse {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] preallocate_images             = none {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] publish_errors                 = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] pybasedir                      = /opt/stack/nova {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ram_allocation_ratio           = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] rate_limit_burst               = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] rate_limit_except_level        = CRITICAL {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] rate_limit_interval            = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] reboot_timeout                 = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] reclaim_instance_interval      = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] record                         = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] reimage_timeout_per_gb         = 60 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] report_interval                = 120 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] rescue_timeout                 = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] reserved_host_cpus             = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] reserved_host_disk_mb          = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] reserved_host_memory_mb        = 512 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] reserved_huge_pages            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] resize_confirm_window          = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] resize_fs_using_block_device   = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] resume_guests_state_on_host_boot = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] rpc_response_timeout           = 60 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] run_external_periodic_tasks    = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] running_deleted_instance_action = reap {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] running_deleted_instance_timeout = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] scheduler_instance_sync_interval = 120 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] service_down_time              = 720 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] servicegroup_driver            = db {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] shelved_offload_time           = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] shelved_poll_interval          = 3600 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] shutdown_timeout               = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] source_is_ipv6                 = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ssl_only                       = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] state_path                     = /opt/stack/data/nova {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] sync_power_state_interval      = 600 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] sync_power_state_pool_size     = 1000 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] syslog_log_facility            = LOG_USER {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] tempdir                        = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] timeout_nbd                    = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] transport_url                  = **** {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] update_resources_interval      = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] use_cow_images                 = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] use_eventlog                   = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] use_journal                    = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] use_json                       = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] use_rootwrap_daemon            = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] use_stderr                     = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] use_syslog                     = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vcpu_pin_set                   = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vif_plugging_is_fatal          = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vif_plugging_timeout           = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] virt_mkfs                      = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] volume_usage_poll_interval     = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] watch_log_file                 = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] web                            = /usr/share/spice-html5 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_concurrency.disable_process_locking = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.auth_strategy              = keystone {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.compute_link_prefix        = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.dhcp_domain                = novalocal {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.enable_instance_password   = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.glance_link_prefix         = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.instance_list_per_project_cells = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.list_records_by_skipping_down_cells = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.local_metadata_per_cell    = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.max_limit                  = 1000 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.metadata_cache_expiration  = 15 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.neutron_default_tenant_id  = default {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.use_forwarded_for          = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.use_neutron_default_nets   = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.vendordata_dynamic_targets = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.vendordata_jsonfile_path   = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.backend_argument         = **** {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.config_prefix            = cache.oslo {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.dead_timeout             = 60.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.debug_cache_backend      = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.enable_retry_client      = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.enable_socket_keepalive  = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.enabled                  = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.expiration_time          = 600 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.hashclient_retry_attempts = 2 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.memcache_dead_retry      = 300 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.memcache_password        =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.memcache_sasl_enabled    = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.memcache_username        =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.proxies                  = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.retry_attempts           = 2 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.retry_delay              = 0.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.socket_keepalive_count   = 1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.socket_keepalive_idle    = 1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.socket_keepalive_interval = 1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.tls_allowed_ciphers      = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.tls_cafile               = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.tls_certfile             = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.tls_enabled              = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cache.tls_keyfile              = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cinder.auth_section            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cinder.auth_type               = password {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cinder.cafile                  = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cinder.certfile                = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cinder.collect_timing          = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cinder.cross_az_attach         = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cinder.debug                   = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cinder.endpoint_template       = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cinder.http_retries            = 3 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cinder.insecure                = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cinder.keyfile                 = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cinder.os_region_name          = RegionOne {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cinder.split_loggers           = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cinder.timeout                 = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] compute.cpu_dedicated_set      = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] compute.cpu_shared_set         = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] compute.image_type_exclude_list = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] compute.resource_provider_association_refresh = 300 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] compute.shutdown_retry_interval = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] conductor.workers              = 3 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] console.allowed_origins        = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] console.ssl_ciphers            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] console.ssl_minimum_version    = default {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] consoleauth.token_ttl          = 600 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cyborg.cafile                  = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cyborg.certfile                = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cyborg.collect_timing          = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cyborg.connect_retries         = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cyborg.connect_retry_delay     = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cyborg.endpoint_override       = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cyborg.insecure                = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cyborg.keyfile                 = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cyborg.max_version             = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cyborg.min_version             = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cyborg.region_name             = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cyborg.service_name            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cyborg.service_type            = accelerator {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cyborg.split_loggers           = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cyborg.status_code_retries     = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cyborg.status_code_retry_delay = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cyborg.timeout                 = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] cyborg.version                 = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.backend               = sqlalchemy {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.connection            = **** {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.connection_debug      = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.connection_parameters =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.connection_recycle_time = 3600 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.connection_trace      = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.db_inc_retry_interval = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.db_max_retries        = 20 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.db_max_retry_interval = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.db_retry_interval     = 1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.max_overflow          = 50 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.max_pool_size         = 5 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.max_retries           = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.mysql_enable_ndb      = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.mysql_wsrep_sync_wait = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.pool_timeout          = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.retry_interval        = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.slave_connection      = **** {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] database.sqlite_synchronous    = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.backend           = sqlalchemy {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.connection        = **** {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.connection_debug  = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.connection_parameters =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.connection_recycle_time = 3600 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.connection_trace  = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.db_inc_retry_interval = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.db_max_retries    = 20 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.db_max_retry_interval = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.db_retry_interval = 1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.max_overflow      = 50 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.max_pool_size     = 5 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.max_retries       = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.mysql_enable_ndb  = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.pool_timeout      = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.retry_interval    = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.slave_connection  = **** {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] api_database.sqlite_synchronous = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] devices.enabled_mdev_types     = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ephemeral_storage_encryption.enabled = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.api_servers             = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.cafile                  = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.certfile                = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.collect_timing          = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.connect_retries         = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.connect_retry_delay     = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.debug                   = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.default_trusted_certificate_ids = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.enable_certificate_validation = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.enable_rbd_download     = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.endpoint_override       = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.insecure                = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.keyfile                 = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.max_version             = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.min_version             = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.num_retries             = 3 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.rbd_ceph_conf           =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.rbd_connect_timeout     = 5 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.rbd_pool                =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.rbd_user                =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.region_name             = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.service_name            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.service_type            = image {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.split_loggers           = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.status_code_retries     = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.status_code_retry_delay = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.timeout                 = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.verify_glance_signatures = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] glance.version                 = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] guestfs.debug                  = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] hyperv.config_drive_cdrom      = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] hyperv.config_drive_inject_password = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] hyperv.enable_remotefx         = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] hyperv.instances_path_share    =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] hyperv.limit_cpu_features      = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] hyperv.use_multipath_io        = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] hyperv.vswitch_name            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] mks.enabled                    = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] image_cache.manager_interval   = 2400 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] image_cache.precache_concurrency = 1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] image_cache.remove_unused_base_images = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] image_cache.subdirectory_name  = _base {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.api_max_retries         = 60 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.api_retry_interval      = 2 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.auth_section            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.auth_type               = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.cafile                  = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.certfile                = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.collect_timing          = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.connect_retries         = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.connect_retry_delay     = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.endpoint_override       = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.insecure                = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.keyfile                 = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.max_version             = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.min_version             = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.partition_key           = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.peer_list               = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.region_name             = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.serial_console_state_timeout = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.service_name            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.service_type            = baremetal {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.split_loggers           = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.status_code_retries     = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.status_code_retry_delay = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.timeout                 = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ironic.version                 = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] key_manager.fixed_key          = **** {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican.barbican_api_version  = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican.barbican_endpoint     = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican.barbican_endpoint_type = public {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican.barbican_region_name  = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican.cafile                = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican.certfile              = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican.collect_timing        = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican.insecure              = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican.keyfile               = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican.number_of_retries     = 60 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican.retry_delay           = 1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican.send_service_user_token = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican.split_loggers         = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican.timeout               = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican.verify_ssl            = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican.verify_ssl_path       = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican_service_user.auth_section = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican_service_user.auth_type = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican_service_user.cafile   = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican_service_user.certfile = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican_service_user.collect_timing = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican_service_user.insecure = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican_service_user.keyfile  = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican_service_user.split_loggers = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] barbican_service_user.timeout  = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vault.approle_role_id          = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vault.approle_secret_id        = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vault.cafile                   = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vault.certfile                 = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vault.collect_timing           = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vault.insecure                 = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vault.keyfile                  = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vault.kv_mountpoint            = secret {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vault.kv_version               = 2 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vault.namespace                = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vault.root_token_id            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vault.split_loggers            = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vault.ssl_ca_crt_file          = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vault.timeout                  = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vault.use_ssl                  = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] keystone.cafile                = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] keystone.certfile              = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] keystone.collect_timing        = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] keystone.connect_retries       = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] keystone.connect_retry_delay   = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] keystone.endpoint_override     = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] keystone.insecure              = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] keystone.keyfile               = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] keystone.max_version           = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] keystone.min_version           = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] keystone.region_name           = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] keystone.service_name          = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] keystone.service_type          = identity {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] keystone.split_loggers         = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] keystone.status_code_retries   = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] keystone.status_code_retry_delay = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] keystone.timeout               = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] keystone.version               = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.connection_uri         =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.cpu_mode               = custom {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: WARNING oslo_config.cfg [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.cpu_power_governor_high = performance {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.cpu_power_management   = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.device_detach_attempts = 8 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.device_detach_timeout  = 20 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.disk_cachemodes        = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.disk_prefix            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.enabled_perf_events    = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.file_backed_memory     = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.gid_maps               = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.hw_disk_discard        = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.hw_machine_type        = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.images_rbd_pool        = rbd {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.images_type            = default {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.images_volume_group    = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.inject_key             = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.inject_partition       = -2 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.inject_password        = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.iscsi_iface            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.iser_use_multipath     = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.live_migration_downtime = 500 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.live_migration_inbound_addr = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.live_migration_scheme  = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.live_migration_timeout_action = abort {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.live_migration_tunnelled = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: WARNING oslo_config.cfg [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 27 06:32:29 user nova-compute[73258]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 27 06:32:29 user nova-compute[73258]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 27 06:32:29 user nova-compute[73258]: and ``live_migration_inbound_addr`` respectively.
Aug 27 06:32:29 user nova-compute[73258]: ).  Its value may be silently ignored in the future.
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.live_migration_with_native_tls = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.max_queues             = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.nfs_mount_options      = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.num_pcie_ports         = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.pmem_namespaces        = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.quobyte_client_cfg     = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.rbd_secret_uuid        = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.rbd_user               = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.rescue_image_id        = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.rescue_kernel_id       = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.rx_queue_size          = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.smbfs_mount_options    =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.snapshot_compression   = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.snapshot_image_format  = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.sparse_logical_volumes = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.swtpm_enabled          = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.swtpm_group            = tss {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.swtpm_user             = tss {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.sysinfo_serial         = unique {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.tb_cache_size          = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.tx_queue_size          = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.uid_maps               = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.use_virtio_for_bridges = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.virt_type              = kvm {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.volume_clear           = zero {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.volume_clear_size      = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.volume_use_multipath   = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.vzstorage_cache_path   = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.auth_section           = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.auth_type              = password {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.cafile                 = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.certfile               = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.collect_timing         = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.connect_retries        = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.connect_retry_delay    = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.default_floating_pool  = public {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.endpoint_override      = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.extension_sync_interval = 600 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.http_retries           = 3 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.insecure               = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.keyfile                = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.max_version            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.min_version            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.ovs_bridge             = br-int {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.physnets               = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.region_name            = RegionOne {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.service_metadata_proxy = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.service_name           = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.service_type           = network {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.split_loggers          = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.status_code_retries    = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.status_code_retry_delay = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.timeout                = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] neutron.version                = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] notifications.bdms_in_notifications = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] notifications.default_level    = INFO {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] notifications.notification_format = unversioned {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] notifications.notify_on_state_change = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] pci.alias                      = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] pci.device_spec                = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] pci.report_in_placement        = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.auth_section         = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.auth_type            = password {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.cafile               = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.certfile             = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.collect_timing       = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.connect_retries      = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.connect_retry_delay  = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.default_domain_id    = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.default_domain_name  = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.domain_id            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.domain_name          = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.endpoint_override    = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.insecure             = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.keyfile              = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.max_version          = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.min_version          = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.password             = **** {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.project_domain_id    = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.project_domain_name  = Default {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.project_id           = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.project_name         = service {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.region_name          = RegionOne {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.service_name         = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.service_type         = placement {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.split_loggers        = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.status_code_retries  = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.status_code_retry_delay = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.system_scope         = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.timeout              = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.trust_id             = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.user_domain_id       = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.user_domain_name     = Default {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.user_id              = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.username             = placement {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] placement.version              = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] quota.cores                    = 20 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] quota.count_usage_from_placement = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] quota.injected_file_content_bytes = 10240 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] quota.injected_file_path_length = 255 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] quota.injected_files           = 5 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] quota.instances                = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] quota.key_pairs                = 100 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] quota.metadata_items           = 128 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] quota.ram                      = 51200 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] quota.recheck_quota            = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] quota.server_group_members     = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] quota.server_groups            = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] rdp.enabled                    = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] scheduler.image_metadata_prefilter = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] scheduler.max_attempts         = 3 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] scheduler.max_placement_results = 1000 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] scheduler.workers              = 3 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.host_subset_size = 1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.isolated_hosts = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.isolated_images = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.pci_in_placement = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.track_instance_changes = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] metrics.required               = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] metrics.weight_multiplier      = 1.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] metrics.weight_setting         = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] serial_console.enabled         = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] serial_console.port_range      = 10000:20000 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] serial_console.serialproxy_port = 6083 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] service_user.auth_section      = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] service_user.auth_type         = password {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] service_user.cafile            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] service_user.certfile          = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] service_user.collect_timing    = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] service_user.insecure          = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] service_user.keyfile           = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] service_user.send_service_user_token = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] service_user.split_loggers     = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] service_user.timeout           = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] spice.agent_enabled            = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] spice.enabled                  = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] spice.html5proxy_port          = 6082 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] spice.image_compression        = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] spice.jpeg_compression         = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] spice.playback_compression     = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] spice.server_listen            = 127.0.0.1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] spice.streaming_mode           = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] spice.zlib_compression         = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] upgrade_levels.baseapi         = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] upgrade_levels.cert            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] upgrade_levels.compute         = auto {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] upgrade_levels.conductor       = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] upgrade_levels.scheduler       = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vendordata_dynamic_auth.cafile = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vendordata_dynamic_auth.certfile = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vendordata_dynamic_auth.insecure = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vendordata_dynamic_auth.timeout = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.api_retry_count         = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.ca_file                 = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.cache_prefix            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.cluster_name            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.connection_pool_size    = 10 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.console_delay_seconds   = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.datastore_regex         = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.host_ip                 = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.host_password           = **** {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.host_port               = 443 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.host_username           = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.insecure                = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.integration_bridge      = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.maximum_objects         = 100 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.pbm_default_policy      = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.pbm_enabled             = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.pbm_wsdl_location       = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.serial_port_proxy_uri   = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.serial_port_service_uri = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.task_poll_interval      = 0.5 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.use_linked_clone        = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.vnc_keymap              = en-us {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.vnc_port                = 5900 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vmware.vnc_port_total          = 10000 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vnc.auth_schemes               = ['none'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vnc.enabled                    = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vnc.novncproxy_port            = 6080 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vnc.vencrypt_ca_certs          = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vnc.vencrypt_client_cert       = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vnc.vencrypt_client_key        = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.disable_rootwrap   = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.enable_numa_live_migration = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.libvirt_disable_apic = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] wsgi.client_socket_timeout     = 900 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] wsgi.default_pool_size         = 1000 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] wsgi.keep_alive                = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] wsgi.max_header_line           = 16384 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] wsgi.ssl_ca_file               = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] wsgi.ssl_cert_file             = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] wsgi.ssl_key_file              = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] wsgi.tcp_keepidle              = 600 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] zvm.ca_file                    = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] zvm.cloud_connector_url        = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] zvm.reachable_timeout          = 300 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_policy.enforce_new_defaults = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_policy.enforce_scope      = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_policy.policy_default_rule = default {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] profiler.connection_string     = messaging:// {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] profiler.enabled               = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] profiler.es_doc_type           = notification {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] profiler.es_scroll_size        = 10000 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] profiler.es_scroll_time        = 2m {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] profiler.filter_error_trace    = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] profiler.hmac_keys             = **** {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] profiler.sentinel_service_name = mymaster {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] profiler.socket_timeout        = 0.1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] profiler.trace_requests        = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] profiler.trace_sqlalchemy      = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] profiler_jaeger.process_tags   = {} {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] profiler_jaeger.service_name_prefix = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] profiler_otlp.service_name_prefix = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] remote_debug.host              = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] remote_debug.port              = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_notifications.retry = -1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.auth_section        = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.auth_type           = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.cafile              = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.certfile            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.collect_timing      = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.connect_retries     = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.connect_retry_delay = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.endpoint_id         = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.endpoint_override   = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.insecure            = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.keyfile             = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.max_version         = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.min_version         = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.region_name         = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.service_name        = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.service_type        = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.split_loggers       = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.status_code_retries = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.status_code_retry_delay = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.timeout             = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.valid_interfaces    = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_limit.version             = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_reports.file_event_handler = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] oslo_reports.log_dir           = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vif_plug_ovs_privileged.group  = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] vif_plug_ovs_privileged.user   = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] os_vif_ovs.isolate_vif         = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] os_brick.lock_path             = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] privsep_osbrick.capabilities   = [21] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] privsep_osbrick.group          = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] privsep_osbrick.helper_command = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] privsep_osbrick.user           = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] nova_sys_admin.group           = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] nova_sys_admin.helper_command  = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] nova_sys_admin.user            = None {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG oslo_service.service [None req-47cd0760-23d5-49a4-a7df-af9a0c01e3c6 None None] ******************************************************************************** {{(pid=73258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 27 06:32:29 user nova-compute[73258]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 27 06:32:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Starting native event thread {{(pid=73258) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Starting green dispatch thread {{(pid=73258) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Starting connection event dispatch thread {{(pid=73258) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Connecting to libvirt: qemu:///system {{(pid=73258) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fa441efa7d0> {{(pid=73258) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Aug 27 06:32:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fa441efa7d0> {{(pid=73258) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Aug 27 06:32:29 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Connection event '1' reason 'None'
Aug 27 06:32:29 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 27 06:32:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.mount [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Initialising _HostMountState generation 0 {{(pid=73258) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 27 06:32:36 user nova-compute[73258]: INFO nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Libvirt host capabilities <capabilities>
Aug 27 06:32:36 user nova-compute[73258]:   <host>
Aug 27 06:32:36 user nova-compute[73258]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 27 06:32:36 user nova-compute[73258]:     <cpu>
Aug 27 06:32:36 user nova-compute[73258]:       <arch>x86_64</arch>
Aug 27 06:32:36 user nova-compute[73258]:       <model>IvyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <vendor>Intel</vendor>
Aug 27 06:32:36 user nova-compute[73258]:       <microcode version='1070'/>
Aug 27 06:32:36 user nova-compute[73258]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 27 06:32:36 user nova-compute[73258]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature name='ss'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature name='vmx'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature name='pcid'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature name='osxsave'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature name='hypervisor'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature name='arat'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature name='tsc_adjust'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature name='md-clear'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature name='stibp'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature name='arch-capabilities'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature name='ssbd'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature name='invtsc'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature name='rsba'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature name='skip-l1dfl-vmentry'/>
Aug 27 06:32:36 user nova-compute[73258]:       <pages unit='KiB' size='4'/>
Aug 27 06:32:36 user nova-compute[73258]:       <pages unit='KiB' size='2048'/>
Aug 27 06:32:36 user nova-compute[73258]:     </cpu>
Aug 27 06:32:36 user nova-compute[73258]:     <power_management>
Aug 27 06:32:36 user nova-compute[73258]:       <suspend_mem/>
Aug 27 06:32:36 user nova-compute[73258]:       <suspend_disk/>
Aug 27 06:32:36 user nova-compute[73258]:       <suspend_hybrid/>
Aug 27 06:32:36 user nova-compute[73258]:     </power_management>
Aug 27 06:32:36 user nova-compute[73258]:     <iommu support='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     <migration_features>
Aug 27 06:32:36 user nova-compute[73258]:       <live/>
Aug 27 06:32:36 user nova-compute[73258]:       <uri_transports>
Aug 27 06:32:36 user nova-compute[73258]:         <uri_transport>tcp</uri_transport>
Aug 27 06:32:36 user nova-compute[73258]:         <uri_transport>rdma</uri_transport>
Aug 27 06:32:36 user nova-compute[73258]:       </uri_transports>
Aug 27 06:32:36 user nova-compute[73258]:     </migration_features>
Aug 27 06:32:36 user nova-compute[73258]:     <topology>
Aug 27 06:32:36 user nova-compute[73258]:       <cells num='2'>
Aug 27 06:32:36 user nova-compute[73258]:         <cell id='0'>
Aug 27 06:32:36 user nova-compute[73258]:           <memory unit='KiB'>8189224</memory>
Aug 27 06:32:36 user nova-compute[73258]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 27 06:32:36 user nova-compute[73258]:           <pages unit='KiB' size='2048'>0</pages>
Aug 27 06:32:36 user nova-compute[73258]:           <distances>
Aug 27 06:32:36 user nova-compute[73258]:             <sibling id='0' value='10'/>
Aug 27 06:32:36 user nova-compute[73258]:             <sibling id='1' value='20'/>
Aug 27 06:32:36 user nova-compute[73258]:           </distances>
Aug 27 06:32:36 user nova-compute[73258]:           <cpus num='6'>
Aug 27 06:32:36 user nova-compute[73258]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 27 06:32:36 user nova-compute[73258]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 27 06:32:36 user nova-compute[73258]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 27 06:32:36 user nova-compute[73258]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 27 06:32:36 user nova-compute[73258]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 27 06:32:36 user nova-compute[73258]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 27 06:32:36 user nova-compute[73258]:           </cpus>
Aug 27 06:32:36 user nova-compute[73258]:         </cell>
Aug 27 06:32:36 user nova-compute[73258]:         <cell id='1'>
Aug 27 06:32:36 user nova-compute[73258]:           <memory unit='KiB'>8206460</memory>
Aug 27 06:32:36 user nova-compute[73258]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 27 06:32:36 user nova-compute[73258]:           <pages unit='KiB' size='2048'>0</pages>
Aug 27 06:32:36 user nova-compute[73258]:           <distances>
Aug 27 06:32:36 user nova-compute[73258]:             <sibling id='0' value='20'/>
Aug 27 06:32:36 user nova-compute[73258]:             <sibling id='1' value='10'/>
Aug 27 06:32:36 user nova-compute[73258]:           </distances>
Aug 27 06:32:36 user nova-compute[73258]:           <cpus num='6'>
Aug 27 06:32:36 user nova-compute[73258]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 27 06:32:36 user nova-compute[73258]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 27 06:32:36 user nova-compute[73258]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 27 06:32:36 user nova-compute[73258]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 27 06:32:36 user nova-compute[73258]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 27 06:32:36 user nova-compute[73258]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 27 06:32:36 user nova-compute[73258]:           </cpus>
Aug 27 06:32:36 user nova-compute[73258]:         </cell>
Aug 27 06:32:36 user nova-compute[73258]:       </cells>
Aug 27 06:32:36 user nova-compute[73258]:     </topology>
Aug 27 06:32:36 user nova-compute[73258]:     <cache>
Aug 27 06:32:36 user nova-compute[73258]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 27 06:32:36 user nova-compute[73258]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 27 06:32:36 user nova-compute[73258]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 27 06:32:36 user nova-compute[73258]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 27 06:32:36 user nova-compute[73258]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 27 06:32:36 user nova-compute[73258]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 27 06:32:36 user nova-compute[73258]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 27 06:32:36 user nova-compute[73258]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 27 06:32:36 user nova-compute[73258]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 27 06:32:36 user nova-compute[73258]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 27 06:32:36 user nova-compute[73258]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 27 06:32:36 user nova-compute[73258]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 27 06:32:36 user nova-compute[73258]:     </cache>
Aug 27 06:32:36 user nova-compute[73258]:     <secmodel>
Aug 27 06:32:36 user nova-compute[73258]:       <model>apparmor</model>
Aug 27 06:32:36 user nova-compute[73258]:       <doi>0</doi>
Aug 27 06:32:36 user nova-compute[73258]:     </secmodel>
Aug 27 06:32:36 user nova-compute[73258]:     <secmodel>
Aug 27 06:32:36 user nova-compute[73258]:       <model>dac</model>
Aug 27 06:32:36 user nova-compute[73258]:       <doi>0</doi>
Aug 27 06:32:36 user nova-compute[73258]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 27 06:32:36 user nova-compute[73258]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 27 06:32:36 user nova-compute[73258]:     </secmodel>
Aug 27 06:32:36 user nova-compute[73258]:   </host>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='alpha'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>64</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>clipper</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='armv6l'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>32</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>integratorcp</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>borzoi</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>spitz</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>nuri</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>musca-b1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>versatileab</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>kzm</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>musca-a</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>smdkc210</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>sx1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>z2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>tosa</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>sabrelite</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>realview-eb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>n810</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>n800</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>versatilepb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>terrier</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mainstone</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>midway</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>musicpal</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>microbit</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>cubieboard</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>verdex</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>netduino2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>raspi2b</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>cheetah</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>highbank</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>akita</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>connex</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>collie</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>raspi0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='armv7l'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>32</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>integratorcp</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>borzoi</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>spitz</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>nuri</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>musca-b1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>versatileab</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>kzm</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>musca-a</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>smdkc210</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>sx1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>z2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>tosa</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>sabrelite</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>realview-eb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>n810</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>n800</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>versatilepb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>terrier</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mainstone</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>midway</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>musicpal</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>microbit</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>cubieboard</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>verdex</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>netduino2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>raspi2b</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>cheetah</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>highbank</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>akita</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>connex</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>collie</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>raspi0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='aarch64'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>64</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>integratorcp</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>borzoi</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>spitz</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>nuri</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>musca-b1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>versatileab</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>kzm</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>musca-a</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>smdkc210</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>sx1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>z2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>tosa</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>sabrelite</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>realview-eb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>n810</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>n800</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>versatilepb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>terrier</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mainstone</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>midway</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>musicpal</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>microbit</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>cubieboard</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>verdex</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>netduino2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>raspi3b</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>raspi2b</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>cheetah</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>highbank</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>akita</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>connex</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>collie</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>raspi0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <acpi default='on' toggle='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='cris'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>32</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='i686'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>32</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>x-remote</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>isapc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>microvm</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='kvm'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <pae/>
Aug 27 06:32:36 user nova-compute[73258]:       <nonpae/>
Aug 27 06:32:36 user nova-compute[73258]:       <acpi default='on' toggle='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:       <apic default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='m68k'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>32</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>an5206</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>q800</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>next-cube</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='microblaze'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>32</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='microblazeel'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>32</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='mips'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>32</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='16'>malta</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='mipsel'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>32</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='16'>malta</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='mips64'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>64</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='16'>malta</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>pica61</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>magnum</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='mips64el'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>64</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='16'>malta</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>pica61</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>magnum</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='16'>boston</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='ppc'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>32</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>g3beige</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mac99</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>ppce500</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>pegasos2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>sam460ex</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>bamboo</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>40p</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>ref405ep</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>taihu</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='ppc64'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>64</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2048'>powernv9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>taihu</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2048'>powernv10</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>ppce500</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>40p</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>pegasos2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>bamboo</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>g3beige</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mac99</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>sam460ex</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>ref405ep</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2048'>powernv8</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='ppc64le'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>64</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2048'>powernv9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>taihu</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2048'>powernv10</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>ppce500</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>40p</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>pegasos2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>bamboo</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>g3beige</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>mac99</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>sam460ex</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>ref405ep</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2048'>powernv8</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='riscv32'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>32</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='8'>spike</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>opentitan</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='5'>sifive_u</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>sifive_e</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='8'>virt</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='riscv64'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>64</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='8'>spike</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='5'>sifive_u</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>shakti_c</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>sifive_e</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='8'>virt</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='s390x'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>64</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='sh4'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>32</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>shix</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>r2d</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='sh4eb'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>64</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>shix</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>r2d</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='sparc'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>32</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>SS-5</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>SS-20</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>LX</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>SS-4</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>SS-10</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>Voyager</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='sparc64'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>64</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>sun4u</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>niagara</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>sun4v</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='x86_64'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>64</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>x-remote</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='1'>isapc</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>microvm</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='kvm'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <acpi default='on' toggle='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:       <apic default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='xtensa'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>32</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>sim</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>kc705</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>ml605</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>virt</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>lx200</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>lx60</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]:   <guest>
Aug 27 06:32:36 user nova-compute[73258]:     <os_type>hvm</os_type>
Aug 27 06:32:36 user nova-compute[73258]:     <arch name='xtensaeb'>
Aug 27 06:32:36 user nova-compute[73258]:       <wordsize>32</wordsize>
Aug 27 06:32:36 user nova-compute[73258]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='4'>sim</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>kc705</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>ml605</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>virt</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>lx200</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>lx60</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 27 06:32:36 user nova-compute[73258]:       <domain type='qemu'/>
Aug 27 06:32:36 user nova-compute[73258]:     </arch>
Aug 27 06:32:36 user nova-compute[73258]:     <features>
Aug 27 06:32:36 user nova-compute[73258]:       <cpuselection/>
Aug 27 06:32:36 user nova-compute[73258]:       <deviceboot/>
Aug 27 06:32:36 user nova-compute[73258]:       <disksnapshot default='on' toggle='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     </features>
Aug 27 06:32:36 user nova-compute[73258]:   </guest>
Aug 27 06:32:36 user nova-compute[73258]: </capabilities>
Aug 27 06:32:36 user nova-compute[73258]: 
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 27 06:32:36 user nova-compute[73258]: <domainCapabilities>
Aug 27 06:32:36 user nova-compute[73258]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 06:32:36 user nova-compute[73258]:   <domain>kvm</domain>
Aug 27 06:32:36 user nova-compute[73258]:   <machine>pc-q35-6.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:   <arch>i686</arch>
Aug 27 06:32:36 user nova-compute[73258]:   <vcpu max='288'/>
Aug 27 06:32:36 user nova-compute[73258]:   <iothreads supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:   <os supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:     <enum name='firmware'/>
Aug 27 06:32:36 user nova-compute[73258]:     <loader supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='type'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>rom</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>pflash</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='readonly'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>yes</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>no</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='secure'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>no</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </loader>
Aug 27 06:32:36 user nova-compute[73258]:   </os>
Aug 27 06:32:36 user nova-compute[73258]:   <cpu>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='host-passthrough' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='hostPassthroughMigratable'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>off</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='maximum' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='maximumMigratable'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>on</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>off</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='host-model' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <vendor>Intel</vendor>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ss'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='vmx'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='pcid'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='hypervisor'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='arat'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='umip'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='md-clear'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='stibp'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ssbd'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ibpb'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ibrs'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='amd-stibp'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='erms'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='lm'/>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='custom' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>qemu64</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>qemu32</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>phenom</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium3</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium2</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>n270</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>kvm64</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>kvm32</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>coreduo</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>core2duo</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>athlon</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Westmere</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Snowridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>SandyBridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Penryn</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G5</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G4</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G3</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G2</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G1</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Nehalem</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>IvyBridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Icelake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-Rome</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-Milan</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Dhyana</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cooperlake</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Conroe</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>486</model>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:   </cpu>
Aug 27 06:32:36 user nova-compute[73258]:   <memoryBacking supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:     <enum name='sourceType'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>file</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>anonymous</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>memfd</value>
Aug 27 06:32:36 user nova-compute[73258]:     </enum>
Aug 27 06:32:36 user nova-compute[73258]:   </memoryBacking>
Aug 27 06:32:36 user nova-compute[73258]:   <devices>
Aug 27 06:32:36 user nova-compute[73258]:     <disk supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='diskDevice'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>disk</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>cdrom</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>floppy</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>lun</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='bus'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>fdc</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>scsi</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>usb</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>sata</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-non-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </disk>
Aug 27 06:32:36 user nova-compute[73258]:     <graphics supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='type'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>sdl</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vnc</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>spice</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>egl-headless</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </graphics>
Aug 27 06:32:36 user nova-compute[73258]:     <video supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='modelType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vga</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>cirrus</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vmvga</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>qxl</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>none</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>bochs</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>ramfb</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </video>
Aug 27 06:32:36 user nova-compute[73258]:     <hostdev supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='mode'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>subsystem</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='startupPolicy'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>default</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>mandatory</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>requisite</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>optional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='subsysType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>usb</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>pci</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>scsi</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='capsType'/>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='pciBackend'/>
Aug 27 06:32:36 user nova-compute[73258]:     </hostdev>
Aug 27 06:32:36 user nova-compute[73258]:     <rng supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-non-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='backendModel'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>random</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>egd</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>builtin</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </rng>
Aug 27 06:32:36 user nova-compute[73258]:     <filesystem supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='driverType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>path</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>handle</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtiofs</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </filesystem>
Aug 27 06:32:36 user nova-compute[73258]:     <tpm supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>tpm-tis</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>tpm-crb</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='backendModel'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>passthrough</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>emulator</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </tpm>
Aug 27 06:32:36 user nova-compute[73258]:   </devices>
Aug 27 06:32:36 user nova-compute[73258]:   <features>
Aug 27 06:32:36 user nova-compute[73258]:     <gic supported='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     <vmcoreinfo supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <genid supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <backingStoreInput supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <backup supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <sev supported='no'/>
Aug 27 06:32:36 user nova-compute[73258]:   </features>
Aug 27 06:32:36 user nova-compute[73258]: </domainCapabilities>
Aug 27 06:32:36 user nova-compute[73258]:  {{(pid=73258) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 27 06:32:36 user nova-compute[73258]: <domainCapabilities>
Aug 27 06:32:36 user nova-compute[73258]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 06:32:36 user nova-compute[73258]:   <domain>kvm</domain>
Aug 27 06:32:36 user nova-compute[73258]:   <machine>pc-i440fx-jammy</machine>
Aug 27 06:32:36 user nova-compute[73258]:   <arch>i686</arch>
Aug 27 06:32:36 user nova-compute[73258]:   <vcpu max='255'/>
Aug 27 06:32:36 user nova-compute[73258]:   <iothreads supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:   <os supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:     <enum name='firmware'/>
Aug 27 06:32:36 user nova-compute[73258]:     <loader supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='type'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>rom</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>pflash</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='readonly'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>yes</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>no</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='secure'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>no</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </loader>
Aug 27 06:32:36 user nova-compute[73258]:   </os>
Aug 27 06:32:36 user nova-compute[73258]:   <cpu>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='host-passthrough' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='hostPassthroughMigratable'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>off</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='maximum' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='maximumMigratable'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>on</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>off</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='host-model' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <vendor>Intel</vendor>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ss'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='vmx'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='pcid'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='hypervisor'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='arat'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='umip'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='md-clear'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='stibp'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ssbd'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ibpb'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ibrs'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='amd-stibp'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='erms'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='lm'/>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='custom' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>qemu64</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>qemu32</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>phenom</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium3</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium2</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>n270</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>kvm64</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>kvm32</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>coreduo</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>core2duo</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>athlon</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Westmere</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Snowridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>SandyBridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Penryn</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G5</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G4</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G3</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G2</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G1</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Nehalem</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>IvyBridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Icelake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-Rome</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-Milan</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Dhyana</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cooperlake</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Conroe</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>486</model>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:   </cpu>
Aug 27 06:32:36 user nova-compute[73258]:   <memoryBacking supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:     <enum name='sourceType'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>file</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>anonymous</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>memfd</value>
Aug 27 06:32:36 user nova-compute[73258]:     </enum>
Aug 27 06:32:36 user nova-compute[73258]:   </memoryBacking>
Aug 27 06:32:36 user nova-compute[73258]:   <devices>
Aug 27 06:32:36 user nova-compute[73258]:     <disk supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='diskDevice'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>disk</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>cdrom</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>floppy</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>lun</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='bus'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>ide</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>fdc</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>scsi</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>usb</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>sata</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-non-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </disk>
Aug 27 06:32:36 user nova-compute[73258]:     <graphics supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='type'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>sdl</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vnc</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>spice</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>egl-headless</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </graphics>
Aug 27 06:32:36 user nova-compute[73258]:     <video supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='modelType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vga</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>cirrus</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vmvga</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>qxl</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>none</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>bochs</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>ramfb</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </video>
Aug 27 06:32:36 user nova-compute[73258]:     <hostdev supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='mode'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>subsystem</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='startupPolicy'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>default</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>mandatory</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>requisite</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>optional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='subsysType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>usb</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>pci</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>scsi</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='capsType'/>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='pciBackend'/>
Aug 27 06:32:36 user nova-compute[73258]:     </hostdev>
Aug 27 06:32:36 user nova-compute[73258]:     <rng supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-non-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='backendModel'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>random</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>egd</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>builtin</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </rng>
Aug 27 06:32:36 user nova-compute[73258]:     <filesystem supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='driverType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>path</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>handle</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtiofs</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </filesystem>
Aug 27 06:32:36 user nova-compute[73258]:     <tpm supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>tpm-tis</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>tpm-crb</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='backendModel'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>passthrough</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>emulator</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </tpm>
Aug 27 06:32:36 user nova-compute[73258]:   </devices>
Aug 27 06:32:36 user nova-compute[73258]:   <features>
Aug 27 06:32:36 user nova-compute[73258]:     <gic supported='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     <vmcoreinfo supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <genid supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <backingStoreInput supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <backup supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <sev supported='no'/>
Aug 27 06:32:36 user nova-compute[73258]:   </features>
Aug 27 06:32:36 user nova-compute[73258]: </domainCapabilities>
Aug 27 06:32:36 user nova-compute[73258]:  {{(pid=73258) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 27 06:32:36 user nova-compute[73258]: <domainCapabilities>
Aug 27 06:32:36 user nova-compute[73258]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 06:32:36 user nova-compute[73258]:   <domain>kvm</domain>
Aug 27 06:32:36 user nova-compute[73258]:   <machine>pc-i440fx-6.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:   <arch>i686</arch>
Aug 27 06:32:36 user nova-compute[73258]:   <vcpu max='255'/>
Aug 27 06:32:36 user nova-compute[73258]:   <iothreads supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:   <os supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:     <enum name='firmware'/>
Aug 27 06:32:36 user nova-compute[73258]:     <loader supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='type'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>rom</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>pflash</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='readonly'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>yes</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>no</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='secure'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>no</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </loader>
Aug 27 06:32:36 user nova-compute[73258]:   </os>
Aug 27 06:32:36 user nova-compute[73258]:   <cpu>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='host-passthrough' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='hostPassthroughMigratable'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>off</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='maximum' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='maximumMigratable'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>on</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>off</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='host-model' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <vendor>Intel</vendor>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ss'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='vmx'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='pcid'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='hypervisor'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='arat'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='umip'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='md-clear'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='stibp'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ssbd'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ibpb'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ibrs'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='amd-stibp'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='erms'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='lm'/>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='custom' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>qemu64</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>qemu32</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>phenom</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium3</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium2</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>n270</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>kvm64</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>kvm32</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>coreduo</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>core2duo</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>athlon</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Westmere</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Snowridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>SandyBridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Penryn</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G5</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G4</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G3</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G2</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G1</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Nehalem</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>IvyBridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Icelake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-Rome</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-Milan</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Dhyana</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cooperlake</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Conroe</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>486</model>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:   </cpu>
Aug 27 06:32:36 user nova-compute[73258]:   <memoryBacking supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:     <enum name='sourceType'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>file</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>anonymous</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>memfd</value>
Aug 27 06:32:36 user nova-compute[73258]:     </enum>
Aug 27 06:32:36 user nova-compute[73258]:   </memoryBacking>
Aug 27 06:32:36 user nova-compute[73258]:   <devices>
Aug 27 06:32:36 user nova-compute[73258]:     <disk supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='diskDevice'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>disk</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>cdrom</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>floppy</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>lun</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='bus'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>ide</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>fdc</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>scsi</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>usb</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>sata</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-non-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </disk>
Aug 27 06:32:36 user nova-compute[73258]:     <graphics supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='type'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>sdl</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vnc</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>spice</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>egl-headless</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </graphics>
Aug 27 06:32:36 user nova-compute[73258]:     <video supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='modelType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vga</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>cirrus</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vmvga</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>qxl</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>none</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>bochs</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>ramfb</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </video>
Aug 27 06:32:36 user nova-compute[73258]:     <hostdev supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='mode'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>subsystem</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='startupPolicy'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>default</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>mandatory</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>requisite</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>optional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='subsysType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>usb</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>pci</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>scsi</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='capsType'/>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='pciBackend'/>
Aug 27 06:32:36 user nova-compute[73258]:     </hostdev>
Aug 27 06:32:36 user nova-compute[73258]:     <rng supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-non-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='backendModel'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>random</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>egd</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>builtin</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </rng>
Aug 27 06:32:36 user nova-compute[73258]:     <filesystem supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='driverType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>path</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>handle</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtiofs</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </filesystem>
Aug 27 06:32:36 user nova-compute[73258]:     <tpm supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>tpm-tis</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>tpm-crb</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='backendModel'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>passthrough</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>emulator</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </tpm>
Aug 27 06:32:36 user nova-compute[73258]:   </devices>
Aug 27 06:32:36 user nova-compute[73258]:   <features>
Aug 27 06:32:36 user nova-compute[73258]:     <gic supported='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     <vmcoreinfo supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <genid supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <backingStoreInput supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <backup supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <sev supported='no'/>
Aug 27 06:32:36 user nova-compute[73258]:   </features>
Aug 27 06:32:36 user nova-compute[73258]: </domainCapabilities>
Aug 27 06:32:36 user nova-compute[73258]:  {{(pid=73258) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 27 06:32:36 user nova-compute[73258]: <domainCapabilities>
Aug 27 06:32:36 user nova-compute[73258]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 06:32:36 user nova-compute[73258]:   <domain>kvm</domain>
Aug 27 06:32:36 user nova-compute[73258]:   <machine>pc-q35-jammy</machine>
Aug 27 06:32:36 user nova-compute[73258]:   <arch>i686</arch>
Aug 27 06:32:36 user nova-compute[73258]:   <vcpu max='288'/>
Aug 27 06:32:36 user nova-compute[73258]:   <iothreads supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:   <os supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:     <enum name='firmware'/>
Aug 27 06:32:36 user nova-compute[73258]:     <loader supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='type'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>rom</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>pflash</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='readonly'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>yes</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>no</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='secure'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>no</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </loader>
Aug 27 06:32:36 user nova-compute[73258]:   </os>
Aug 27 06:32:36 user nova-compute[73258]:   <cpu>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='host-passthrough' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='hostPassthroughMigratable'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>off</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='maximum' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='maximumMigratable'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>on</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>off</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='host-model' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <vendor>Intel</vendor>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ss'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='vmx'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='pcid'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='hypervisor'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='arat'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='umip'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='md-clear'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='stibp'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ssbd'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ibpb'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ibrs'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='amd-stibp'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='erms'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='lm'/>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='custom' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>qemu64</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>qemu32</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>phenom</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium3</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium2</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>n270</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>kvm64</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>kvm32</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>coreduo</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>core2duo</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>athlon</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Westmere</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Snowridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>SandyBridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Penryn</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G5</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G4</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G3</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G2</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G1</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Nehalem</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>IvyBridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Icelake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-Rome</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-Milan</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Dhyana</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cooperlake</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Conroe</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>486</model>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:   </cpu>
Aug 27 06:32:36 user nova-compute[73258]:   <memoryBacking supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:     <enum name='sourceType'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>file</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>anonymous</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>memfd</value>
Aug 27 06:32:36 user nova-compute[73258]:     </enum>
Aug 27 06:32:36 user nova-compute[73258]:   </memoryBacking>
Aug 27 06:32:36 user nova-compute[73258]:   <devices>
Aug 27 06:32:36 user nova-compute[73258]:     <disk supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='diskDevice'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>disk</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>cdrom</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>floppy</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>lun</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='bus'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>fdc</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>scsi</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>usb</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>sata</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-non-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </disk>
Aug 27 06:32:36 user nova-compute[73258]:     <graphics supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='type'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>sdl</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vnc</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>spice</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>egl-headless</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </graphics>
Aug 27 06:32:36 user nova-compute[73258]:     <video supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='modelType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vga</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>cirrus</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vmvga</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>qxl</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>none</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>bochs</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>ramfb</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </video>
Aug 27 06:32:36 user nova-compute[73258]:     <hostdev supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='mode'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>subsystem</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='startupPolicy'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>default</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>mandatory</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>requisite</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>optional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='subsysType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>usb</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>pci</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>scsi</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='capsType'/>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='pciBackend'/>
Aug 27 06:32:36 user nova-compute[73258]:     </hostdev>
Aug 27 06:32:36 user nova-compute[73258]:     <rng supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-non-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='backendModel'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>random</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>egd</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>builtin</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </rng>
Aug 27 06:32:36 user nova-compute[73258]:     <filesystem supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='driverType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>path</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>handle</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtiofs</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </filesystem>
Aug 27 06:32:36 user nova-compute[73258]:     <tpm supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>tpm-tis</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>tpm-crb</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='backendModel'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>passthrough</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>emulator</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </tpm>
Aug 27 06:32:36 user nova-compute[73258]:   </devices>
Aug 27 06:32:36 user nova-compute[73258]:   <features>
Aug 27 06:32:36 user nova-compute[73258]:     <gic supported='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     <vmcoreinfo supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <genid supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <backingStoreInput supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <backup supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <sev supported='no'/>
Aug 27 06:32:36 user nova-compute[73258]:   </features>
Aug 27 06:32:36 user nova-compute[73258]: </domainCapabilities>
Aug 27 06:32:36 user nova-compute[73258]:  {{(pid=73258) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 27 06:32:36 user nova-compute[73258]: <domainCapabilities>
Aug 27 06:32:36 user nova-compute[73258]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 06:32:36 user nova-compute[73258]:   <domain>kvm</domain>
Aug 27 06:32:36 user nova-compute[73258]:   <machine>pc-q35-6.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:   <arch>x86_64</arch>
Aug 27 06:32:36 user nova-compute[73258]:   <vcpu max='288'/>
Aug 27 06:32:36 user nova-compute[73258]:   <iothreads supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:   <os supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:     <enum name='firmware'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>efi</value>
Aug 27 06:32:36 user nova-compute[73258]:     </enum>
Aug 27 06:32:36 user nova-compute[73258]:     <loader supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='type'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>rom</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>pflash</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='readonly'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>yes</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>no</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='secure'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>yes</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>no</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </loader>
Aug 27 06:32:36 user nova-compute[73258]:   </os>
Aug 27 06:32:36 user nova-compute[73258]:   <cpu>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='host-passthrough' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='hostPassthroughMigratable'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>on</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>off</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='maximum' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='maximumMigratable'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>on</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>off</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='host-model' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <vendor>Intel</vendor>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ss'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='vmx'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='pcid'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='hypervisor'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='arat'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='umip'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='md-clear'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='stibp'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ssbd'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='invtsc'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ibpb'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ibrs'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='amd-stibp'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='rsba'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='erms'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='custom' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>qemu64</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>qemu32</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>phenom</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium3</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium2</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>n270</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>kvm64</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>kvm32</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>coreduo</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>core2duo</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>athlon</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Westmere</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Snowridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>SandyBridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Penryn</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G5</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G4</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G3</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G2</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Opteron_G1</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Nehalem</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>IvyBridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Icelake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-Rome</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-Milan</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Dhyana</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cooperlake</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Conroe</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>486</model>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:   </cpu>
Aug 27 06:32:36 user nova-compute[73258]:   <memoryBacking supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:     <enum name='sourceType'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>file</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>anonymous</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>memfd</value>
Aug 27 06:32:36 user nova-compute[73258]:     </enum>
Aug 27 06:32:36 user nova-compute[73258]:   </memoryBacking>
Aug 27 06:32:36 user nova-compute[73258]:   <devices>
Aug 27 06:32:36 user nova-compute[73258]:     <disk supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='diskDevice'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>disk</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>cdrom</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>floppy</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>lun</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='bus'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>fdc</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>scsi</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>usb</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>sata</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-non-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </disk>
Aug 27 06:32:36 user nova-compute[73258]:     <graphics supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='type'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>sdl</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vnc</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>spice</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>egl-headless</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </graphics>
Aug 27 06:32:36 user nova-compute[73258]:     <video supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='modelType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vga</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>cirrus</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vmvga</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>qxl</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>none</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>bochs</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>ramfb</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </video>
Aug 27 06:32:36 user nova-compute[73258]:     <hostdev supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='mode'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>subsystem</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='startupPolicy'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>default</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>mandatory</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>requisite</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>optional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='subsysType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>usb</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>pci</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>scsi</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='capsType'/>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='pciBackend'/>
Aug 27 06:32:36 user nova-compute[73258]:     </hostdev>
Aug 27 06:32:36 user nova-compute[73258]:     <rng supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-non-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='backendModel'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>random</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>egd</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>builtin</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </rng>
Aug 27 06:32:36 user nova-compute[73258]:     <filesystem supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='driverType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>path</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>handle</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtiofs</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </filesystem>
Aug 27 06:32:36 user nova-compute[73258]:     <tpm supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>tpm-tis</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>tpm-crb</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='backendModel'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>passthrough</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>emulator</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </tpm>
Aug 27 06:32:36 user nova-compute[73258]:   </devices>
Aug 27 06:32:36 user nova-compute[73258]:   <features>
Aug 27 06:32:36 user nova-compute[73258]:     <gic supported='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     <vmcoreinfo supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <genid supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <backingStoreInput supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <backup supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <sev supported='no'/>
Aug 27 06:32:36 user nova-compute[73258]:   </features>
Aug 27 06:32:36 user nova-compute[73258]: </domainCapabilities>
Aug 27 06:32:36 user nova-compute[73258]:  {{(pid=73258) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 27 06:32:36 user nova-compute[73258]: <domainCapabilities>
Aug 27 06:32:36 user nova-compute[73258]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 06:32:36 user nova-compute[73258]:   <domain>kvm</domain>
Aug 27 06:32:36 user nova-compute[73258]:   <machine>pc-i440fx-jammy</machine>
Aug 27 06:32:36 user nova-compute[73258]:   <arch>x86_64</arch>
Aug 27 06:32:36 user nova-compute[73258]:   <vcpu max='255'/>
Aug 27 06:32:36 user nova-compute[73258]:   <iothreads supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:   <os supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:     <enum name='firmware'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>efi</value>
Aug 27 06:32:36 user nova-compute[73258]:     </enum>
Aug 27 06:32:36 user nova-compute[73258]:     <loader supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='type'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>rom</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>pflash</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='readonly'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>yes</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>no</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='secure'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>no</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </loader>
Aug 27 06:32:36 user nova-compute[73258]:   </os>
Aug 27 06:32:36 user nova-compute[73258]:   <cpu>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='host-passthrough' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='hostPassthroughMigratable'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>on</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>off</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='maximum' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='maximumMigratable'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>on</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>off</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='host-model' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <vendor>Intel</vendor>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ss'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='vmx'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='pcid'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='hypervisor'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='arat'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='umip'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='md-clear'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='stibp'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ssbd'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='invtsc'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ibpb'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ibrs'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='amd-stibp'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='rsba'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='erms'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='custom' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>qemu64</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>qemu32</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>phenom</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium3</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium2</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>n270</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>kvm64</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>kvm32</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>coreduo</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>core2duo</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>athlon</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Westmere</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Snowridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>SandyBridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Penryn</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G5</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G4</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G3</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G2</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Opteron_G1</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Nehalem</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>IvyBridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Icelake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-Rome</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-Milan</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Dhyana</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cooperlake</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Conroe</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>486</model>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:   </cpu>
Aug 27 06:32:36 user nova-compute[73258]:   <memoryBacking supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:     <enum name='sourceType'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>file</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>anonymous</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>memfd</value>
Aug 27 06:32:36 user nova-compute[73258]:     </enum>
Aug 27 06:32:36 user nova-compute[73258]:   </memoryBacking>
Aug 27 06:32:36 user nova-compute[73258]:   <devices>
Aug 27 06:32:36 user nova-compute[73258]:     <disk supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='diskDevice'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>disk</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>cdrom</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>floppy</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>lun</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='bus'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>ide</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>fdc</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>scsi</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>usb</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>sata</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-non-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </disk>
Aug 27 06:32:36 user nova-compute[73258]:     <graphics supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='type'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>sdl</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vnc</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>spice</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>egl-headless</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </graphics>
Aug 27 06:32:36 user nova-compute[73258]:     <video supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='modelType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vga</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>cirrus</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vmvga</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>qxl</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>none</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>bochs</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>ramfb</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </video>
Aug 27 06:32:36 user nova-compute[73258]:     <hostdev supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='mode'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>subsystem</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='startupPolicy'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>default</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>mandatory</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>requisite</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>optional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='subsysType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>usb</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>pci</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>scsi</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='capsType'/>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='pciBackend'/>
Aug 27 06:32:36 user nova-compute[73258]:     </hostdev>
Aug 27 06:32:36 user nova-compute[73258]:     <rng supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-non-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='backendModel'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>random</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>egd</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>builtin</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </rng>
Aug 27 06:32:36 user nova-compute[73258]:     <filesystem supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='driverType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>path</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>handle</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtiofs</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </filesystem>
Aug 27 06:32:36 user nova-compute[73258]:     <tpm supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>tpm-tis</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>tpm-crb</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='backendModel'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>passthrough</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>emulator</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </tpm>
Aug 27 06:32:36 user nova-compute[73258]:   </devices>
Aug 27 06:32:36 user nova-compute[73258]:   <features>
Aug 27 06:32:36 user nova-compute[73258]:     <gic supported='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     <vmcoreinfo supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <genid supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <backingStoreInput supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <backup supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <sev supported='no'/>
Aug 27 06:32:36 user nova-compute[73258]:   </features>
Aug 27 06:32:36 user nova-compute[73258]: </domainCapabilities>
Aug 27 06:32:36 user nova-compute[73258]:  {{(pid=73258) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 27 06:32:36 user nova-compute[73258]: <domainCapabilities>
Aug 27 06:32:36 user nova-compute[73258]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 06:32:36 user nova-compute[73258]:   <domain>kvm</domain>
Aug 27 06:32:36 user nova-compute[73258]:   <machine>pc-i440fx-6.2</machine>
Aug 27 06:32:36 user nova-compute[73258]:   <arch>x86_64</arch>
Aug 27 06:32:36 user nova-compute[73258]:   <vcpu max='255'/>
Aug 27 06:32:36 user nova-compute[73258]:   <iothreads supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:   <os supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:     <enum name='firmware'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>efi</value>
Aug 27 06:32:36 user nova-compute[73258]:     </enum>
Aug 27 06:32:36 user nova-compute[73258]:     <loader supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='type'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>rom</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>pflash</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='readonly'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>yes</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>no</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='secure'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>no</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </loader>
Aug 27 06:32:36 user nova-compute[73258]:   </os>
Aug 27 06:32:36 user nova-compute[73258]:   <cpu>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='host-passthrough' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='hostPassthroughMigratable'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>on</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>off</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='maximum' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='maximumMigratable'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>on</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>off</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='host-model' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <vendor>Intel</vendor>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ss'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='vmx'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='pcid'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='hypervisor'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='arat'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='umip'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='md-clear'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='stibp'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ssbd'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='invtsc'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ibpb'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ibrs'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='amd-stibp'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='rsba'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='erms'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='custom' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>qemu64</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>qemu32</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>phenom</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium3</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium2</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>n270</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>kvm64</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>kvm32</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>coreduo</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>core2duo</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>athlon</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Westmere</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Snowridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>SandyBridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Penryn</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G5</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G4</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G3</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G2</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Opteron_G1</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Nehalem</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>IvyBridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Icelake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-Rome</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-Milan</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Dhyana</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cooperlake</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Conroe</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>486</model>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:   </cpu>
Aug 27 06:32:36 user nova-compute[73258]:   <memoryBacking supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:     <enum name='sourceType'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>file</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>anonymous</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>memfd</value>
Aug 27 06:32:36 user nova-compute[73258]:     </enum>
Aug 27 06:32:36 user nova-compute[73258]:   </memoryBacking>
Aug 27 06:32:36 user nova-compute[73258]:   <devices>
Aug 27 06:32:36 user nova-compute[73258]:     <disk supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='diskDevice'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>disk</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>cdrom</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>floppy</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>lun</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='bus'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>ide</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>fdc</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>scsi</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>usb</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>sata</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-non-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </disk>
Aug 27 06:32:36 user nova-compute[73258]:     <graphics supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='type'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>sdl</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vnc</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>spice</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>egl-headless</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </graphics>
Aug 27 06:32:36 user nova-compute[73258]:     <video supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='modelType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vga</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>cirrus</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vmvga</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>qxl</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>none</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>bochs</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>ramfb</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </video>
Aug 27 06:32:36 user nova-compute[73258]:     <hostdev supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='mode'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>subsystem</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='startupPolicy'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>default</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>mandatory</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>requisite</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>optional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='subsysType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>usb</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>pci</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>scsi</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='capsType'/>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='pciBackend'/>
Aug 27 06:32:36 user nova-compute[73258]:     </hostdev>
Aug 27 06:32:36 user nova-compute[73258]:     <rng supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-non-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='backendModel'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>random</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>egd</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>builtin</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </rng>
Aug 27 06:32:36 user nova-compute[73258]:     <filesystem supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='driverType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>path</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>handle</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtiofs</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </filesystem>
Aug 27 06:32:36 user nova-compute[73258]:     <tpm supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>tpm-tis</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>tpm-crb</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='backendModel'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>passthrough</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>emulator</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </tpm>
Aug 27 06:32:36 user nova-compute[73258]:   </devices>
Aug 27 06:32:36 user nova-compute[73258]:   <features>
Aug 27 06:32:36 user nova-compute[73258]:     <gic supported='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     <vmcoreinfo supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <genid supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <backingStoreInput supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <backup supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <sev supported='no'/>
Aug 27 06:32:36 user nova-compute[73258]:   </features>
Aug 27 06:32:36 user nova-compute[73258]: </domainCapabilities>
Aug 27 06:32:36 user nova-compute[73258]:  {{(pid=73258) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 27 06:32:36 user nova-compute[73258]: <domainCapabilities>
Aug 27 06:32:36 user nova-compute[73258]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 06:32:36 user nova-compute[73258]:   <domain>kvm</domain>
Aug 27 06:32:36 user nova-compute[73258]:   <machine>pc-q35-jammy</machine>
Aug 27 06:32:36 user nova-compute[73258]:   <arch>x86_64</arch>
Aug 27 06:32:36 user nova-compute[73258]:   <vcpu max='288'/>
Aug 27 06:32:36 user nova-compute[73258]:   <iothreads supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:   <os supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:     <enum name='firmware'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>efi</value>
Aug 27 06:32:36 user nova-compute[73258]:     </enum>
Aug 27 06:32:36 user nova-compute[73258]:     <loader supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='type'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>rom</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>pflash</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='readonly'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>yes</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>no</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='secure'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>yes</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>no</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </loader>
Aug 27 06:32:36 user nova-compute[73258]:   </os>
Aug 27 06:32:36 user nova-compute[73258]:   <cpu>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='host-passthrough' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='hostPassthroughMigratable'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>on</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>off</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='maximum' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='maximumMigratable'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>on</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>off</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='host-model' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <vendor>Intel</vendor>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ss'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='vmx'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='pcid'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='hypervisor'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='arat'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='umip'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='md-clear'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='stibp'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ssbd'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='invtsc'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ibpb'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='ibrs'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='amd-stibp'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='rsba'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='erms'/>
Aug 27 06:32:36 user nova-compute[73258]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:     <mode name='custom' supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>qemu64</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>qemu32</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>phenom</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium3</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium2</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>pentium</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>n270</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>kvm64</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>kvm32</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>coreduo</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>core2duo</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>athlon</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Westmere</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Snowridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Skylake-Client</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>SandyBridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Penryn</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G5</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G4</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G3</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Opteron_G2</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Opteron_G1</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Nehalem</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>IvyBridge</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Icelake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Haswell</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-Rome</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-Milan</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>EPYC</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Dhyana</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cooperlake</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>Conroe</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='no'>Broadwell</model>
Aug 27 06:32:36 user nova-compute[73258]:       <model usable='yes'>486</model>
Aug 27 06:32:36 user nova-compute[73258]:     </mode>
Aug 27 06:32:36 user nova-compute[73258]:   </cpu>
Aug 27 06:32:36 user nova-compute[73258]:   <memoryBacking supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:     <enum name='sourceType'>
Aug 27 06:32:36 user nova-compute[73258]:       <value>file</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>anonymous</value>
Aug 27 06:32:36 user nova-compute[73258]:       <value>memfd</value>
Aug 27 06:32:36 user nova-compute[73258]:     </enum>
Aug 27 06:32:36 user nova-compute[73258]:   </memoryBacking>
Aug 27 06:32:36 user nova-compute[73258]:   <devices>
Aug 27 06:32:36 user nova-compute[73258]:     <disk supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='diskDevice'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>disk</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>cdrom</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>floppy</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>lun</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='bus'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>fdc</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>scsi</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>usb</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>sata</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-non-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </disk>
Aug 27 06:32:36 user nova-compute[73258]:     <graphics supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='type'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>sdl</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vnc</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>spice</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>egl-headless</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </graphics>
Aug 27 06:32:36 user nova-compute[73258]:     <video supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='modelType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vga</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>cirrus</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>vmvga</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>qxl</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>none</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>bochs</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>ramfb</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </video>
Aug 27 06:32:36 user nova-compute[73258]:     <hostdev supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='mode'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>subsystem</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='startupPolicy'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>default</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>mandatory</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>requisite</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>optional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='subsysType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>usb</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>pci</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>scsi</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='capsType'/>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='pciBackend'/>
Aug 27 06:32:36 user nova-compute[73258]:     </hostdev>
Aug 27 06:32:36 user nova-compute[73258]:     <rng supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtio-non-transitional</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='backendModel'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>random</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>egd</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>builtin</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </rng>
Aug 27 06:32:36 user nova-compute[73258]:     <filesystem supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='driverType'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>path</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>handle</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>virtiofs</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </filesystem>
Aug 27 06:32:36 user nova-compute[73258]:     <tpm supported='yes'>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='model'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>tpm-tis</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>tpm-crb</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:       <enum name='backendModel'>
Aug 27 06:32:36 user nova-compute[73258]:         <value>passthrough</value>
Aug 27 06:32:36 user nova-compute[73258]:         <value>emulator</value>
Aug 27 06:32:36 user nova-compute[73258]:       </enum>
Aug 27 06:32:36 user nova-compute[73258]:     </tpm>
Aug 27 06:32:36 user nova-compute[73258]:   </devices>
Aug 27 06:32:36 user nova-compute[73258]:   <features>
Aug 27 06:32:36 user nova-compute[73258]:     <gic supported='no'/>
Aug 27 06:32:36 user nova-compute[73258]:     <vmcoreinfo supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <genid supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <backingStoreInput supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <backup supported='yes'/>
Aug 27 06:32:36 user nova-compute[73258]:     <sev supported='no'/>
Aug 27 06:32:36 user nova-compute[73258]:   </features>
Aug 27 06:32:36 user nova-compute[73258]: </domainCapabilities>
Aug 27 06:32:36 user nova-compute[73258]:  {{(pid=73258) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Checking secure boot support for host arch (x86_64) {{(pid=73258) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 27 06:32:36 user nova-compute[73258]: INFO nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Secure Boot support detected
Aug 27 06:32:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] cpu compare xml: <cpu match="exact">
Aug 27 06:32:36 user nova-compute[73258]:   <model>Nehalem</model>
Aug 27 06:32:36 user nova-compute[73258]: </cpu>
Aug 27 06:32:36 user nova-compute[73258]:  {{(pid=73258) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 27 06:32:36 user nova-compute[73258]: INFO nova.virt.node [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Generated node identity 13f05024-5078-4590-94a5-110d29d864c8
Aug 27 06:32:36 user nova-compute[73258]: INFO nova.virt.node [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Wrote node identity 13f05024-5078-4590-94a5-110d29d864c8 to /opt/stack/data/nova/compute_id
Aug 27 06:32:36 user nova-compute[73258]: WARNING nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Compute nodes ['13f05024-5078-4590-94a5-110d29d864c8'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 27 06:32:36 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 27 06:32:37 user nova-compute[73258]: WARNING nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 27 06:32:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:32:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:32:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:32:37 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:32:37 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:32:37 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:32:37 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Hypervisor/Node resource view: name=user free_ram=10792MB free_disk=25.053375244140625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:32:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:32:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:32:37 user nova-compute[73258]: WARNING nova.compute.resource_tracker [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] No compute node record for user:13f05024-5078-4590-94a5-110d29d864c8: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 13f05024-5078-4590-94a5-110d29d864c8 could not be found.
Aug 27 06:32:37 user nova-compute[73258]: INFO nova.compute.resource_tracker [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Compute node record created for user:user with uuid: 13f05024-5078-4590-94a5-110d29d864c8
Aug 27 06:32:37 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:32:37 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:32:37 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [req-43014ad1-0bcb-465c-86fa-39da76c021bf] Created resource provider record via placement API for resource provider with UUID 13f05024-5078-4590-94a5-110d29d864c8 and name user.
Aug 27 06:32:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73258) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 27 06:32:37 user nova-compute[73258]: INFO nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] kernel doesn't support AMD SEV
Aug 27 06:32:37 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Updating inventory in ProviderTree for provider 13f05024-5078-4590-94a5-110d29d864c8 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 06:32:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:32:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Libvirt baseline CPU <cpu>
Aug 27 06:32:37 user nova-compute[73258]:   <arch>x86_64</arch>
Aug 27 06:32:37 user nova-compute[73258]:   <model>Nehalem</model>
Aug 27 06:32:37 user nova-compute[73258]:   <vendor>Intel</vendor>
Aug 27 06:32:37 user nova-compute[73258]:   <topology sockets="6" cores="1" threads="1"/>
Aug 27 06:32:37 user nova-compute[73258]: </cpu>
Aug 27 06:32:37 user nova-compute[73258]:  {{(pid=73258) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 27 06:32:37 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Updated inventory for provider 13f05024-5078-4590-94a5-110d29d864c8 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 27 06:32:37 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Updating resource provider 13f05024-5078-4590-94a5-110d29d864c8 generation from 0 to 1 during operation: update_inventory {{(pid=73258) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 27 06:32:37 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Updating inventory in ProviderTree for provider 13f05024-5078-4590-94a5-110d29d864c8 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 06:32:37 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Updating resource provider 13f05024-5078-4590-94a5-110d29d864c8 generation from 1 to 2 during operation: update_traits {{(pid=73258) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 27 06:32:37 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:32:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:32:37 user nova-compute[73258]: DEBUG nova.service [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Creating RPC server for service compute {{(pid=73258) start /opt/stack/nova/nova/service.py:182}}
Aug 27 06:32:38 user nova-compute[73258]: DEBUG nova.service [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Join ServiceGroup membership for this service compute {{(pid=73258) start /opt/stack/nova/nova/service.py:199}}
Aug 27 06:32:38 user nova-compute[73258]: DEBUG nova.servicegroup.drivers.db [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73258) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Didn't find any instances for network info cache update. {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_power_states {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:33:33 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:33:33 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:33:33 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=10223MB free_disk=24.95700454711914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:33:33 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:34:29 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:34:29 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:34:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:34:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 06:34:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Didn't find any instances for network info cache update. {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 06:34:29 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:34:29 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:34:29 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:34:29 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:34:29 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:34:29 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:34:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:34:30 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:34:30 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:34:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:34:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:34:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:34:30 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:34:31 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:34:31 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:34:31 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=10141MB free_disk=25.00314712524414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:34:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:34:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:34:31 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:34:31 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:34:31 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:34:31 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:34:31 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:34:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:35:29 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:35:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:35:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 06:35:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Didn't find any instances for network info cache update. {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 06:35:29 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:35:29 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:35:29 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:35:30 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:35:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:35:31 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:35:31 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:35:31 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:35:32 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:35:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:35:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:35:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:35:32 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:35:33 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:35:33 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:35:33 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=10131MB free_disk=24.78746795654297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:35:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:35:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:35:33 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:35:33 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:35:33 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:35:33 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:35:33 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:35:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.108s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:29 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:36:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:36:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 06:36:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Didn't find any instances for network info cache update. {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 06:36:29 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:36:29 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:36:29 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:36:31 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:36:31 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:36:31 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:36:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:36:32 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:36:33 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:36:33 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:36:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:33 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:36:34 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:36:34 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:36:34 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=9433MB free_disk=24.819740295410156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:36:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:34 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:36:34 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:36:34 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:36:34 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:36:34 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:36:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Acquiring lock "bb57b63c-888f-40a0-88c0-97f63fd8297f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "bb57b63c-888f-40a0-88c0-97f63fd8297f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:44 user nova-compute[73258]: DEBUG nova.compute.manager [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:36:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:36:44 user nova-compute[73258]: INFO nova.compute.claims [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Claim successful on node user
Aug 27 06:36:45 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:36:45 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:36:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:36:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:36:45 user nova-compute[73258]: DEBUG nova.network.neutron [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:36:45 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:36:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:36:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:36:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:36:45 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Creating image(s)
Aug 27 06:36:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "/opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "/opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:45 user nova-compute[73258]: DEBUG nova.policy [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dcfbf648e8db4ea0abd192e7b03c369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e4e2704bd54e42a2ef6798115ae8dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:36:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33.part --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33.part --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:46 user nova-compute[73258]: DEBUG nova.virt.images [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] a1da8f3b-7558-465b-96c4-208255c7b142 was qcow2, converting to raw {{(pid=73258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 06:36:46 user nova-compute[73258]: DEBUG nova.privsep.utils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 06:36:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33.part /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33.converted {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33.part /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33.converted" returned: 0 in 0.144s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33.converted --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.557s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:47 user nova-compute[73258]: INFO oslo.privsep.daemon [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpzvs05mhp/privsep.sock']
Aug 27 06:36:47 user sudo[82582]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpzvs05mhp/privsep.sock
Aug 27 06:36:47 user sudo[82582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 27 06:36:48 user nova-compute[73258]: DEBUG nova.network.neutron [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Successfully created port: 1b826212-ad3e-49a6-a97d-7b4f0c7f5830 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:36:48 user sudo[82582]: pam_unix(sudo:session): session closed for user root
Aug 27 06:36:48 user nova-compute[73258]: INFO oslo.privsep.daemon [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Spawned new privsep daemon via rootwrap
Aug 27 06:36:48 user nova-compute[73258]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 27 06:36:48 user nova-compute[73258]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 27 06:36:48 user nova-compute[73258]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 27 06:36:48 user nova-compute[73258]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82585
Aug 27 06:36:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.196s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/disk 1073741824" returned: 0 in 0.049s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.166s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:49 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:36:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:49 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Cannot resize image /opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:36:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:36:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Ensure instance console log exists: /opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:36:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:50 user nova-compute[73258]: DEBUG nova.compute.manager [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:36:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:50 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:36:50 user nova-compute[73258]: INFO nova.compute.claims [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Claim successful on node user
Aug 27 06:36:50 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:36:50 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:36:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:50 user nova-compute[73258]: DEBUG nova.compute.manager [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:36:50 user nova-compute[73258]: DEBUG nova.compute.manager [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:36:50 user nova-compute[73258]: DEBUG nova.network.neutron [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:36:50 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:36:50 user nova-compute[73258]: DEBUG nova.compute.manager [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG nova.compute.manager [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:36:51 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Creating image(s)
Aug 27 06:36:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "/opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "/opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG nova.policy [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd74559df08d44e298ba6e2ccbaaefae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43f32eaadfd4f7eacc418385cc5e474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.178s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk 1073741824" returned: 0 in 0.083s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.152s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Cannot resize image /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Ensure instance console log exists: /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:36:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:52 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:36:52 user nova-compute[73258]: INFO nova.compute.claims [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Claim successful on node user
Aug 27 06:36:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:36:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:52 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:36:52 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:36:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:36:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.141s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:52 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:36:52 user nova-compute[73258]: INFO nova.compute.claims [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Claim successful on node user
Aug 27 06:36:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:36:52 user nova-compute[73258]: DEBUG nova.network.neutron [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:36:52 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:36:52 user nova-compute[73258]: DEBUG nova.network.neutron [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Successfully updated port: 1b826212-ad3e-49a6-a97d-7b4f0c7f5830 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:36:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Acquiring lock "refresh_cache-bb57b63c-888f-40a0-88c0-97f63fd8297f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Acquired lock "refresh_cache-bb57b63c-888f-40a0-88c0-97f63fd8297f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.network.neutron [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.policy [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67f8a06ab5634f60b6ed2d1d9b2c342e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57faf7cb6c704c05aba06857a6cdd29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:36:53 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Creating image(s)
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "/opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "/opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "/opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.177s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.network.neutron [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.network.neutron [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.compute.manager [req-cb4b694a-f463-4c79-bba8-74e9e5958b66 req-f00c6069-f3aa-40ae-adc6-35301d164383 service nova] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Received event network-changed-1b826212-ad3e-49a6-a97d-7b4f0c7f5830 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.compute.manager [req-cb4b694a-f463-4c79-bba8-74e9e5958b66 req-f00c6069-f3aa-40ae-adc6-35301d164383 service nova] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Refreshing instance network info cache due to event network-changed-1b826212-ad3e-49a6-a97d-7b4f0c7f5830. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cb4b694a-f463-4c79-bba8-74e9e5958b66 req-f00c6069-f3aa-40ae-adc6-35301d164383 service nova] Acquiring lock "refresh_cache-bb57b63c-888f-40a0-88c0-97f63fd8297f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:36:53 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.182s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk 1073741824" returned: 0 in 0.050s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.policy [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff1f51bb7163499c94ebbc93a051b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a4f958e494352aaa119a4d44a52c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:36:53 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Creating image(s)
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "/opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "/opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "/opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.network.neutron [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Successfully created port: 22202aee-0bda-40c0-9441-f014a5f99131 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.204s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.177s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Cannot resize image /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Ensure instance console log exists: /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.171s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk 1073741824" returned: 0 in 0.059s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.164s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:54 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:36:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:54 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Cannot resize image /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:36:54 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:36:54 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Ensure instance console log exists: /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:36:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.network.neutron [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Updating instance_info_cache with network_info: [{"id": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "address": "fa:16:3e:78:b4:e4", "network": {"id": "17e248c2-cdb2-407a-9707-690809f91d19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-577762610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25e4e2704bd54e42a2ef6798115ae8dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b826212-ad", "ovs_interfaceid": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:36:55 user nova-compute[73258]: INFO nova.compute.claims [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Claim successful on node user
Aug 27 06:36:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Releasing lock "refresh_cache-bb57b63c-888f-40a0-88c0-97f63fd8297f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Instance network_info: |[{"id": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "address": "fa:16:3e:78:b4:e4", "network": {"id": "17e248c2-cdb2-407a-9707-690809f91d19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-577762610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25e4e2704bd54e42a2ef6798115ae8dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b826212-ad", "ovs_interfaceid": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cb4b694a-f463-4c79-bba8-74e9e5958b66 req-f00c6069-f3aa-40ae-adc6-35301d164383 service nova] Acquired lock "refresh_cache-bb57b63c-888f-40a0-88c0-97f63fd8297f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.network.neutron [req-cb4b694a-f463-4c79-bba8-74e9e5958b66 req-f00c6069-f3aa-40ae-adc6-35301d164383 service nova] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Refreshing network info cache for port 1b826212-ad3e-49a6-a97d-7b4f0c7f5830 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Start _get_guest_xml network_info=[{"id": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "address": "fa:16:3e:78:b4:e4", "network": {"id": "17e248c2-cdb2-407a-9707-690809f91d19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-577762610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25e4e2704bd54e42a2ef6798115ae8dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b826212-ad", "ovs_interfaceid": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:36:55 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:36:55 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.privsep.utils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:36:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-919904346',display_name='tempest-DeleteServersTestJSON-server-919904346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-919904346',id=1,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25e4e2704bd54e42a2ef6798115ae8dd',ramdisk_id='',reservation_id='r-71csclza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1135220088',owner_user_name='tempest-DeleteServersTestJSON-1135220088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:36:45Z,user_data=None,user_id='dcfbf648e8db4ea0abd192e7b03c369d',uuid=bb57b63c-888f-40a0-88c0-97f63fd8297f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "address": "fa:16:3e:78:b4:e4", "network": {"id": "17e248c2-cdb2-407a-9707-690809f91d19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-577762610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25e4e2704bd54e42a2ef6798115ae8dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b826212-ad", "ovs_interfaceid": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Converting VIF {"id": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "address": "fa:16:3e:78:b4:e4", "network": {"id": "17e248c2-cdb2-407a-9707-690809f91d19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-577762610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25e4e2704bd54e42a2ef6798115ae8dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b826212-ad", "ovs_interfaceid": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:b4:e4,bridge_name='br-int',has_traffic_filtering=True,id=1b826212-ad3e-49a6-a97d-7b4f0c7f5830,network=Network(17e248c2-cdb2-407a-9707-690809f91d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b826212-ad') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.objects.instance [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lazy-loading 'pci_devices' on Instance uuid bb57b63c-888f-40a0-88c0-97f63fd8297f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:36:55 user nova-compute[73258]:   <uuid>bb57b63c-888f-40a0-88c0-97f63fd8297f</uuid>
Aug 27 06:36:55 user nova-compute[73258]:   <name>instance-00000001</name>
Aug 27 06:36:55 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:36:55 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:36:55 user nova-compute[73258]:   <metadata>
Aug 27 06:36:55 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:36:55 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:36:55 user nova-compute[73258]:       <nova:name>tempest-DeleteServersTestJSON-server-919904346</nova:name>
Aug 27 06:36:55 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:36:55</nova:creationTime>
Aug 27 06:36:55 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:36:55 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:36:55 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:36:55 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:36:55 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:36:55 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:36:55 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:36:55 user nova-compute[73258]:       <nova:owner>
Aug 27 06:36:55 user nova-compute[73258]:         <nova:user uuid="dcfbf648e8db4ea0abd192e7b03c369d">tempest-DeleteServersTestJSON-1135220088-project-member</nova:user>
Aug 27 06:36:55 user nova-compute[73258]:         <nova:project uuid="25e4e2704bd54e42a2ef6798115ae8dd">tempest-DeleteServersTestJSON-1135220088</nova:project>
Aug 27 06:36:55 user nova-compute[73258]:       </nova:owner>
Aug 27 06:36:55 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:36:55 user nova-compute[73258]:       <nova:ports>
Aug 27 06:36:55 user nova-compute[73258]:         <nova:port uuid="1b826212-ad3e-49a6-a97d-7b4f0c7f5830">
Aug 27 06:36:55 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 06:36:55 user nova-compute[73258]:         </nova:port>
Aug 27 06:36:55 user nova-compute[73258]:       </nova:ports>
Aug 27 06:36:55 user nova-compute[73258]:     </nova:instance>
Aug 27 06:36:55 user nova-compute[73258]:   </metadata>
Aug 27 06:36:55 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:36:55 user nova-compute[73258]:     <system>
Aug 27 06:36:55 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:36:55 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:36:55 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:36:55 user nova-compute[73258]:       <entry name="serial">bb57b63c-888f-40a0-88c0-97f63fd8297f</entry>
Aug 27 06:36:55 user nova-compute[73258]:       <entry name="uuid">bb57b63c-888f-40a0-88c0-97f63fd8297f</entry>
Aug 27 06:36:55 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:36:55 user nova-compute[73258]:     </system>
Aug 27 06:36:55 user nova-compute[73258]:   </sysinfo>
Aug 27 06:36:55 user nova-compute[73258]:   <os>
Aug 27 06:36:55 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:36:55 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:36:55 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:36:55 user nova-compute[73258]:   </os>
Aug 27 06:36:55 user nova-compute[73258]:   <features>
Aug 27 06:36:55 user nova-compute[73258]:     <acpi/>
Aug 27 06:36:55 user nova-compute[73258]:     <apic/>
Aug 27 06:36:55 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:36:55 user nova-compute[73258]:   </features>
Aug 27 06:36:55 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:36:55 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:36:55 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:36:55 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:36:55 user nova-compute[73258]:   </clock>
Aug 27 06:36:55 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:36:55 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:36:55 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:36:55 user nova-compute[73258]:   </cpu>
Aug 27 06:36:55 user nova-compute[73258]:   <devices>
Aug 27 06:36:55 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:36:55 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:36:55 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/disk"/>
Aug 27 06:36:55 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:36:55 user nova-compute[73258]:     </disk>
Aug 27 06:36:55 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:36:55 user nova-compute[73258]:       <mac address="fa:16:3e:78:b4:e4"/>
Aug 27 06:36:55 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:36:55 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:36:55 user nova-compute[73258]:       <target dev="tap1b826212-ad"/>
Aug 27 06:36:55 user nova-compute[73258]:     </interface>
Aug 27 06:36:55 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:36:55 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/console.log" append="off"/>
Aug 27 06:36:55 user nova-compute[73258]:     </serial>
Aug 27 06:36:55 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:36:55 user nova-compute[73258]:     <video>
Aug 27 06:36:55 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:36:55 user nova-compute[73258]:     </video>
Aug 27 06:36:55 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:36:55 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:36:55 user nova-compute[73258]:     </rng>
Aug 27 06:36:55 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:36:55 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:36:55 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:36:55 user nova-compute[73258]:     </memballoon>
Aug 27 06:36:55 user nova-compute[73258]:   </devices>
Aug 27 06:36:55 user nova-compute[73258]: </domain>
Aug 27 06:36:55 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:36:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-919904346',display_name='tempest-DeleteServersTestJSON-server-919904346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-919904346',id=1,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25e4e2704bd54e42a2ef6798115ae8dd',ramdisk_id='',reservation_id='r-71csclza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1135220088',owner_user_name='tempest-DeleteServersTestJSON-1135220088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:36:45Z,user_data=None,user_id='dcfbf648e8db4ea0abd192e7b03c369d',uuid=bb57b63c-888f-40a0-88c0-97f63fd8297f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "address": "fa:16:3e:78:b4:e4", "network": {"id": "17e248c2-cdb2-407a-9707-690809f91d19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-577762610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25e4e2704bd54e42a2ef6798115ae8dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b826212-ad", "ovs_interfaceid": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Converting VIF {"id": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "address": "fa:16:3e:78:b4:e4", "network": {"id": "17e248c2-cdb2-407a-9707-690809f91d19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-577762610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25e4e2704bd54e42a2ef6798115ae8dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b826212-ad", "ovs_interfaceid": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:b4:e4,bridge_name='br-int',has_traffic_filtering=True,id=1b826212-ad3e-49a6-a97d-7b4f0c7f5830,network=Network(17e248c2-cdb2-407a-9707-690809f91d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b826212-ad') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG os_vif [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:b4:e4,bridge_name='br-int',has_traffic_filtering=True,id=1b826212-ad3e-49a6-a97d-7b4f0c7f5830,network=Network(17e248c2-cdb2-407a-9707-690809f91d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b826212-ad') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG nova.network.neutron [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Successfully created port: f2f7670e-c9a1-437f-8143-4f7cfc60a035 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Created schema index Interface.name {{(pid=73258) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Created schema index Port.name {{(pid=73258) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Created schema index Bridge.name {{(pid=73258) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [POLLOUT] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:36:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:36:55 user nova-compute[73258]: INFO oslo.privsep.daemon [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp3oy037gb/privsep.sock']
Aug 27 06:36:55 user sudo[82694]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp3oy037gb/privsep.sock
Aug 27 06:36:55 user sudo[82694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 27 06:36:56 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:36:56 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:36:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:36:56 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Creating image(s)
Aug 27 06:36:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "/opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "/opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG nova.policy [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '526f6ab3befe4130ac81cd46f9678ebe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79d0a3715b343dea709d64cc322db6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.187s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG nova.network.neutron [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Successfully updated port: 22202aee-0bda-40c0-9441-f014a5f99131 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "refresh_cache-e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquired lock "refresh_cache-e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG nova.network.neutron [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG nova.network.neutron [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Successfully created port: a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk 1073741824" returned: 0 in 0.048s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.181s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG nova.network.neutron [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG nova.compute.manager [req-a5ddace2-e81e-4d7e-a774-54b26e5fbbf5 req-8206f3ae-a02f-4f73-9a26-1f46f10da7d6 service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Received event network-changed-22202aee-0bda-40c0-9441-f014a5f99131 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG nova.compute.manager [req-a5ddace2-e81e-4d7e-a774-54b26e5fbbf5 req-8206f3ae-a02f-4f73-9a26-1f46f10da7d6 service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Refreshing instance network info cache due to event network-changed-22202aee-0bda-40c0-9441-f014a5f99131. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a5ddace2-e81e-4d7e-a774-54b26e5fbbf5 req-8206f3ae-a02f-4f73-9a26-1f46f10da7d6 service nova] Acquiring lock "refresh_cache-e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Cannot resize image /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Ensure instance console log exists: /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:36:57 user sudo[82694]: pam_unix(sudo:session): session closed for user root
Aug 27 06:36:57 user nova-compute[73258]: INFO oslo.privsep.daemon [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Spawned new privsep daemon via rootwrap
Aug 27 06:36:57 user nova-compute[73258]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 27 06:36:57 user nova-compute[73258]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 27 06:36:57 user nova-compute[73258]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 27 06:36:57 user nova-compute[73258]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82716
Aug 27 06:36:57 user nova-compute[73258]: DEBUG nova.network.neutron [req-cb4b694a-f463-4c79-bba8-74e9e5958b66 req-f00c6069-f3aa-40ae-adc6-35301d164383 service nova] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Updated VIF entry in instance network info cache for port 1b826212-ad3e-49a6-a97d-7b4f0c7f5830. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG nova.network.neutron [req-cb4b694a-f463-4c79-bba8-74e9e5958b66 req-f00c6069-f3aa-40ae-adc6-35301d164383 service nova] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Updating instance_info_cache with network_info: [{"id": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "address": "fa:16:3e:78:b4:e4", "network": {"id": "17e248c2-cdb2-407a-9707-690809f91d19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-577762610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25e4e2704bd54e42a2ef6798115ae8dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b826212-ad", "ovs_interfaceid": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cb4b694a-f463-4c79-bba8-74e9e5958b66 req-f00c6069-f3aa-40ae-adc6-35301d164383 service nova] Releasing lock "refresh_cache-bb57b63c-888f-40a0-88c0-97f63fd8297f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG nova.network.neutron [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Updating instance_info_cache with network_info: [{"id": "22202aee-0bda-40c0-9441-f014a5f99131", "address": "fa:16:3e:4a:cd:08", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22202aee-0b", "ovs_interfaceid": "22202aee-0bda-40c0-9441-f014a5f99131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Releasing lock "refresh_cache-e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Instance network_info: |[{"id": "22202aee-0bda-40c0-9441-f014a5f99131", "address": "fa:16:3e:4a:cd:08", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22202aee-0b", "ovs_interfaceid": "22202aee-0bda-40c0-9441-f014a5f99131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a5ddace2-e81e-4d7e-a774-54b26e5fbbf5 req-8206f3ae-a02f-4f73-9a26-1f46f10da7d6 service nova] Acquired lock "refresh_cache-e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG nova.network.neutron [req-a5ddace2-e81e-4d7e-a774-54b26e5fbbf5 req-8206f3ae-a02f-4f73-9a26-1f46f10da7d6 service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Refreshing network info cache for port 22202aee-0bda-40c0-9441-f014a5f99131 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:36:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Start _get_guest_xml network_info=[{"id": "22202aee-0bda-40c0-9441-f014a5f99131", "address": "fa:16:3e:4a:cd:08", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22202aee-0b", "ovs_interfaceid": "22202aee-0bda-40c0-9441-f014a5f99131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:36:57 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:36:57 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:36:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-574338431',display_name='tempest-AttachVolumeNegativeTest-server-574338431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-574338431',id=2,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQ4MFm8WHy6eUHK6twNNCN3DsKMcDcxpwno8VmEqxt7IRP4qn6F+52Hnd0nAImY4EznUiVj7cwrADgXNrJEakaPM3hhsDYZ9AziFA/Bg5hPZpuLfUtLHpi9mIw4WYmNdQ==',key_name='tempest-keypair-381106654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f43f32eaadfd4f7eacc418385cc5e474',ramdisk_id='',reservation_id='r-t9yj1jpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-537954646',owner_user_name='tempest-AttachVolumeNegativeTest-537954646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:36:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd74559df08d44e298ba6e2ccbaaefae',uuid=e0e28ddd-fdc0-4db2-a4d5-64b9a724f943,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22202aee-0bda-40c0-9441-f014a5f99131", "address": "fa:16:3e:4a:cd:08", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22202aee-0b", "ovs_interfaceid": "22202aee-0bda-40c0-9441-f014a5f99131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converting VIF {"id": "22202aee-0bda-40c0-9441-f014a5f99131", "address": "fa:16:3e:4a:cd:08", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22202aee-0b", "ovs_interfaceid": "22202aee-0bda-40c0-9441-f014a5f99131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:cd:08,bridge_name='br-int',has_traffic_filtering=True,id=22202aee-0bda-40c0-9441-f014a5f99131,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22202aee-0b') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.objects.instance [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lazy-loading 'pci_devices' on Instance uuid e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:36:58 user nova-compute[73258]:   <uuid>e0e28ddd-fdc0-4db2-a4d5-64b9a724f943</uuid>
Aug 27 06:36:58 user nova-compute[73258]:   <name>instance-00000002</name>
Aug 27 06:36:58 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:36:58 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:36:58 user nova-compute[73258]:   <metadata>
Aug 27 06:36:58 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:36:58 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:36:58 user nova-compute[73258]:       <nova:name>tempest-AttachVolumeNegativeTest-server-574338431</nova:name>
Aug 27 06:36:58 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:36:57</nova:creationTime>
Aug 27 06:36:58 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:36:58 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:36:58 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:36:58 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:36:58 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:36:58 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:36:58 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:36:58 user nova-compute[73258]:       <nova:owner>
Aug 27 06:36:58 user nova-compute[73258]:         <nova:user uuid="fd74559df08d44e298ba6e2ccbaaefae">tempest-AttachVolumeNegativeTest-537954646-project-member</nova:user>
Aug 27 06:36:58 user nova-compute[73258]:         <nova:project uuid="f43f32eaadfd4f7eacc418385cc5e474">tempest-AttachVolumeNegativeTest-537954646</nova:project>
Aug 27 06:36:58 user nova-compute[73258]:       </nova:owner>
Aug 27 06:36:58 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:36:58 user nova-compute[73258]:       <nova:ports>
Aug 27 06:36:58 user nova-compute[73258]:         <nova:port uuid="22202aee-0bda-40c0-9441-f014a5f99131">
Aug 27 06:36:58 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 06:36:58 user nova-compute[73258]:         </nova:port>
Aug 27 06:36:58 user nova-compute[73258]:       </nova:ports>
Aug 27 06:36:58 user nova-compute[73258]:     </nova:instance>
Aug 27 06:36:58 user nova-compute[73258]:   </metadata>
Aug 27 06:36:58 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:36:58 user nova-compute[73258]:     <system>
Aug 27 06:36:58 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:36:58 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:36:58 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:36:58 user nova-compute[73258]:       <entry name="serial">e0e28ddd-fdc0-4db2-a4d5-64b9a724f943</entry>
Aug 27 06:36:58 user nova-compute[73258]:       <entry name="uuid">e0e28ddd-fdc0-4db2-a4d5-64b9a724f943</entry>
Aug 27 06:36:58 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:36:58 user nova-compute[73258]:     </system>
Aug 27 06:36:58 user nova-compute[73258]:   </sysinfo>
Aug 27 06:36:58 user nova-compute[73258]:   <os>
Aug 27 06:36:58 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:36:58 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:36:58 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:36:58 user nova-compute[73258]:   </os>
Aug 27 06:36:58 user nova-compute[73258]:   <features>
Aug 27 06:36:58 user nova-compute[73258]:     <acpi/>
Aug 27 06:36:58 user nova-compute[73258]:     <apic/>
Aug 27 06:36:58 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:36:58 user nova-compute[73258]:   </features>
Aug 27 06:36:58 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:36:58 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:36:58 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:36:58 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:36:58 user nova-compute[73258]:   </clock>
Aug 27 06:36:58 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:36:58 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:36:58 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:36:58 user nova-compute[73258]:   </cpu>
Aug 27 06:36:58 user nova-compute[73258]:   <devices>
Aug 27 06:36:58 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:36:58 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:36:58 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk"/>
Aug 27 06:36:58 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:36:58 user nova-compute[73258]:     </disk>
Aug 27 06:36:58 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:36:58 user nova-compute[73258]:       <mac address="fa:16:3e:4a:cd:08"/>
Aug 27 06:36:58 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:36:58 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:36:58 user nova-compute[73258]:       <target dev="tap22202aee-0b"/>
Aug 27 06:36:58 user nova-compute[73258]:     </interface>
Aug 27 06:36:58 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:36:58 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/console.log" append="off"/>
Aug 27 06:36:58 user nova-compute[73258]:     </serial>
Aug 27 06:36:58 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:36:58 user nova-compute[73258]:     <video>
Aug 27 06:36:58 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:36:58 user nova-compute[73258]:     </video>
Aug 27 06:36:58 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:36:58 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:36:58 user nova-compute[73258]:     </rng>
Aug 27 06:36:58 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:36:58 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:36:58 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:36:58 user nova-compute[73258]:     </memballoon>
Aug 27 06:36:58 user nova-compute[73258]:   </devices>
Aug 27 06:36:58 user nova-compute[73258]: </domain>
Aug 27 06:36:58 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:36:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-574338431',display_name='tempest-AttachVolumeNegativeTest-server-574338431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-574338431',id=2,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQ4MFm8WHy6eUHK6twNNCN3DsKMcDcxpwno8VmEqxt7IRP4qn6F+52Hnd0nAImY4EznUiVj7cwrADgXNrJEakaPM3hhsDYZ9AziFA/Bg5hPZpuLfUtLHpi9mIw4WYmNdQ==',key_name='tempest-keypair-381106654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f43f32eaadfd4f7eacc418385cc5e474',ramdisk_id='',reservation_id='r-t9yj1jpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-537954646',owner_user_name='tempest-AttachVolumeNegativeTest-537954646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:36:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd74559df08d44e298ba6e2ccbaaefae',uuid=e0e28ddd-fdc0-4db2-a4d5-64b9a724f943,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22202aee-0bda-40c0-9441-f014a5f99131", "address": "fa:16:3e:4a:cd:08", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22202aee-0b", "ovs_interfaceid": "22202aee-0bda-40c0-9441-f014a5f99131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converting VIF {"id": "22202aee-0bda-40c0-9441-f014a5f99131", "address": "fa:16:3e:4a:cd:08", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22202aee-0b", "ovs_interfaceid": "22202aee-0bda-40c0-9441-f014a5f99131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:cd:08,bridge_name='br-int',has_traffic_filtering=True,id=22202aee-0bda-40c0-9441-f014a5f99131,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22202aee-0b') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG os_vif [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:cd:08,bridge_name='br-int',has_traffic_filtering=True,id=22202aee-0bda-40c0-9441-f014a5f99131,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22202aee-0b') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b826212-ad, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1b826212-ad, col_values=(('external_ids', {'iface-id': '1b826212-ad3e-49a6-a97d-7b4f0c7f5830', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:b4:e4', 'vm-uuid': 'bb57b63c-888f-40a0-88c0-97f63fd8297f'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:36:58 user nova-compute[73258]: INFO os_vif [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:b4:e4,bridge_name='br-int',has_traffic_filtering=True,id=1b826212-ad3e-49a6-a97d-7b4f0c7f5830,network=Network(17e248c2-cdb2-407a-9707-690809f91d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b826212-ad')
Aug 27 06:36:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22202aee-0b, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22202aee-0b, col_values=(('external_ids', {'iface-id': '22202aee-0bda-40c0-9441-f014a5f99131', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:cd:08', 'vm-uuid': 'e0e28ddd-fdc0-4db2-a4d5-64b9a724f943'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:36:58 user nova-compute[73258]: INFO os_vif [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:cd:08,bridge_name='br-int',has_traffic_filtering=True,id=22202aee-0bda-40c0-9441-f014a5f99131,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22202aee-0b')
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] No VIF found with MAC fa:16:3e:78:b4:e4, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:36:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] No VIF found with MAC fa:16:3e:4a:cd:08, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:36:59 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Successfully created port: a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:36:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:36:59 user nova-compute[73258]: DEBUG nova.network.neutron [req-a5ddace2-e81e-4d7e-a774-54b26e5fbbf5 req-8206f3ae-a02f-4f73-9a26-1f46f10da7d6 service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Updated VIF entry in instance network info cache for port 22202aee-0bda-40c0-9441-f014a5f99131. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:36:59 user nova-compute[73258]: DEBUG nova.network.neutron [req-a5ddace2-e81e-4d7e-a774-54b26e5fbbf5 req-8206f3ae-a02f-4f73-9a26-1f46f10da7d6 service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Updating instance_info_cache with network_info: [{"id": "22202aee-0bda-40c0-9441-f014a5f99131", "address": "fa:16:3e:4a:cd:08", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22202aee-0b", "ovs_interfaceid": "22202aee-0bda-40c0-9441-f014a5f99131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:36:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a5ddace2-e81e-4d7e-a774-54b26e5fbbf5 req-8206f3ae-a02f-4f73-9a26-1f46f10da7d6 service nova] Releasing lock "refresh_cache-e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:37:00 user nova-compute[73258]: DEBUG nova.network.neutron [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Successfully updated port: f2f7670e-c9a1-437f-8143-4f7cfc60a035 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:37:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:37:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquired lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:37:00 user nova-compute[73258]: DEBUG nova.network.neutron [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:37:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:00 user nova-compute[73258]: DEBUG nova.network.neutron [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:37:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:00 user nova-compute[73258]: DEBUG nova.compute.manager [req-2c2e2526-9860-4f5f-8b39-c659ef7e0d68 req-a45e69b1-4818-45cf-9645-b45d6ee1afbe service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Received event network-changed-f2f7670e-c9a1-437f-8143-4f7cfc60a035 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:00 user nova-compute[73258]: DEBUG nova.compute.manager [req-2c2e2526-9860-4f5f-8b39-c659ef7e0d68 req-a45e69b1-4818-45cf-9645-b45d6ee1afbe service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Refreshing instance network info cache due to event network-changed-f2f7670e-c9a1-437f-8143-4f7cfc60a035. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:37:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2c2e2526-9860-4f5f-8b39-c659ef7e0d68 req-a45e69b1-4818-45cf-9645-b45d6ee1afbe service nova] Acquiring lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:37:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.network.neutron [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Successfully updated port: a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquired lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.network.neutron [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.network.neutron [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.network.neutron [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Updating instance_info_cache with network_info: [{"id": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "address": "fa:16:3e:82:0b:22", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f7670e-c9", "ovs_interfaceid": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Releasing lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.compute.manager [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Instance network_info: |[{"id": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "address": "fa:16:3e:82:0b:22", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f7670e-c9", "ovs_interfaceid": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2c2e2526-9860-4f5f-8b39-c659ef7e0d68 req-a45e69b1-4818-45cf-9645-b45d6ee1afbe service nova] Acquired lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.network.neutron [req-2c2e2526-9860-4f5f-8b39-c659ef7e0d68 req-a45e69b1-4818-45cf-9645-b45d6ee1afbe service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Refreshing network info cache for port f2f7670e-c9a1-437f-8143-4f7cfc60a035 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Start _get_guest_xml network_info=[{"id": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "address": "fa:16:3e:82:0b:22", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f7670e-c9", "ovs_interfaceid": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:37:01 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:37:01 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:37:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1407957058',display_name='tempest-ServerActionsTestOtherA-server-1407957058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1407957058',id=3,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/KYWUE6gNqqFSSqcTnsAI5+JZTptdXjLfwtgiVKLM8n2N6Y2L8s6Bg81l6XDxMjw3BfYNizv1BnMF+y6NIh1U/xVCMRNK16iGCh/62JzPGiCS6K24meGZJ+ETPM0mnhw==',key_name='tempest-keypair-1255305482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57faf7cb6c704c05aba06857a6cdd29f',ramdisk_id='',reservation_id='r-v66hy8sm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1477462030',owner_user_name='tempest-ServerActionsTestOtherA-1477462030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:36:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f8a06ab5634f60b6ed2d1d9b2c342e',uuid=75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "address": "fa:16:3e:82:0b:22", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f7670e-c9", "ovs_interfaceid": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converting VIF {"id": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "address": "fa:16:3e:82:0b:22", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f7670e-c9", "ovs_interfaceid": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:0b:22,bridge_name='br-int',has_traffic_filtering=True,id=f2f7670e-c9a1-437f-8143-4f7cfc60a035,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f7670e-c9') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.objects.instance [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lazy-loading 'pci_devices' on Instance uuid 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:37:02 user nova-compute[73258]:   <uuid>75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc</uuid>
Aug 27 06:37:02 user nova-compute[73258]:   <name>instance-00000003</name>
Aug 27 06:37:02 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:37:02 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:37:02 user nova-compute[73258]:   <metadata>
Aug 27 06:37:02 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:37:02 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:37:02 user nova-compute[73258]:       <nova:name>tempest-ServerActionsTestOtherA-server-1407957058</nova:name>
Aug 27 06:37:02 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:37:01</nova:creationTime>
Aug 27 06:37:02 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:37:02 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:37:02 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:37:02 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:37:02 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:37:02 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:37:02 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:37:02 user nova-compute[73258]:       <nova:owner>
Aug 27 06:37:02 user nova-compute[73258]:         <nova:user uuid="67f8a06ab5634f60b6ed2d1d9b2c342e">tempest-ServerActionsTestOtherA-1477462030-project-member</nova:user>
Aug 27 06:37:02 user nova-compute[73258]:         <nova:project uuid="57faf7cb6c704c05aba06857a6cdd29f">tempest-ServerActionsTestOtherA-1477462030</nova:project>
Aug 27 06:37:02 user nova-compute[73258]:       </nova:owner>
Aug 27 06:37:02 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:37:02 user nova-compute[73258]:       <nova:ports>
Aug 27 06:37:02 user nova-compute[73258]:         <nova:port uuid="f2f7670e-c9a1-437f-8143-4f7cfc60a035">
Aug 27 06:37:02 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 06:37:02 user nova-compute[73258]:         </nova:port>
Aug 27 06:37:02 user nova-compute[73258]:       </nova:ports>
Aug 27 06:37:02 user nova-compute[73258]:     </nova:instance>
Aug 27 06:37:02 user nova-compute[73258]:   </metadata>
Aug 27 06:37:02 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:37:02 user nova-compute[73258]:     <system>
Aug 27 06:37:02 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:37:02 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:37:02 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:37:02 user nova-compute[73258]:       <entry name="serial">75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc</entry>
Aug 27 06:37:02 user nova-compute[73258]:       <entry name="uuid">75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc</entry>
Aug 27 06:37:02 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:37:02 user nova-compute[73258]:     </system>
Aug 27 06:37:02 user nova-compute[73258]:   </sysinfo>
Aug 27 06:37:02 user nova-compute[73258]:   <os>
Aug 27 06:37:02 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:37:02 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:37:02 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:37:02 user nova-compute[73258]:   </os>
Aug 27 06:37:02 user nova-compute[73258]:   <features>
Aug 27 06:37:02 user nova-compute[73258]:     <acpi/>
Aug 27 06:37:02 user nova-compute[73258]:     <apic/>
Aug 27 06:37:02 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:37:02 user nova-compute[73258]:   </features>
Aug 27 06:37:02 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:37:02 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:37:02 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:37:02 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:37:02 user nova-compute[73258]:   </clock>
Aug 27 06:37:02 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:37:02 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:37:02 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:37:02 user nova-compute[73258]:   </cpu>
Aug 27 06:37:02 user nova-compute[73258]:   <devices>
Aug 27 06:37:02 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:37:02 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:37:02 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk"/>
Aug 27 06:37:02 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:37:02 user nova-compute[73258]:     </disk>
Aug 27 06:37:02 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:37:02 user nova-compute[73258]:       <mac address="fa:16:3e:82:0b:22"/>
Aug 27 06:37:02 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:37:02 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:37:02 user nova-compute[73258]:       <target dev="tapf2f7670e-c9"/>
Aug 27 06:37:02 user nova-compute[73258]:     </interface>
Aug 27 06:37:02 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:37:02 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/console.log" append="off"/>
Aug 27 06:37:02 user nova-compute[73258]:     </serial>
Aug 27 06:37:02 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:37:02 user nova-compute[73258]:     <video>
Aug 27 06:37:02 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:37:02 user nova-compute[73258]:     </video>
Aug 27 06:37:02 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:37:02 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:37:02 user nova-compute[73258]:     </rng>
Aug 27 06:37:02 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:37:02 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:37:02 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:37:02 user nova-compute[73258]:     </memballoon>
Aug 27 06:37:02 user nova-compute[73258]:   </devices>
Aug 27 06:37:02 user nova-compute[73258]: </domain>
Aug 27 06:37:02 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1407957058',display_name='tempest-ServerActionsTestOtherA-server-1407957058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1407957058',id=3,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/KYWUE6gNqqFSSqcTnsAI5+JZTptdXjLfwtgiVKLM8n2N6Y2L8s6Bg81l6XDxMjw3BfYNizv1BnMF+y6NIh1U/xVCMRNK16iGCh/62JzPGiCS6K24meGZJ+ETPM0mnhw==',key_name='tempest-keypair-1255305482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57faf7cb6c704c05aba06857a6cdd29f',ramdisk_id='',reservation_id='r-v66hy8sm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1477462030',owner_user_name='tempest-ServerActionsTestOtherA-1477462030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:36:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f8a06ab5634f60b6ed2d1d9b2c342e',uuid=75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "address": "fa:16:3e:82:0b:22", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f7670e-c9", "ovs_interfaceid": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converting VIF {"id": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "address": "fa:16:3e:82:0b:22", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f7670e-c9", "ovs_interfaceid": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:0b:22,bridge_name='br-int',has_traffic_filtering=True,id=f2f7670e-c9a1-437f-8143-4f7cfc60a035,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f7670e-c9') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG os_vif [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:0b:22,bridge_name='br-int',has_traffic_filtering=True,id=f2f7670e-c9a1-437f-8143-4f7cfc60a035,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f7670e-c9') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2f7670e-c9, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf2f7670e-c9, col_values=(('external_ids', {'iface-id': 'f2f7670e-c9a1-437f-8143-4f7cfc60a035', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:0b:22', 'vm-uuid': '75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:02 user nova-compute[73258]: INFO os_vif [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:0b:22,bridge_name='br-int',has_traffic_filtering=True,id=f2f7670e-c9a1-437f-8143-4f7cfc60a035,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f7670e-c9')
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] No VIF found with MAC fa:16:3e:82:0b:22, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.network.neutron [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Updating instance_info_cache with network_info: [{"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Releasing lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Instance network_info: |[{"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Start _get_guest_xml network_info=[{"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:37:02 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:37:02 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1601086860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1601086860',id=4,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKN9oL6K1unToy1vBLfJDEhspBZ+6nInEDeFMBSIOkLauRGrGEb7fgBw3l691stm4aY7EPmi5rpZ3MPjWGELc3hQ/yUBUE8pZ2TuVjgtNW/eoGdif/reII4vfSxWa8rL1A==',key_name='tempest-keypair-1616777814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='235a4f958e494352aaa119a4d44a52c5',ramdisk_id='',reservation_id='r-v9phxkt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1261077306',owner_user_name='tempest-AttachVolumeShelveTestJSON-1261077306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:36:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff1f51bb7163499c94ebbc93a051b4df',uuid=32ca4a64-5e49-4bbb-bf96-d3f8cf39146e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converting VIF {"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9f:3e,bridge_name='br-int',has_traffic_filtering=True,id=a345de09-b566-4d5c-8df6-5e706f31bc62,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa345de09-b5') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.objects.instance [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'pci_devices' on Instance uuid 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Successfully updated port: a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquired lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:37:02 user nova-compute[73258]:   <uuid>32ca4a64-5e49-4bbb-bf96-d3f8cf39146e</uuid>
Aug 27 06:37:02 user nova-compute[73258]:   <name>instance-00000004</name>
Aug 27 06:37:02 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:37:02 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:37:02 user nova-compute[73258]:   <metadata>
Aug 27 06:37:02 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:37:02 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:37:02 user nova-compute[73258]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1601086860</nova:name>
Aug 27 06:37:02 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:37:02</nova:creationTime>
Aug 27 06:37:02 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:37:02 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:37:02 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:37:02 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:37:02 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:37:02 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:37:02 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:37:02 user nova-compute[73258]:       <nova:owner>
Aug 27 06:37:02 user nova-compute[73258]:         <nova:user uuid="ff1f51bb7163499c94ebbc93a051b4df">tempest-AttachVolumeShelveTestJSON-1261077306-project-member</nova:user>
Aug 27 06:37:02 user nova-compute[73258]:         <nova:project uuid="235a4f958e494352aaa119a4d44a52c5">tempest-AttachVolumeShelveTestJSON-1261077306</nova:project>
Aug 27 06:37:02 user nova-compute[73258]:       </nova:owner>
Aug 27 06:37:02 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:37:02 user nova-compute[73258]:       <nova:ports>
Aug 27 06:37:02 user nova-compute[73258]:         <nova:port uuid="a345de09-b566-4d5c-8df6-5e706f31bc62">
Aug 27 06:37:02 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 06:37:02 user nova-compute[73258]:         </nova:port>
Aug 27 06:37:02 user nova-compute[73258]:       </nova:ports>
Aug 27 06:37:02 user nova-compute[73258]:     </nova:instance>
Aug 27 06:37:02 user nova-compute[73258]:   </metadata>
Aug 27 06:37:02 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:37:02 user nova-compute[73258]:     <system>
Aug 27 06:37:02 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:37:02 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:37:02 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:37:02 user nova-compute[73258]:       <entry name="serial">32ca4a64-5e49-4bbb-bf96-d3f8cf39146e</entry>
Aug 27 06:37:02 user nova-compute[73258]:       <entry name="uuid">32ca4a64-5e49-4bbb-bf96-d3f8cf39146e</entry>
Aug 27 06:37:02 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:37:02 user nova-compute[73258]:     </system>
Aug 27 06:37:02 user nova-compute[73258]:   </sysinfo>
Aug 27 06:37:02 user nova-compute[73258]:   <os>
Aug 27 06:37:02 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:37:02 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:37:02 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:37:02 user nova-compute[73258]:   </os>
Aug 27 06:37:02 user nova-compute[73258]:   <features>
Aug 27 06:37:02 user nova-compute[73258]:     <acpi/>
Aug 27 06:37:02 user nova-compute[73258]:     <apic/>
Aug 27 06:37:02 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:37:02 user nova-compute[73258]:   </features>
Aug 27 06:37:02 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:37:02 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:37:02 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:37:02 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:37:02 user nova-compute[73258]:   </clock>
Aug 27 06:37:02 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:37:02 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:37:02 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:37:02 user nova-compute[73258]:   </cpu>
Aug 27 06:37:02 user nova-compute[73258]:   <devices>
Aug 27 06:37:02 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:37:02 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:37:02 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk"/>
Aug 27 06:37:02 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:37:02 user nova-compute[73258]:     </disk>
Aug 27 06:37:02 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:37:02 user nova-compute[73258]:       <mac address="fa:16:3e:e0:9f:3e"/>
Aug 27 06:37:02 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:37:02 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:37:02 user nova-compute[73258]:       <target dev="tapa345de09-b5"/>
Aug 27 06:37:02 user nova-compute[73258]:     </interface>
Aug 27 06:37:02 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:37:02 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/console.log" append="off"/>
Aug 27 06:37:02 user nova-compute[73258]:     </serial>
Aug 27 06:37:02 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:37:02 user nova-compute[73258]:     <video>
Aug 27 06:37:02 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:37:02 user nova-compute[73258]:     </video>
Aug 27 06:37:02 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:37:02 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:37:02 user nova-compute[73258]:     </rng>
Aug 27 06:37:02 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:37:02 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:37:02 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:37:02 user nova-compute[73258]:     </memballoon>
Aug 27 06:37:02 user nova-compute[73258]:   </devices>
Aug 27 06:37:02 user nova-compute[73258]: </domain>
Aug 27 06:37:02 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1601086860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1601086860',id=4,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKN9oL6K1unToy1vBLfJDEhspBZ+6nInEDeFMBSIOkLauRGrGEb7fgBw3l691stm4aY7EPmi5rpZ3MPjWGELc3hQ/yUBUE8pZ2TuVjgtNW/eoGdif/reII4vfSxWa8rL1A==',key_name='tempest-keypair-1616777814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='235a4f958e494352aaa119a4d44a52c5',ramdisk_id='',reservation_id='r-v9phxkt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1261077306',owner_user_name='tempest-AttachVolumeShelveTestJSON-1261077306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:36:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff1f51bb7163499c94ebbc93a051b4df',uuid=32ca4a64-5e49-4bbb-bf96-d3f8cf39146e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converting VIF {"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9f:3e,bridge_name='br-int',has_traffic_filtering=True,id=a345de09-b566-4d5c-8df6-5e706f31bc62,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa345de09-b5') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG os_vif [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9f:3e,bridge_name='br-int',has_traffic_filtering=True,id=a345de09-b566-4d5c-8df6-5e706f31bc62,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa345de09-b5') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa345de09-b5, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa345de09-b5, col_values=(('external_ids', {'iface-id': 'a345de09-b566-4d5c-8df6-5e706f31bc62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:9f:3e', 'vm-uuid': '32ca4a64-5e49-4bbb-bf96-d3f8cf39146e'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:02 user nova-compute[73258]: INFO os_vif [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9f:3e,bridge_name='br-int',has_traffic_filtering=True,id=a345de09-b566-4d5c-8df6-5e706f31bc62,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa345de09-b5')
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118222.8243515, e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:37:02 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] VM Resumed (Lifecycle Event)
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.compute.manager [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.compute.manager [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.compute.manager [req-9d220ae7-8d2c-4f5a-bfc2-8155a97dbdfa req-f746794d-00b2-45b2-92c9-18d67f9930fe service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-changed-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.compute.manager [req-9d220ae7-8d2c-4f5a-bfc2-8155a97dbdfa req-f746794d-00b2-45b2-92c9-18d67f9930fe service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Refreshing instance network info cache due to event network-changed-a695f0b6-9494-4a0c-9bd1-853631b8d8f4. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9d220ae7-8d2c-4f5a-bfc2-8155a97dbdfa req-f746794d-00b2-45b2-92c9-18d67f9930fe service nova] Acquiring lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] No VIF found with MAC fa:16:3e:e0:9f:3e, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:37:02 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Instance spawned successfully.
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:37:02 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Instance spawned successfully.
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:02 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118222.8336987, e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:37:02 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] VM Started (Lifecycle Event)
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:03 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:37:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:03 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:03 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:37:03 user nova-compute[73258]: DEBUG nova.compute.manager [req-230fcec5-8804-44dc-9a7a-fcae176e0493 req-57d6b791-bd85-4e34-94b5-ed35e3613aa2 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received event network-changed-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:03 user nova-compute[73258]: DEBUG nova.compute.manager [req-230fcec5-8804-44dc-9a7a-fcae176e0493 req-57d6b791-bd85-4e34-94b5-ed35e3613aa2 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Refreshing instance network info cache due to event network-changed-a345de09-b566-4d5c-8df6-5e706f31bc62. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:37:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-230fcec5-8804-44dc-9a7a-fcae176e0493 req-57d6b791-bd85-4e34-94b5-ed35e3613aa2 service nova] Acquiring lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:37:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-230fcec5-8804-44dc-9a7a-fcae176e0493 req-57d6b791-bd85-4e34-94b5-ed35e3613aa2 service nova] Acquired lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:37:03 user nova-compute[73258]: DEBUG nova.network.neutron [req-230fcec5-8804-44dc-9a7a-fcae176e0493 req-57d6b791-bd85-4e34-94b5-ed35e3613aa2 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Refreshing network info cache for port a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:37:03 user nova-compute[73258]: INFO nova.compute.manager [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Took 17.63 seconds to spawn the instance on the hypervisor.
Aug 27 06:37:03 user nova-compute[73258]: DEBUG nova.compute.manager [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:03 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:37:03 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118222.8385005, bb57b63c-888f-40a0-88c0-97f63fd8297f => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:37:03 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] VM Resumed (Lifecycle Event)
Aug 27 06:37:03 user nova-compute[73258]: INFO nova.compute.manager [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Took 12.14 seconds to spawn the instance on the hypervisor.
Aug 27 06:37:03 user nova-compute[73258]: DEBUG nova.compute.manager [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:03 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:03 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:37:03 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:37:03 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118222.8392944, bb57b63c-888f-40a0-88c0-97f63fd8297f => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:37:03 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] VM Started (Lifecycle Event)
Aug 27 06:37:03 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:03 user nova-compute[73258]: INFO nova.compute.manager [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Took 18.57 seconds to build instance.
Aug 27 06:37:03 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:37:03 user nova-compute[73258]: INFO nova.compute.manager [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Took 12.94 seconds to build instance.
Aug 27 06:37:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-04ac20b2-e095-4702-8b25-e3a680dfcb95 tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "bb57b63c-888f-40a0-88c0-97f63fd8297f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.814s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-287c7c18-a907-45bf-a9c8-94d5203516fe tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.106s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.network.neutron [req-2c2e2526-9860-4f5f-8b39-c659ef7e0d68 req-a45e69b1-4818-45cf-9645-b45d6ee1afbe service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Updated VIF entry in instance network info cache for port f2f7670e-c9a1-437f-8143-4f7cfc60a035. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.network.neutron [req-2c2e2526-9860-4f5f-8b39-c659ef7e0d68 req-a45e69b1-4818-45cf-9645-b45d6ee1afbe service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Updating instance_info_cache with network_info: [{"id": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "address": "fa:16:3e:82:0b:22", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f7670e-c9", "ovs_interfaceid": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2c2e2526-9860-4f5f-8b39-c659ef7e0d68 req-a45e69b1-4818-45cf-9645-b45d6ee1afbe service nova] Releasing lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Updating instance_info_cache with network_info: [{"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Releasing lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Instance network_info: |[{"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9d220ae7-8d2c-4f5a-bfc2-8155a97dbdfa req-f746794d-00b2-45b2-92c9-18d67f9930fe service nova] Acquired lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.network.neutron [req-9d220ae7-8d2c-4f5a-bfc2-8155a97dbdfa req-f746794d-00b2-45b2-92c9-18d67f9930fe service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Refreshing network info cache for port a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Start _get_guest_xml network_info=[{"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:37:04 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:37:04 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1098597537',display_name='tempest-ServerStableDeviceRescueTest-server-1098597537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1098597537',id=5,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAM0bmrEujlL8AI20zgQ/6kDsTFJuTxBCGvCarDVibclhhoc8ycGQgzzGiJjqiEsO14pVdFTzq5p35TGFRRkumZiqKN3fKgLokKihqSJCwjk5FC1NUqd8yScmsAcMPUhUg==',key_name='tempest-keypair-275662107',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f79d0a3715b343dea709d64cc322db6f',ramdisk_id='',reservation_id='r-epepb7c3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-543871806',owner_user_name='tempest-ServerStableDeviceRescueTest-543871806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:36:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='526f6ab3befe4130ac81cd46f9678ebe',uuid=0a70cda7-b972-4d06-ac46-27ebb6d9d8ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Converting VIF {"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1f:48,bridge_name='br-int',has_traffic_filtering=True,id=a695f0b6-9494-4a0c-9bd1-853631b8d8f4,network=Network(2584e799-abc7-4e9b-9295-e30c677c03b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa695f0b6-94') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.objects.instance [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:37:04 user nova-compute[73258]:   <uuid>0a70cda7-b972-4d06-ac46-27ebb6d9d8ae</uuid>
Aug 27 06:37:04 user nova-compute[73258]:   <name>instance-00000005</name>
Aug 27 06:37:04 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:37:04 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:37:04 user nova-compute[73258]:   <metadata>
Aug 27 06:37:04 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:37:04 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:37:04 user nova-compute[73258]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1098597537</nova:name>
Aug 27 06:37:04 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:37:04</nova:creationTime>
Aug 27 06:37:04 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:37:04 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:37:04 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:37:04 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:37:04 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:37:04 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:37:04 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:37:04 user nova-compute[73258]:       <nova:owner>
Aug 27 06:37:04 user nova-compute[73258]:         <nova:user uuid="526f6ab3befe4130ac81cd46f9678ebe">tempest-ServerStableDeviceRescueTest-543871806-project-member</nova:user>
Aug 27 06:37:04 user nova-compute[73258]:         <nova:project uuid="f79d0a3715b343dea709d64cc322db6f">tempest-ServerStableDeviceRescueTest-543871806</nova:project>
Aug 27 06:37:04 user nova-compute[73258]:       </nova:owner>
Aug 27 06:37:04 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:37:04 user nova-compute[73258]:       <nova:ports>
Aug 27 06:37:04 user nova-compute[73258]:         <nova:port uuid="a695f0b6-9494-4a0c-9bd1-853631b8d8f4">
Aug 27 06:37:04 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 06:37:04 user nova-compute[73258]:         </nova:port>
Aug 27 06:37:04 user nova-compute[73258]:       </nova:ports>
Aug 27 06:37:04 user nova-compute[73258]:     </nova:instance>
Aug 27 06:37:04 user nova-compute[73258]:   </metadata>
Aug 27 06:37:04 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:37:04 user nova-compute[73258]:     <system>
Aug 27 06:37:04 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:37:04 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:37:04 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:37:04 user nova-compute[73258]:       <entry name="serial">0a70cda7-b972-4d06-ac46-27ebb6d9d8ae</entry>
Aug 27 06:37:04 user nova-compute[73258]:       <entry name="uuid">0a70cda7-b972-4d06-ac46-27ebb6d9d8ae</entry>
Aug 27 06:37:04 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:37:04 user nova-compute[73258]:     </system>
Aug 27 06:37:04 user nova-compute[73258]:   </sysinfo>
Aug 27 06:37:04 user nova-compute[73258]:   <os>
Aug 27 06:37:04 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:37:04 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:37:04 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:37:04 user nova-compute[73258]:   </os>
Aug 27 06:37:04 user nova-compute[73258]:   <features>
Aug 27 06:37:04 user nova-compute[73258]:     <acpi/>
Aug 27 06:37:04 user nova-compute[73258]:     <apic/>
Aug 27 06:37:04 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:37:04 user nova-compute[73258]:   </features>
Aug 27 06:37:04 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:37:04 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:37:04 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:37:04 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:37:04 user nova-compute[73258]:   </clock>
Aug 27 06:37:04 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:37:04 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:37:04 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:37:04 user nova-compute[73258]:   </cpu>
Aug 27 06:37:04 user nova-compute[73258]:   <devices>
Aug 27 06:37:04 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:37:04 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:37:04 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk"/>
Aug 27 06:37:04 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:37:04 user nova-compute[73258]:     </disk>
Aug 27 06:37:04 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:37:04 user nova-compute[73258]:       <mac address="fa:16:3e:b1:1f:48"/>
Aug 27 06:37:04 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:37:04 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:37:04 user nova-compute[73258]:       <target dev="tapa695f0b6-94"/>
Aug 27 06:37:04 user nova-compute[73258]:     </interface>
Aug 27 06:37:04 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:37:04 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/console.log" append="off"/>
Aug 27 06:37:04 user nova-compute[73258]:     </serial>
Aug 27 06:37:04 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:37:04 user nova-compute[73258]:     <video>
Aug 27 06:37:04 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:37:04 user nova-compute[73258]:     </video>
Aug 27 06:37:04 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:37:04 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:37:04 user nova-compute[73258]:     </rng>
Aug 27 06:37:04 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:37:04 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:37:04 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:37:04 user nova-compute[73258]:     </memballoon>
Aug 27 06:37:04 user nova-compute[73258]:   </devices>
Aug 27 06:37:04 user nova-compute[73258]: </domain>
Aug 27 06:37:04 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1098597537',display_name='tempest-ServerStableDeviceRescueTest-server-1098597537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1098597537',id=5,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAM0bmrEujlL8AI20zgQ/6kDsTFJuTxBCGvCarDVibclhhoc8ycGQgzzGiJjqiEsO14pVdFTzq5p35TGFRRkumZiqKN3fKgLokKihqSJCwjk5FC1NUqd8yScmsAcMPUhUg==',key_name='tempest-keypair-275662107',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f79d0a3715b343dea709d64cc322db6f',ramdisk_id='',reservation_id='r-epepb7c3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-543871806',owner_user_name='tempest-ServerStableDeviceRescueTest-543871806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:36:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='526f6ab3befe4130ac81cd46f9678ebe',uuid=0a70cda7-b972-4d06-ac46-27ebb6d9d8ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Converting VIF {"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1f:48,bridge_name='br-int',has_traffic_filtering=True,id=a695f0b6-9494-4a0c-9bd1-853631b8d8f4,network=Network(2584e799-abc7-4e9b-9295-e30c677c03b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa695f0b6-94') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG os_vif [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1f:48,bridge_name='br-int',has_traffic_filtering=True,id=a695f0b6-9494-4a0c-9bd1-853631b8d8f4,network=Network(2584e799-abc7-4e9b-9295-e30c677c03b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa695f0b6-94') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa695f0b6-94, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa695f0b6-94, col_values=(('external_ids', {'iface-id': 'a695f0b6-9494-4a0c-9bd1-853631b8d8f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:1f:48', 'vm-uuid': '0a70cda7-b972-4d06-ac46-27ebb6d9d8ae'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:04 user nova-compute[73258]: INFO os_vif [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1f:48,bridge_name='br-int',has_traffic_filtering=True,id=a695f0b6-9494-4a0c-9bd1-853631b8d8f4,network=Network(2584e799-abc7-4e9b-9295-e30c677c03b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa695f0b6-94')
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:37:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] No VIF found with MAC fa:16:3e:b1:1f:48, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:37:05 user nova-compute[73258]: DEBUG nova.network.neutron [req-230fcec5-8804-44dc-9a7a-fcae176e0493 req-57d6b791-bd85-4e34-94b5-ed35e3613aa2 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Updated VIF entry in instance network info cache for port a345de09-b566-4d5c-8df6-5e706f31bc62. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:37:05 user nova-compute[73258]: DEBUG nova.network.neutron [req-230fcec5-8804-44dc-9a7a-fcae176e0493 req-57d6b791-bd85-4e34-94b5-ed35e3613aa2 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Updating instance_info_cache with network_info: [{"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:37:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-230fcec5-8804-44dc-9a7a-fcae176e0493 req-57d6b791-bd85-4e34-94b5-ed35e3613aa2 service nova] Releasing lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:37:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:07 user nova-compute[73258]: DEBUG nova.network.neutron [req-9d220ae7-8d2c-4f5a-bfc2-8155a97dbdfa req-f746794d-00b2-45b2-92c9-18d67f9930fe service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Updated VIF entry in instance network info cache for port a695f0b6-9494-4a0c-9bd1-853631b8d8f4. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:37:07 user nova-compute[73258]: DEBUG nova.network.neutron [req-9d220ae7-8d2c-4f5a-bfc2-8155a97dbdfa req-f746794d-00b2-45b2-92c9-18d67f9930fe service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Updating instance_info_cache with network_info: [{"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:37:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9d220ae7-8d2c-4f5a-bfc2-8155a97dbdfa req-f746794d-00b2-45b2-92c9-18d67f9930fe service nova] Releasing lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:37:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-a3b12d60-8cfe-42dd-a54f-f5bd047237e6 req-0ffbe567-c36d-49cf-a85a-f59b98e96ee4 service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Received event network-vif-plugged-22202aee-0bda-40c0-9441-f014a5f99131 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a3b12d60-8cfe-42dd-a54f-f5bd047237e6 req-0ffbe567-c36d-49cf-a85a-f59b98e96ee4 service nova] Acquiring lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a3b12d60-8cfe-42dd-a54f-f5bd047237e6 req-0ffbe567-c36d-49cf-a85a-f59b98e96ee4 service nova] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a3b12d60-8cfe-42dd-a54f-f5bd047237e6 req-0ffbe567-c36d-49cf-a85a-f59b98e96ee4 service nova] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-a3b12d60-8cfe-42dd-a54f-f5bd047237e6 req-0ffbe567-c36d-49cf-a85a-f59b98e96ee4 service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] No waiting events found dispatching network-vif-plugged-22202aee-0bda-40c0-9441-f014a5f99131 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:37:09 user nova-compute[73258]: WARNING nova.compute.manager [req-a3b12d60-8cfe-42dd-a54f-f5bd047237e6 req-0ffbe567-c36d-49cf-a85a-f59b98e96ee4 service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Received unexpected event network-vif-plugged-22202aee-0bda-40c0-9441-f014a5f99131 for instance with vm_state active and task_state None.
Aug 27 06:37:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118231.4258175, 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:37:11 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] VM Resumed (Lifecycle Event)
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:37:11 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Instance spawned successfully.
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:37:11 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Instance spawned successfully.
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:11 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Instance spawned successfully.
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:37:11 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118231.425962, 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:37:11 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] VM Started (Lifecycle Event)
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:11 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118231.4341354, 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:37:11 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] VM Resumed (Lifecycle Event)
Aug 27 06:37:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:11 user nova-compute[73258]: INFO nova.compute.manager [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Took 18.09 seconds to spawn the instance on the hypervisor.
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:11 user nova-compute[73258]: INFO nova.compute.manager [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Took 18.70 seconds to spawn the instance on the hypervisor.
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:11 user nova-compute[73258]: INFO nova.compute.manager [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Took 15.46 seconds to spawn the instance on the hypervisor.
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:37:11 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118231.4343424, 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:37:11 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] VM Started (Lifecycle Event)
Aug 27 06:37:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:11 user nova-compute[73258]: INFO nova.compute.manager [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Took 19.27 seconds to build instance.
Aug 27 06:37:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:37:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-14e4846e-98b9-4a21-ac5c-63ce06268df9 req-72482548-214f-4563-9b23-6c6c44f7974b service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Received event network-vif-plugged-22202aee-0bda-40c0-9441-f014a5f99131 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-14e4846e-98b9-4a21-ac5c-63ce06268df9 req-72482548-214f-4563-9b23-6c6c44f7974b service nova] Acquiring lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-14e4846e-98b9-4a21-ac5c-63ce06268df9 req-72482548-214f-4563-9b23-6c6c44f7974b service nova] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-14e4846e-98b9-4a21-ac5c-63ce06268df9 req-72482548-214f-4563-9b23-6c6c44f7974b service nova] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-14e4846e-98b9-4a21-ac5c-63ce06268df9 req-72482548-214f-4563-9b23-6c6c44f7974b service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] No waiting events found dispatching network-vif-plugged-22202aee-0bda-40c0-9441-f014a5f99131 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:37:12 user nova-compute[73258]: WARNING nova.compute.manager [req-14e4846e-98b9-4a21-ac5c-63ce06268df9 req-72482548-214f-4563-9b23-6c6c44f7974b service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Received unexpected event network-vif-plugged-22202aee-0bda-40c0-9441-f014a5f99131 for instance with vm_state active and task_state None.
Aug 27 06:37:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8356c33a-a89e-46fe-ae32-3bdba49f9536 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.509s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:12 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:37:12 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118231.4903712, 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:37:12 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] VM Resumed (Lifecycle Event)
Aug 27 06:37:12 user nova-compute[73258]: INFO nova.compute.manager [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Took 16.63 seconds to build instance.
Aug 27 06:37:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:12 user nova-compute[73258]: INFO nova.compute.manager [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Took 19.69 seconds to build instance.
Aug 27 06:37:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bea7e5df-0096-4081-a2eb-027162961ead tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.756s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:37:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-797cafce-270d-4945-a9d2-43c4bf0df8b5 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.909s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:12 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118231.4941456, 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:37:12 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] VM Started (Lifecycle Event)
Aug 27 06:37:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:37:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-e7132326-de51-4ea4-8c9b-3ed530051b56 req-2350cfa9-eca1-4784-a321-391c3ee65523 service nova] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Received event network-vif-plugged-1b826212-ad3e-49a6-a97d-7b4f0c7f5830 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e7132326-de51-4ea4-8c9b-3ed530051b56 req-2350cfa9-eca1-4784-a321-391c3ee65523 service nova] Acquiring lock "bb57b63c-888f-40a0-88c0-97f63fd8297f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e7132326-de51-4ea4-8c9b-3ed530051b56 req-2350cfa9-eca1-4784-a321-391c3ee65523 service nova] Lock "bb57b63c-888f-40a0-88c0-97f63fd8297f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e7132326-de51-4ea4-8c9b-3ed530051b56 req-2350cfa9-eca1-4784-a321-391c3ee65523 service nova] Lock "bb57b63c-888f-40a0-88c0-97f63fd8297f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-e7132326-de51-4ea4-8c9b-3ed530051b56 req-2350cfa9-eca1-4784-a321-391c3ee65523 service nova] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] No waiting events found dispatching network-vif-plugged-1b826212-ad3e-49a6-a97d-7b4f0c7f5830 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:37:18 user nova-compute[73258]: WARNING nova.compute.manager [req-e7132326-de51-4ea4-8c9b-3ed530051b56 req-2350cfa9-eca1-4784-a321-391c3ee65523 service nova] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Received unexpected event network-vif-plugged-1b826212-ad3e-49a6-a97d-7b4f0c7f5830 for instance with vm_state active and task_state None.
Aug 27 06:37:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "33b995be-307d-4491-a1b4-fb75ececea1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "33b995be-307d-4491-a1b4-fb75ececea1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:37:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-a6e6bbb2-5ee1-4bd0-a316-9398d2e79d37 req-a609bbf2-2a48-4d35-b5ab-896b2841c042 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received event network-vif-plugged-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a6e6bbb2-5ee1-4bd0-a316-9398d2e79d37 req-a609bbf2-2a48-4d35-b5ab-896b2841c042 service nova] Acquiring lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a6e6bbb2-5ee1-4bd0-a316-9398d2e79d37 req-a609bbf2-2a48-4d35-b5ab-896b2841c042 service nova] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a6e6bbb2-5ee1-4bd0-a316-9398d2e79d37 req-a609bbf2-2a48-4d35-b5ab-896b2841c042 service nova] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-a6e6bbb2-5ee1-4bd0-a316-9398d2e79d37 req-a609bbf2-2a48-4d35-b5ab-896b2841c042 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] No waiting events found dispatching network-vif-plugged-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:37:19 user nova-compute[73258]: WARNING nova.compute.manager [req-a6e6bbb2-5ee1-4bd0-a316-9398d2e79d37 req-a609bbf2-2a48-4d35-b5ab-896b2841c042 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received unexpected event network-vif-plugged-a345de09-b566-4d5c-8df6-5e706f31bc62 for instance with vm_state active and task_state None.
Aug 27 06:37:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Acquiring lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:37:19 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:37:19 user nova-compute[73258]: INFO nova.compute.claims [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Claim successful on node user
Aug 27 06:37:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:20 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:37:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:20 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:37:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.797s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:37:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.637s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:37:20 user nova-compute[73258]: INFO nova.compute.claims [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Claim successful on node user
Aug 27 06:37:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:37:20 user nova-compute[73258]: DEBUG nova.network.neutron [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:37:20 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:37:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:37:21 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Creating image(s)
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "/opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "/opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "/opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.compute.manager [req-5f754f38-04d6-445a-a54d-6923065a4de2 req-856f9951-ab76-452f-82b7-0e3e72ef4dcb service nova] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Received event network-vif-plugged-1b826212-ad3e-49a6-a97d-7b4f0c7f5830 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5f754f38-04d6-445a-a54d-6923065a4de2 req-856f9951-ab76-452f-82b7-0e3e72ef4dcb service nova] Acquiring lock "bb57b63c-888f-40a0-88c0-97f63fd8297f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5f754f38-04d6-445a-a54d-6923065a4de2 req-856f9951-ab76-452f-82b7-0e3e72ef4dcb service nova] Lock "bb57b63c-888f-40a0-88c0-97f63fd8297f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5f754f38-04d6-445a-a54d-6923065a4de2 req-856f9951-ab76-452f-82b7-0e3e72ef4dcb service nova] Lock "bb57b63c-888f-40a0-88c0-97f63fd8297f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.compute.manager [req-5f754f38-04d6-445a-a54d-6923065a4de2 req-856f9951-ab76-452f-82b7-0e3e72ef4dcb service nova] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] No waiting events found dispatching network-vif-plugged-1b826212-ad3e-49a6-a97d-7b4f0c7f5830 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:37:21 user nova-compute[73258]: WARNING nova.compute.manager [req-5f754f38-04d6-445a-a54d-6923065a4de2 req-856f9951-ab76-452f-82b7-0e3e72ef4dcb service nova] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Received unexpected event network-vif-plugged-1b826212-ad3e-49a6-a97d-7b4f0c7f5830 for instance with vm_state active and task_state None.
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.policy [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff56e21976b246b297b6d15c9ba81c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d8e2938a0a4a97ac0b3f381626e880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.252s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.network.neutron [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:37:21 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.194s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.policy [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aeb20bad802548c4bdd6067a668d6f05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef630acc68949fd914df77f6cde70d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk 1073741824" returned: 0 in 0.064s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:37:21 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Creating image(s)
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Acquiring lock "/opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "/opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "/opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Acquiring lock "117aadf2824f7d0ca17e3bfc0cec85d49f77ec31" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "117aadf2824f7d0ca17e3bfc0cec85d49f77ec31" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.191s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.compute.manager [req-4e4ff1a5-a048-407f-a502-a17d0ad7aab6 req-1610f03d-773c-4d6c-b307-38565b438ad3 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received event network-vif-plugged-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4e4ff1a5-a048-407f-a502-a17d0ad7aab6 req-1610f03d-773c-4d6c-b307-38565b438ad3 service nova] Acquiring lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4e4ff1a5-a048-407f-a502-a17d0ad7aab6 req-1610f03d-773c-4d6c-b307-38565b438ad3 service nova] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4e4ff1a5-a048-407f-a502-a17d0ad7aab6 req-1610f03d-773c-4d6c-b307-38565b438ad3 service nova] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.compute.manager [req-4e4ff1a5-a048-407f-a502-a17d0ad7aab6 req-1610f03d-773c-4d6c-b307-38565b438ad3 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] No waiting events found dispatching network-vif-plugged-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:37:21 user nova-compute[73258]: WARNING nova.compute.manager [req-4e4ff1a5-a048-407f-a502-a17d0ad7aab6 req-1610f03d-773c-4d6c-b307-38565b438ad3 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received unexpected event network-vif-plugged-a345de09-b566-4d5c-8df6-5e706f31bc62 for instance with vm_state active and task_state None.
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.compute.manager [req-4e4ff1a5-a048-407f-a502-a17d0ad7aab6 req-1610f03d-773c-4d6c-b307-38565b438ad3 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4e4ff1a5-a048-407f-a502-a17d0ad7aab6 req-1610f03d-773c-4d6c-b307-38565b438ad3 service nova] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4e4ff1a5-a048-407f-a502-a17d0ad7aab6 req-1610f03d-773c-4d6c-b307-38565b438ad3 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4e4ff1a5-a048-407f-a502-a17d0ad7aab6 req-1610f03d-773c-4d6c-b307-38565b438ad3 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.compute.manager [req-4e4ff1a5-a048-407f-a502-a17d0ad7aab6 req-1610f03d-773c-4d6c-b307-38565b438ad3 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] No waiting events found dispatching network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:37:21 user nova-compute[73258]: WARNING nova.compute.manager [req-4e4ff1a5-a048-407f-a502-a17d0ad7aab6 req-1610f03d-773c-4d6c-b307-38565b438ad3 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received unexpected event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 for instance with vm_state active and task_state None.
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.compute.manager [req-4e4ff1a5-a048-407f-a502-a17d0ad7aab6 req-1610f03d-773c-4d6c-b307-38565b438ad3 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4e4ff1a5-a048-407f-a502-a17d0ad7aab6 req-1610f03d-773c-4d6c-b307-38565b438ad3 service nova] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4e4ff1a5-a048-407f-a502-a17d0ad7aab6 req-1610f03d-773c-4d6c-b307-38565b438ad3 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4e4ff1a5-a048-407f-a502-a17d0ad7aab6 req-1610f03d-773c-4d6c-b307-38565b438ad3 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:21 user nova-compute[73258]: DEBUG nova.compute.manager [req-4e4ff1a5-a048-407f-a502-a17d0ad7aab6 req-1610f03d-773c-4d6c-b307-38565b438ad3 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] No waiting events found dispatching network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:37:21 user nova-compute[73258]: WARNING nova.compute.manager [req-4e4ff1a5-a048-407f-a502-a17d0ad7aab6 req-1610f03d-773c-4d6c-b307-38565b438ad3 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received unexpected event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 for instance with vm_state active and task_state None.
Aug 27 06:37:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/117aadf2824f7d0ca17e3bfc0cec85d49f77ec31.part --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json" returned: 0 in 0.489s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Cannot resize image /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Ensure instance console log exists: /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/117aadf2824f7d0ca17e3bfc0cec85d49f77ec31.part --force-share --output=json" returned: 0 in 0.229s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG nova.virt.images [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] e470b548-a1b2-430d-af20-72902f307f92 was qcow2, converting to raw {{(pid=73258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG nova.privsep.utils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/117aadf2824f7d0ca17e3bfc0cec85d49f77ec31.part /opt/stack/data/nova/instances/_base/117aadf2824f7d0ca17e3bfc0cec85d49f77ec31.converted {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG nova.network.neutron [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Successfully created port: 9210c142-099e-4af9-b48b-fc0e3ddcdc23 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/117aadf2824f7d0ca17e3bfc0cec85d49f77ec31.part /opt/stack/data/nova/instances/_base/117aadf2824f7d0ca17e3bfc0cec85d49f77ec31.converted" returned: 0 in 0.281s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/117aadf2824f7d0ca17e3bfc0cec85d49f77ec31.converted --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/117aadf2824f7d0ca17e3bfc0cec85d49f77ec31.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "117aadf2824f7d0ca17e3bfc0cec85d49f77ec31" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.207s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/117aadf2824f7d0ca17e3bfc0cec85d49f77ec31 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG nova.network.neutron [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Successfully created port: 5d69f70a-cd94-4b7b-abc9-652fc681c98b {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:37:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/117aadf2824f7d0ca17e3bfc0cec85d49f77ec31 --force-share --output=json" returned: 0 in 0.236s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Acquiring lock "117aadf2824f7d0ca17e3bfc0cec85d49f77ec31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "117aadf2824f7d0ca17e3bfc0cec85d49f77ec31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/117aadf2824f7d0ca17e3bfc0cec85d49f77ec31 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/117aadf2824f7d0ca17e3bfc0cec85d49f77ec31 --force-share --output=json" returned: 0 in 0.256s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/117aadf2824f7d0ca17e3bfc0cec85d49f77ec31,backing_fmt=raw /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/117aadf2824f7d0ca17e3bfc0cec85d49f77ec31,backing_fmt=raw /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk 1073741824" returned: 0 in 0.077s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "117aadf2824f7d0ca17e3bfc0cec85d49f77ec31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.339s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/117aadf2824f7d0ca17e3bfc0cec85d49f77ec31 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/117aadf2824f7d0ca17e3bfc0cec85d49f77ec31 --force-share --output=json" returned: 0 in 0.205s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:23 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:37:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:23 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Cannot resize image /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:37:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:37:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Ensure instance console log exists: /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:37:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.network.neutron [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Successfully updated port: 9210c142-099e-4af9-b48b-fc0e3ddcdc23 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Acquiring lock "refresh_cache-e76827f8-dbbf-45fa-a84e-7f5dd0c62912" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Acquired lock "refresh_cache-e76827f8-dbbf-45fa-a84e-7f5dd0c62912" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.network.neutron [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-81195339-51d8-4fcc-a17f-3f43a1526eb6 req-8d3fa797-d06b-4750-8570-84534dc9e826 service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Received event network-changed-9210c142-099e-4af9-b48b-fc0e3ddcdc23 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-81195339-51d8-4fcc-a17f-3f43a1526eb6 req-8d3fa797-d06b-4750-8570-84534dc9e826 service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Refreshing instance network info cache due to event network-changed-9210c142-099e-4af9-b48b-fc0e3ddcdc23. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-81195339-51d8-4fcc-a17f-3f43a1526eb6 req-8d3fa797-d06b-4750-8570-84534dc9e826 service nova] Acquiring lock "refresh_cache-e76827f8-dbbf-45fa-a84e-7f5dd0c62912" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.network.neutron [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.network.neutron [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Successfully updated port: 5d69f70a-cd94-4b7b-abc9-652fc681c98b {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "refresh_cache-33b995be-307d-4491-a1b4-fb75ececea1d" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquired lock "refresh_cache-33b995be-307d-4491-a1b4-fb75ececea1d" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.network.neutron [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-157980ff-77d8-4ed4-a149-ee188fd63c44 req-ecab612c-b19f-4ee1-b56d-f524861dfc91 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Received event network-changed-5d69f70a-cd94-4b7b-abc9-652fc681c98b {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-157980ff-77d8-4ed4-a149-ee188fd63c44 req-ecab612c-b19f-4ee1-b56d-f524861dfc91 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Refreshing instance network info cache due to event network-changed-5d69f70a-cd94-4b7b-abc9-652fc681c98b. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-157980ff-77d8-4ed4-a149-ee188fd63c44 req-ecab612c-b19f-4ee1-b56d-f524861dfc91 service nova] Acquiring lock "refresh_cache-33b995be-307d-4491-a1b4-fb75ececea1d" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.network.neutron [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Updating instance_info_cache with network_info: [{"id": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "address": "fa:16:3e:f8:77:a4", "network": {"id": "3819e7d4-2dc4-42e1-b2d6-8db84f0bb603", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-44170955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef630acc68949fd914df77f6cde70d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9210c142-09", "ovs_interfaceid": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Releasing lock "refresh_cache-e76827f8-dbbf-45fa-a84e-7f5dd0c62912" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Instance network_info: |[{"id": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "address": "fa:16:3e:f8:77:a4", "network": {"id": "3819e7d4-2dc4-42e1-b2d6-8db84f0bb603", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-44170955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef630acc68949fd914df77f6cde70d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9210c142-09", "ovs_interfaceid": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-81195339-51d8-4fcc-a17f-3f43a1526eb6 req-8d3fa797-d06b-4750-8570-84534dc9e826 service nova] Acquired lock "refresh_cache-e76827f8-dbbf-45fa-a84e-7f5dd0c62912" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.network.neutron [req-81195339-51d8-4fcc-a17f-3f43a1526eb6 req-8d3fa797-d06b-4750-8570-84534dc9e826 service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Refreshing network info cache for port 9210c142-099e-4af9-b48b-fc0e3ddcdc23 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Start _get_guest_xml network_info=[{"id": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "address": "fa:16:3e:f8:77:a4", "network": {"id": "3819e7d4-2dc4-42e1-b2d6-8db84f0bb603", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-44170955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef630acc68949fd914df77f6cde70d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9210c142-09", "ovs_interfaceid": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:37:12Z,direct_url=<?>,disk_format='qcow2',id=e470b548-a1b2-430d-af20-72902f307f92,min_disk=0,min_ram=0,name='',owner='fcda7f07cc1147bf9d3fddff25327811',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:37:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'scsi', 'boot_index': 0, 'image_id': 'e470b548-a1b2-430d-af20-72902f307f92'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:24 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:37:24 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.network.neutron [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:37:12Z,direct_url=<?>,disk_format='qcow2',id=e470b548-a1b2-430d-af20-72902f307f92,min_disk=0,min_ram=0,name='',owner='fcda7f07cc1147bf9d3fddff25327811',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:37:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-475161399',display_name='tempest-AttachSCSIVolumeTestJSON-server-475161399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-475161399',id=7,image_ref='e470b548-a1b2-430d-af20-72902f307f92',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUb/pprsCx9GbvnGdwrdo30pEVY7mVwvtzSQLGyVHP0E7BATTSsE/ymYUSHwvHnRWiHvlGjqBHnLILdP5XOjEbpT+u45zDv2yCUko+IyjLy+2Ycw7METAcM6N6kgRfKbg==',key_name='tempest-keypair-126198669',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ef630acc68949fd914df77f6cde70d7',ramdisk_id='',reservation_id='r-wiv6qm22',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e470b548-a1b2-430d-af20-72902f307f92',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-184780235',owner_user_name='tempest-AttachSCSIVolumeTestJSON-184780235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:37:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeb20bad802548c4bdd6067a668d6f05',uuid=e76827f8-dbbf-45fa-a84e-7f5dd0c62912,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "address": "fa:16:3e:f8:77:a4", "network": {"id": "3819e7d4-2dc4-42e1-b2d6-8db84f0bb603", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-44170955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef630acc68949fd914df77f6cde70d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9210c142-09", "ovs_interfaceid": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Converting VIF {"id": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "address": "fa:16:3e:f8:77:a4", "network": {"id": "3819e7d4-2dc4-42e1-b2d6-8db84f0bb603", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-44170955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef630acc68949fd914df77f6cde70d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9210c142-09", "ovs_interfaceid": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:77:a4,bridge_name='br-int',has_traffic_filtering=True,id=9210c142-099e-4af9-b48b-fc0e3ddcdc23,network=Network(3819e7d4-2dc4-42e1-b2d6-8db84f0bb603),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9210c142-09') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.objects.instance [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lazy-loading 'pci_devices' on Instance uuid e76827f8-dbbf-45fa-a84e-7f5dd0c62912 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:37:24 user nova-compute[73258]:   <uuid>e76827f8-dbbf-45fa-a84e-7f5dd0c62912</uuid>
Aug 27 06:37:24 user nova-compute[73258]:   <name>instance-00000007</name>
Aug 27 06:37:24 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:37:24 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:37:24 user nova-compute[73258]:   <metadata>
Aug 27 06:37:24 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:37:24 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:37:24 user nova-compute[73258]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-475161399</nova:name>
Aug 27 06:37:24 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:37:24</nova:creationTime>
Aug 27 06:37:24 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:37:24 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:37:24 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:37:24 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:37:24 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:37:24 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:37:24 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:37:24 user nova-compute[73258]:       <nova:owner>
Aug 27 06:37:24 user nova-compute[73258]:         <nova:user uuid="aeb20bad802548c4bdd6067a668d6f05">tempest-AttachSCSIVolumeTestJSON-184780235-project-member</nova:user>
Aug 27 06:37:24 user nova-compute[73258]:         <nova:project uuid="0ef630acc68949fd914df77f6cde70d7">tempest-AttachSCSIVolumeTestJSON-184780235</nova:project>
Aug 27 06:37:24 user nova-compute[73258]:       </nova:owner>
Aug 27 06:37:24 user nova-compute[73258]:       <nova:root type="image" uuid="e470b548-a1b2-430d-af20-72902f307f92"/>
Aug 27 06:37:24 user nova-compute[73258]:       <nova:ports>
Aug 27 06:37:24 user nova-compute[73258]:         <nova:port uuid="9210c142-099e-4af9-b48b-fc0e3ddcdc23">
Aug 27 06:37:24 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 06:37:24 user nova-compute[73258]:         </nova:port>
Aug 27 06:37:24 user nova-compute[73258]:       </nova:ports>
Aug 27 06:37:24 user nova-compute[73258]:     </nova:instance>
Aug 27 06:37:24 user nova-compute[73258]:   </metadata>
Aug 27 06:37:24 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:37:24 user nova-compute[73258]:     <system>
Aug 27 06:37:24 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:37:24 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:37:24 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:37:24 user nova-compute[73258]:       <entry name="serial">e76827f8-dbbf-45fa-a84e-7f5dd0c62912</entry>
Aug 27 06:37:24 user nova-compute[73258]:       <entry name="uuid">e76827f8-dbbf-45fa-a84e-7f5dd0c62912</entry>
Aug 27 06:37:24 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:37:24 user nova-compute[73258]:     </system>
Aug 27 06:37:24 user nova-compute[73258]:   </sysinfo>
Aug 27 06:37:24 user nova-compute[73258]:   <os>
Aug 27 06:37:24 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:37:24 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:37:24 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:37:24 user nova-compute[73258]:   </os>
Aug 27 06:37:24 user nova-compute[73258]:   <features>
Aug 27 06:37:24 user nova-compute[73258]:     <acpi/>
Aug 27 06:37:24 user nova-compute[73258]:     <apic/>
Aug 27 06:37:24 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:37:24 user nova-compute[73258]:   </features>
Aug 27 06:37:24 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:37:24 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:37:24 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:37:24 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:37:24 user nova-compute[73258]:   </clock>
Aug 27 06:37:24 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:37:24 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:37:24 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:37:24 user nova-compute[73258]:   </cpu>
Aug 27 06:37:24 user nova-compute[73258]:   <devices>
Aug 27 06:37:24 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:37:24 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:37:24 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk"/>
Aug 27 06:37:24 user nova-compute[73258]:       <target dev="sda" bus="scsi"/>
Aug 27 06:37:24 user nova-compute[73258]:       <address type="drive" controller="0" unit="0"/>
Aug 27 06:37:24 user nova-compute[73258]:     </disk>
Aug 27 06:37:24 user nova-compute[73258]:     <disk type="file" device="cdrom">
Aug 27 06:37:24 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 06:37:24 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk.config"/>
Aug 27 06:37:24 user nova-compute[73258]:       <target dev="sdb" bus="scsi"/>
Aug 27 06:37:24 user nova-compute[73258]:       <address type="drive" controller="0" unit="1"/>
Aug 27 06:37:24 user nova-compute[73258]:     </disk>
Aug 27 06:37:24 user nova-compute[73258]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 27 06:37:24 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:37:24 user nova-compute[73258]:       <mac address="fa:16:3e:f8:77:a4"/>
Aug 27 06:37:24 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:37:24 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:37:24 user nova-compute[73258]:       <target dev="tap9210c142-09"/>
Aug 27 06:37:24 user nova-compute[73258]:     </interface>
Aug 27 06:37:24 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:37:24 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/console.log" append="off"/>
Aug 27 06:37:24 user nova-compute[73258]:     </serial>
Aug 27 06:37:24 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:37:24 user nova-compute[73258]:     <video>
Aug 27 06:37:24 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:37:24 user nova-compute[73258]:     </video>
Aug 27 06:37:24 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:37:24 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:37:24 user nova-compute[73258]:     </rng>
Aug 27 06:37:24 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:37:24 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:37:24 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:37:24 user nova-compute[73258]:     </memballoon>
Aug 27 06:37:24 user nova-compute[73258]:   </devices>
Aug 27 06:37:24 user nova-compute[73258]: </domain>
Aug 27 06:37:24 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-475161399',display_name='tempest-AttachSCSIVolumeTestJSON-server-475161399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-475161399',id=7,image_ref='e470b548-a1b2-430d-af20-72902f307f92',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUb/pprsCx9GbvnGdwrdo30pEVY7mVwvtzSQLGyVHP0E7BATTSsE/ymYUSHwvHnRWiHvlGjqBHnLILdP5XOjEbpT+u45zDv2yCUko+IyjLy+2Ycw7METAcM6N6kgRfKbg==',key_name='tempest-keypair-126198669',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ef630acc68949fd914df77f6cde70d7',ramdisk_id='',reservation_id='r-wiv6qm22',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e470b548-a1b2-430d-af20-72902f307f92',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-184780235',owner_user_name='tempest-AttachSCSIVolumeTestJSON-184780235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:37:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeb20bad802548c4bdd6067a668d6f05',uuid=e76827f8-dbbf-45fa-a84e-7f5dd0c62912,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "address": "fa:16:3e:f8:77:a4", "network": {"id": "3819e7d4-2dc4-42e1-b2d6-8db84f0bb603", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-44170955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef630acc68949fd914df77f6cde70d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9210c142-09", "ovs_interfaceid": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Converting VIF {"id": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "address": "fa:16:3e:f8:77:a4", "network": {"id": "3819e7d4-2dc4-42e1-b2d6-8db84f0bb603", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-44170955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef630acc68949fd914df77f6cde70d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9210c142-09", "ovs_interfaceid": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:77:a4,bridge_name='br-int',has_traffic_filtering=True,id=9210c142-099e-4af9-b48b-fc0e3ddcdc23,network=Network(3819e7d4-2dc4-42e1-b2d6-8db84f0bb603),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9210c142-09') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG os_vif [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:77:a4,bridge_name='br-int',has_traffic_filtering=True,id=9210c142-099e-4af9-b48b-fc0e3ddcdc23,network=Network(3819e7d4-2dc4-42e1-b2d6-8db84f0bb603),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9210c142-09') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9210c142-09, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9210c142-09, col_values=(('external_ids', {'iface-id': '9210c142-099e-4af9-b48b-fc0e3ddcdc23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:77:a4', 'vm-uuid': 'e76827f8-dbbf-45fa-a84e-7f5dd0c62912'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:37:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:24 user nova-compute[73258]: INFO os_vif [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:77:a4,bridge_name='br-int',has_traffic_filtering=True,id=9210c142-099e-4af9-b48b-fc0e3ddcdc23,network=Network(3819e7d4-2dc4-42e1-b2d6-8db84f0bb603),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9210c142-09')
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] No BDM found with device name sda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] No VIF found with MAC fa:16:3e:f8:77:a4, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:37:25 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Using config drive
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.network.neutron [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Updating instance_info_cache with network_info: [{"id": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "address": "fa:16:3e:f1:e9:0f", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d69f70a-cd", "ovs_interfaceid": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Releasing lock "refresh_cache-33b995be-307d-4491-a1b4-fb75ececea1d" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Instance network_info: |[{"id": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "address": "fa:16:3e:f1:e9:0f", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d69f70a-cd", "ovs_interfaceid": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-157980ff-77d8-4ed4-a149-ee188fd63c44 req-ecab612c-b19f-4ee1-b56d-f524861dfc91 service nova] Acquired lock "refresh_cache-33b995be-307d-4491-a1b4-fb75ececea1d" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.network.neutron [req-157980ff-77d8-4ed4-a149-ee188fd63c44 req-ecab612c-b19f-4ee1-b56d-f524861dfc91 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Refreshing network info cache for port 5d69f70a-cd94-4b7b-abc9-652fc681c98b {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Start _get_guest_xml network_info=[{"id": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "address": "fa:16:3e:f1:e9:0f", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d69f70a-cd", "ovs_interfaceid": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:37:25 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:37:25 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1980093024',display_name='tempest-VolumesAdminNegativeTest-server-1980093024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1980093024',id=6,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZHAkF/Lu+qiN956dpQA65duHWT+dM/ZXNXETta93wJ/H3S0k3uCPx5xA8R40iyX3F9zMVo6ZKT6aRubY5LxQED0n8983C4Yb0TY65apY3yAim2BsL6va4Fs+TVMpH2ZQ==',key_name='tempest-keypair-169130833',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28d8e2938a0a4a97ac0b3f381626e880',ramdisk_id='',reservation_id='r-j5rjmr8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2002818274',owner_user_name='tempest-VolumesAdminNegativeTest-2002818274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:37:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff56e21976b246b297b6d15c9ba81c89',uuid=33b995be-307d-4491-a1b4-fb75ececea1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "address": "fa:16:3e:f1:e9:0f", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d69f70a-cd", "ovs_interfaceid": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Converting VIF {"id": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "address": "fa:16:3e:f1:e9:0f", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d69f70a-cd", "ovs_interfaceid": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:e9:0f,bridge_name='br-int',has_traffic_filtering=True,id=5d69f70a-cd94-4b7b-abc9-652fc681c98b,network=Network(41b0df8b-c615-470d-85ba-7289905946cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d69f70a-cd') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.objects.instance [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lazy-loading 'pci_devices' on Instance uuid 33b995be-307d-4491-a1b4-fb75ececea1d {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:37:25 user nova-compute[73258]:   <uuid>33b995be-307d-4491-a1b4-fb75ececea1d</uuid>
Aug 27 06:37:25 user nova-compute[73258]:   <name>instance-00000006</name>
Aug 27 06:37:25 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:37:25 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:37:25 user nova-compute[73258]:   <metadata>
Aug 27 06:37:25 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:37:25 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:37:25 user nova-compute[73258]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1980093024</nova:name>
Aug 27 06:37:25 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:37:25</nova:creationTime>
Aug 27 06:37:25 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:37:25 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:37:25 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:37:25 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:37:25 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:37:25 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:37:25 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:37:25 user nova-compute[73258]:       <nova:owner>
Aug 27 06:37:25 user nova-compute[73258]:         <nova:user uuid="ff56e21976b246b297b6d15c9ba81c89">tempest-VolumesAdminNegativeTest-2002818274-project-member</nova:user>
Aug 27 06:37:25 user nova-compute[73258]:         <nova:project uuid="28d8e2938a0a4a97ac0b3f381626e880">tempest-VolumesAdminNegativeTest-2002818274</nova:project>
Aug 27 06:37:25 user nova-compute[73258]:       </nova:owner>
Aug 27 06:37:25 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:37:25 user nova-compute[73258]:       <nova:ports>
Aug 27 06:37:25 user nova-compute[73258]:         <nova:port uuid="5d69f70a-cd94-4b7b-abc9-652fc681c98b">
Aug 27 06:37:25 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 06:37:25 user nova-compute[73258]:         </nova:port>
Aug 27 06:37:25 user nova-compute[73258]:       </nova:ports>
Aug 27 06:37:25 user nova-compute[73258]:     </nova:instance>
Aug 27 06:37:25 user nova-compute[73258]:   </metadata>
Aug 27 06:37:25 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:37:25 user nova-compute[73258]:     <system>
Aug 27 06:37:25 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:37:25 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:37:25 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:37:25 user nova-compute[73258]:       <entry name="serial">33b995be-307d-4491-a1b4-fb75ececea1d</entry>
Aug 27 06:37:25 user nova-compute[73258]:       <entry name="uuid">33b995be-307d-4491-a1b4-fb75ececea1d</entry>
Aug 27 06:37:25 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:37:25 user nova-compute[73258]:     </system>
Aug 27 06:37:25 user nova-compute[73258]:   </sysinfo>
Aug 27 06:37:25 user nova-compute[73258]:   <os>
Aug 27 06:37:25 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:37:25 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:37:25 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:37:25 user nova-compute[73258]:   </os>
Aug 27 06:37:25 user nova-compute[73258]:   <features>
Aug 27 06:37:25 user nova-compute[73258]:     <acpi/>
Aug 27 06:37:25 user nova-compute[73258]:     <apic/>
Aug 27 06:37:25 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:37:25 user nova-compute[73258]:   </features>
Aug 27 06:37:25 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:37:25 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:37:25 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:37:25 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:37:25 user nova-compute[73258]:   </clock>
Aug 27 06:37:25 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:37:25 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:37:25 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:37:25 user nova-compute[73258]:   </cpu>
Aug 27 06:37:25 user nova-compute[73258]:   <devices>
Aug 27 06:37:25 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:37:25 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:37:25 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk"/>
Aug 27 06:37:25 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:37:25 user nova-compute[73258]:     </disk>
Aug 27 06:37:25 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:37:25 user nova-compute[73258]:       <mac address="fa:16:3e:f1:e9:0f"/>
Aug 27 06:37:25 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:37:25 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:37:25 user nova-compute[73258]:       <target dev="tap5d69f70a-cd"/>
Aug 27 06:37:25 user nova-compute[73258]:     </interface>
Aug 27 06:37:25 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:37:25 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/console.log" append="off"/>
Aug 27 06:37:25 user nova-compute[73258]:     </serial>
Aug 27 06:37:25 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:37:25 user nova-compute[73258]:     <video>
Aug 27 06:37:25 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:37:25 user nova-compute[73258]:     </video>
Aug 27 06:37:25 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:37:25 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:37:25 user nova-compute[73258]:     </rng>
Aug 27 06:37:25 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:37:25 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:37:25 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:37:25 user nova-compute[73258]:     </memballoon>
Aug 27 06:37:25 user nova-compute[73258]:   </devices>
Aug 27 06:37:25 user nova-compute[73258]: </domain>
Aug 27 06:37:25 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1980093024',display_name='tempest-VolumesAdminNegativeTest-server-1980093024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1980093024',id=6,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZHAkF/Lu+qiN956dpQA65duHWT+dM/ZXNXETta93wJ/H3S0k3uCPx5xA8R40iyX3F9zMVo6ZKT6aRubY5LxQED0n8983C4Yb0TY65apY3yAim2BsL6va4Fs+TVMpH2ZQ==',key_name='tempest-keypair-169130833',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28d8e2938a0a4a97ac0b3f381626e880',ramdisk_id='',reservation_id='r-j5rjmr8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2002818274',owner_user_name='tempest-VolumesAdminNegativeTest-2002818274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:37:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff56e21976b246b297b6d15c9ba81c89',uuid=33b995be-307d-4491-a1b4-fb75ececea1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "address": "fa:16:3e:f1:e9:0f", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d69f70a-cd", "ovs_interfaceid": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Converting VIF {"id": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "address": "fa:16:3e:f1:e9:0f", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d69f70a-cd", "ovs_interfaceid": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:e9:0f,bridge_name='br-int',has_traffic_filtering=True,id=5d69f70a-cd94-4b7b-abc9-652fc681c98b,network=Network(41b0df8b-c615-470d-85ba-7289905946cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d69f70a-cd') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG os_vif [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:e9:0f,bridge_name='br-int',has_traffic_filtering=True,id=5d69f70a-cd94-4b7b-abc9-652fc681c98b,network=Network(41b0df8b-c615-470d-85ba-7289905946cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d69f70a-cd') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d69f70a-cd, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d69f70a-cd, col_values=(('external_ids', {'iface-id': '5d69f70a-cd94-4b7b-abc9-652fc681c98b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:e9:0f', 'vm-uuid': '33b995be-307d-4491-a1b4-fb75ececea1d'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:25 user nova-compute[73258]: INFO os_vif [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:e9:0f,bridge_name='br-int',has_traffic_filtering=True,id=5d69f70a-cd94-4b7b-abc9-652fc681c98b,network=Network(41b0df8b-c615-470d-85ba-7289905946cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d69f70a-cd')
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] No VIF found with MAC fa:16:3e:f1:e9:0f, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:37:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:26 user nova-compute[73258]: DEBUG nova.network.neutron [req-157980ff-77d8-4ed4-a149-ee188fd63c44 req-ecab612c-b19f-4ee1-b56d-f524861dfc91 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Updated VIF entry in instance network info cache for port 5d69f70a-cd94-4b7b-abc9-652fc681c98b. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:37:26 user nova-compute[73258]: DEBUG nova.network.neutron [req-157980ff-77d8-4ed4-a149-ee188fd63c44 req-ecab612c-b19f-4ee1-b56d-f524861dfc91 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Updating instance_info_cache with network_info: [{"id": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "address": "fa:16:3e:f1:e9:0f", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d69f70a-cd", "ovs_interfaceid": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:37:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-157980ff-77d8-4ed4-a149-ee188fd63c44 req-ecab612c-b19f-4ee1-b56d-f524861dfc91 service nova] Releasing lock "refresh_cache-33b995be-307d-4491-a1b4-fb75ececea1d" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:37:26 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Creating config drive at /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk.config
Aug 27 06:37:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyp7sdpow {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyp7sdpow" returned: 0 in 0.059s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:26 user nova-compute[73258]: DEBUG nova.network.neutron [req-81195339-51d8-4fcc-a17f-3f43a1526eb6 req-8d3fa797-d06b-4750-8570-84534dc9e826 service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Updated VIF entry in instance network info cache for port 9210c142-099e-4af9-b48b-fc0e3ddcdc23. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:37:26 user nova-compute[73258]: DEBUG nova.network.neutron [req-81195339-51d8-4fcc-a17f-3f43a1526eb6 req-8d3fa797-d06b-4750-8570-84534dc9e826 service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Updating instance_info_cache with network_info: [{"id": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "address": "fa:16:3e:f8:77:a4", "network": {"id": "3819e7d4-2dc4-42e1-b2d6-8db84f0bb603", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-44170955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef630acc68949fd914df77f6cde70d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9210c142-09", "ovs_interfaceid": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:37:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-81195339-51d8-4fcc-a17f-3f43a1526eb6 req-8d3fa797-d06b-4750-8570-84534dc9e826 service nova] Releasing lock "refresh_cache-e76827f8-dbbf-45fa-a84e-7f5dd0c62912" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:37:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquiring lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:27 user nova-compute[73258]: DEBUG nova.compute.manager [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:37:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:37:27 user nova-compute[73258]: INFO nova.compute.claims [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Claim successful on node user
Aug 27 06:37:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG nova.network.neutron [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:37:28 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:37:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:37:28 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Creating image(s)
Aug 27 06:37:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquiring lock "/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG nova.policy [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53ae2b77bfcf461fbc01429ee1f052b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3fc6b23bb4467891da7bc8a1b4ae49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.292s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] There are 0 instances to clean {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 06:37:28 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG nova.compute.manager [req-c5f9b22a-15ae-4a02-9c5e-d7e78d0dd8a6 req-6763eb98-30de-420c-9fc2-f7aa0b6e6f35 service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Received event network-vif-plugged-f2f7670e-c9a1-437f-8143-4f7cfc60a035 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c5f9b22a-15ae-4a02-9c5e-d7e78d0dd8a6 req-6763eb98-30de-420c-9fc2-f7aa0b6e6f35 service nova] Acquiring lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c5f9b22a-15ae-4a02-9c5e-d7e78d0dd8a6 req-6763eb98-30de-420c-9fc2-f7aa0b6e6f35 service nova] Lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c5f9b22a-15ae-4a02-9c5e-d7e78d0dd8a6 req-6763eb98-30de-420c-9fc2-f7aa0b6e6f35 service nova] Lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG nova.compute.manager [req-c5f9b22a-15ae-4a02-9c5e-d7e78d0dd8a6 req-6763eb98-30de-420c-9fc2-f7aa0b6e6f35 service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] No waiting events found dispatching network-vif-plugged-f2f7670e-c9a1-437f-8143-4f7cfc60a035 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:37:29 user nova-compute[73258]: WARNING nova.compute.manager [req-c5f9b22a-15ae-4a02-9c5e-d7e78d0dd8a6 req-6763eb98-30de-420c-9fc2-f7aa0b6e6f35 service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Received unexpected event network-vif-plugged-f2f7670e-c9a1-437f-8143-4f7cfc60a035 for instance with vm_state active and task_state None.
Aug 27 06:37:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.225s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk 1073741824" returned: 0 in 0.052s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.254s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG nova.network.neutron [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Successfully created port: e84fffb7-b665-47d1-a38c-525d4ada5d39 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Cannot resize image /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Ensure instance console log exists: /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.network.neutron [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Successfully updated port: e84fffb7-b665-47d1-a38c-525d4ada5d39 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquiring lock "refresh_cache-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquired lock "refresh_cache-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.network.neutron [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-7ba70cb1-ca95-4245-ad9a-d985b6cbc67a req-00a60749-2c38-469a-90a3-9789b8e2f596 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received event network-changed-e84fffb7-b665-47d1-a38c-525d4ada5d39 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-7ba70cb1-ca95-4245-ad9a-d985b6cbc67a req-00a60749-2c38-469a-90a3-9789b8e2f596 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Refreshing instance network info cache due to event network-changed-e84fffb7-b665-47d1-a38c-525d4ada5d39. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7ba70cb1-ca95-4245-ad9a-d985b6cbc67a req-00a60749-2c38-469a-90a3-9789b8e2f596 service nova] Acquiring lock "refresh_cache-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.network.neutron [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Skipping network cache update for instance because it is Building. {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Skipping network cache update for instance because it is Building. {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Skipping network cache update for instance because it is Building. {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118250.9338083, 33b995be-307d-4491-a1b4-fb75ececea1d => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:37:30 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] VM Resumed (Lifecycle Event)
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:37:30 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Instance spawned successfully.
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:30 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:37:30 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118250.9399078, 33b995be-307d-4491-a1b4-fb75ececea1d => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:37:30 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] VM Started (Lifecycle Event)
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.compute.manager [req-7e84a334-1f41-4023-8a98-028ba32001bc req-b1fba107-3349-4cf3-a5ab-873d4db04e20 service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Received event network-vif-plugged-f2f7670e-c9a1-437f-8143-4f7cfc60a035 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7e84a334-1f41-4023-8a98-028ba32001bc req-b1fba107-3349-4cf3-a5ab-873d4db04e20 service nova] Acquiring lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7e84a334-1f41-4023-8a98-028ba32001bc req-b1fba107-3349-4cf3-a5ab-873d4db04e20 service nova] Lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7e84a334-1f41-4023-8a98-028ba32001bc req-b1fba107-3349-4cf3-a5ab-873d4db04e20 service nova] Lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.compute.manager [req-7e84a334-1f41-4023-8a98-028ba32001bc req-b1fba107-3349-4cf3-a5ab-873d4db04e20 service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] No waiting events found dispatching network-vif-plugged-f2f7670e-c9a1-437f-8143-4f7cfc60a035 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:37:31 user nova-compute[73258]: WARNING nova.compute.manager [req-7e84a334-1f41-4023-8a98-028ba32001bc req-b1fba107-3349-4cf3-a5ab-873d4db04e20 service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Received unexpected event network-vif-plugged-f2f7670e-c9a1-437f-8143-4f7cfc60a035 for instance with vm_state active and task_state None.
Aug 27 06:37:31 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:37:31 user nova-compute[73258]: INFO nova.compute.manager [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Took 10.09 seconds to spawn the instance on the hypervisor.
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-bb57b63c-888f-40a0-88c0-97f63fd8297f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-bb57b63c-888f-40a0-88c0-97f63fd8297f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.objects.instance [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lazy-loading 'info_cache' on Instance uuid bb57b63c-888f-40a0-88c0-97f63fd8297f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:37:31 user nova-compute[73258]: INFO nova.compute.manager [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Took 11.43 seconds to build instance.
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.network.neutron [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Updating instance_info_cache with network_info: [{"id": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "address": "fa:16:3e:9e:b0:e1", "network": {"id": "9bc98272-6eb0-4ce7-ba14-721aa5b74a67", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-969683990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape84fffb7-b6", "ovs_interfaceid": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8f7d38bb-1762-4afe-95ae-ebe5658be6d0 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "33b995be-307d-4491-a1b4-fb75ececea1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.637s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Releasing lock "refresh_cache-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Instance network_info: |[{"id": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "address": "fa:16:3e:9e:b0:e1", "network": {"id": "9bc98272-6eb0-4ce7-ba14-721aa5b74a67", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-969683990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape84fffb7-b6", "ovs_interfaceid": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7ba70cb1-ca95-4245-ad9a-d985b6cbc67a req-00a60749-2c38-469a-90a3-9789b8e2f596 service nova] Acquired lock "refresh_cache-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.network.neutron [req-7ba70cb1-ca95-4245-ad9a-d985b6cbc67a req-00a60749-2c38-469a-90a3-9789b8e2f596 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Refreshing network info cache for port e84fffb7-b665-47d1-a38c-525d4ada5d39 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Start _get_guest_xml network_info=[{"id": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "address": "fa:16:3e:9e:b0:e1", "network": {"id": "9bc98272-6eb0-4ce7-ba14-721aa5b74a67", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-969683990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape84fffb7-b6", "ovs_interfaceid": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:37:31 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:37:31 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:37:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272504122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272504122',id=8,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyavg0YndUGAOgB67L8HRF7F2iikxrnrdEVXLpabs98eaA0ZuhB1u8SuP+LgJpkPNPLmHjFchg3jVefSbPuOz2/jsOg0UsGBCCfjGt2BWTYtT1VtCqWWdtqNXaQw6MrAw==',key_name='tempest-keypair-967100910',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae3fc6b23bb4467891da7bc8a1b4ae49',ramdisk_id='',reservation_id='r-bpbfl8r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-45928959',owner_user_name='tempest-TaggedAttachmentsTest-45928959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:37:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53ae2b77bfcf461fbc01429ee1f052b8',uuid=70af3b5e-3a68-41b3-9f92-2b3a36a9d21e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "address": "fa:16:3e:9e:b0:e1", "network": {"id": "9bc98272-6eb0-4ce7-ba14-721aa5b74a67", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-969683990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape84fffb7-b6", "ovs_interfaceid": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Converting VIF {"id": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "address": "fa:16:3e:9e:b0:e1", "network": {"id": "9bc98272-6eb0-4ce7-ba14-721aa5b74a67", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-969683990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape84fffb7-b6", "ovs_interfaceid": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b0:e1,bridge_name='br-int',has_traffic_filtering=True,id=e84fffb7-b665-47d1-a38c-525d4ada5d39,network=Network(9bc98272-6eb0-4ce7-ba14-721aa5b74a67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape84fffb7-b6') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.objects.instance [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lazy-loading 'pci_devices' on Instance uuid 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118251.31145, e76827f8-dbbf-45fa-a84e-7f5dd0c62912 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:37:31 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] VM Resumed (Lifecycle Event)
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:37:31 user nova-compute[73258]:   <uuid>70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</uuid>
Aug 27 06:37:31 user nova-compute[73258]:   <name>instance-00000008</name>
Aug 27 06:37:31 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:37:31 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:37:31 user nova-compute[73258]:   <metadata>
Aug 27 06:37:31 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:37:31 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:37:31 user nova-compute[73258]:       <nova:name>tempest-device-tagging-server-272504122</nova:name>
Aug 27 06:37:31 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:37:31</nova:creationTime>
Aug 27 06:37:31 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:37:31 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:37:31 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:37:31 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:37:31 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:37:31 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:37:31 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:37:31 user nova-compute[73258]:       <nova:owner>
Aug 27 06:37:31 user nova-compute[73258]:         <nova:user uuid="53ae2b77bfcf461fbc01429ee1f052b8">tempest-TaggedAttachmentsTest-45928959-project-member</nova:user>
Aug 27 06:37:31 user nova-compute[73258]:         <nova:project uuid="ae3fc6b23bb4467891da7bc8a1b4ae49">tempest-TaggedAttachmentsTest-45928959</nova:project>
Aug 27 06:37:31 user nova-compute[73258]:       </nova:owner>
Aug 27 06:37:31 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:37:31 user nova-compute[73258]:       <nova:ports>
Aug 27 06:37:31 user nova-compute[73258]:         <nova:port uuid="e84fffb7-b665-47d1-a38c-525d4ada5d39">
Aug 27 06:37:31 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 06:37:31 user nova-compute[73258]:         </nova:port>
Aug 27 06:37:31 user nova-compute[73258]:       </nova:ports>
Aug 27 06:37:31 user nova-compute[73258]:     </nova:instance>
Aug 27 06:37:31 user nova-compute[73258]:   </metadata>
Aug 27 06:37:31 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:37:31 user nova-compute[73258]:     <system>
Aug 27 06:37:31 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:37:31 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:37:31 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:37:31 user nova-compute[73258]:       <entry name="serial">70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</entry>
Aug 27 06:37:31 user nova-compute[73258]:       <entry name="uuid">70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</entry>
Aug 27 06:37:31 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:37:31 user nova-compute[73258]:     </system>
Aug 27 06:37:31 user nova-compute[73258]:   </sysinfo>
Aug 27 06:37:31 user nova-compute[73258]:   <os>
Aug 27 06:37:31 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:37:31 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:37:31 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:37:31 user nova-compute[73258]:   </os>
Aug 27 06:37:31 user nova-compute[73258]:   <features>
Aug 27 06:37:31 user nova-compute[73258]:     <acpi/>
Aug 27 06:37:31 user nova-compute[73258]:     <apic/>
Aug 27 06:37:31 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:37:31 user nova-compute[73258]:   </features>
Aug 27 06:37:31 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:37:31 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:37:31 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:37:31 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:37:31 user nova-compute[73258]:   </clock>
Aug 27 06:37:31 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:37:31 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:37:31 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:37:31 user nova-compute[73258]:   </cpu>
Aug 27 06:37:31 user nova-compute[73258]:   <devices>
Aug 27 06:37:31 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:37:31 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:37:31 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk"/>
Aug 27 06:37:31 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:37:31 user nova-compute[73258]:     </disk>
Aug 27 06:37:31 user nova-compute[73258]:     <disk type="file" device="cdrom">
Aug 27 06:37:31 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 06:37:31 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk.config"/>
Aug 27 06:37:31 user nova-compute[73258]:       <target dev="hda" bus="ide"/>
Aug 27 06:37:31 user nova-compute[73258]:     </disk>
Aug 27 06:37:31 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:37:31 user nova-compute[73258]:       <mac address="fa:16:3e:9e:b0:e1"/>
Aug 27 06:37:31 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:37:31 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:37:31 user nova-compute[73258]:       <target dev="tape84fffb7-b6"/>
Aug 27 06:37:31 user nova-compute[73258]:     </interface>
Aug 27 06:37:31 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:37:31 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/console.log" append="off"/>
Aug 27 06:37:31 user nova-compute[73258]:     </serial>
Aug 27 06:37:31 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:37:31 user nova-compute[73258]:     <video>
Aug 27 06:37:31 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:37:31 user nova-compute[73258]:     </video>
Aug 27 06:37:31 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:37:31 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:37:31 user nova-compute[73258]:     </rng>
Aug 27 06:37:31 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:37:31 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:37:31 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:37:31 user nova-compute[73258]:     </memballoon>
Aug 27 06:37:31 user nova-compute[73258]:   </devices>
Aug 27 06:37:31 user nova-compute[73258]: </domain>
Aug 27 06:37:31 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:37:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272504122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272504122',id=8,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyavg0YndUGAOgB67L8HRF7F2iikxrnrdEVXLpabs98eaA0ZuhB1u8SuP+LgJpkPNPLmHjFchg3jVefSbPuOz2/jsOg0UsGBCCfjGt2BWTYtT1VtCqWWdtqNXaQw6MrAw==',key_name='tempest-keypair-967100910',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae3fc6b23bb4467891da7bc8a1b4ae49',ramdisk_id='',reservation_id='r-bpbfl8r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-45928959',owner_user_name='tempest-TaggedAttachmentsTest-45928959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:37:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53ae2b77bfcf461fbc01429ee1f052b8',uuid=70af3b5e-3a68-41b3-9f92-2b3a36a9d21e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "address": "fa:16:3e:9e:b0:e1", "network": {"id": "9bc98272-6eb0-4ce7-ba14-721aa5b74a67", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-969683990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape84fffb7-b6", "ovs_interfaceid": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Converting VIF {"id": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "address": "fa:16:3e:9e:b0:e1", "network": {"id": "9bc98272-6eb0-4ce7-ba14-721aa5b74a67", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-969683990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape84fffb7-b6", "ovs_interfaceid": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b0:e1,bridge_name='br-int',has_traffic_filtering=True,id=e84fffb7-b665-47d1-a38c-525d4ada5d39,network=Network(9bc98272-6eb0-4ce7-ba14-721aa5b74a67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape84fffb7-b6') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG os_vif [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b0:e1,bridge_name='br-int',has_traffic_filtering=True,id=e84fffb7-b665-47d1-a38c-525d4ada5d39,network=Network(9bc98272-6eb0-4ce7-ba14-721aa5b74a67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape84fffb7-b6') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:31 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Instance spawned successfully.
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape84fffb7-b6, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape84fffb7-b6, col_values=(('external_ids', {'iface-id': 'e84fffb7-b665-47d1-a38c-525d4ada5d39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:b0:e1', 'vm-uuid': '70af3b5e-3a68-41b3-9f92-2b3a36a9d21e'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:31 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118251.3128078, e76827f8-dbbf-45fa-a84e-7f5dd0c62912 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:37:31 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] VM Started (Lifecycle Event)
Aug 27 06:37:31 user nova-compute[73258]: INFO os_vif [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b0:e1,bridge_name='br-int',has_traffic_filtering=True,id=e84fffb7-b665-47d1-a38c-525d4ada5d39,network=Network(9bc98272-6eb0-4ce7-ba14-721aa5b74a67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape84fffb7-b6')
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:37:31 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:37:31 user nova-compute[73258]: INFO nova.compute.manager [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Took 9.81 seconds to spawn the instance on the hypervisor.
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] No BDM found with device name hda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] No VIF found with MAC fa:16:3e:9e:b0:e1, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:37:31 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Using config drive
Aug 27 06:37:31 user nova-compute[73258]: INFO nova.compute.manager [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Took 11.64 seconds to build instance.
Aug 27 06:37:31 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Creating config drive at /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk.config
Aug 27 06:37:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpail8t1y9 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-43160ab4-d377-4358-bfb3-f69a9b922be1 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.888s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpail8t1y9" returned: 0 in 0.065s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Updating instance_info_cache with network_info: [{"id": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "address": "fa:16:3e:78:b4:e4", "network": {"id": "17e248c2-cdb2-407a-9707-690809f91d19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-577762610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25e4e2704bd54e42a2ef6798115ae8dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b826212-ad", "ovs_interfaceid": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-bb57b63c-888f-40a0-88c0-97f63fd8297f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:37:31 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:37:32 user nova-compute[73258]: DEBUG nova.network.neutron [req-7ba70cb1-ca95-4245-ad9a-d985b6cbc67a req-00a60749-2c38-469a-90a3-9789b8e2f596 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Updated VIF entry in instance network info cache for port e84fffb7-b665-47d1-a38c-525d4ada5d39. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:37:32 user nova-compute[73258]: DEBUG nova.network.neutron [req-7ba70cb1-ca95-4245-ad9a-d985b6cbc67a req-00a60749-2c38-469a-90a3-9789b8e2f596 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Updating instance_info_cache with network_info: [{"id": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "address": "fa:16:3e:9e:b0:e1", "network": {"id": "9bc98272-6eb0-4ce7-ba14-721aa5b74a67", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-969683990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape84fffb7-b6", "ovs_interfaceid": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:37:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7ba70cb1-ca95-4245-ad9a-d985b6cbc67a req-00a60749-2c38-469a-90a3-9789b8e2f596 service nova] Releasing lock "refresh_cache-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:37:32 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:37:32 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:37:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:34 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:37:34 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:37:35 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Acquiring lock "b51f0635-3ec5-4623-9265-350033b778c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Lock "b51f0635-3ec5-4623-9265-350033b778c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:37:36 user nova-compute[73258]: INFO nova.compute.claims [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Claim successful on node user
Aug 27 06:37:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118256.6916091, 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:37:36 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] VM Resumed (Lifecycle Event)
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:37:36 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Instance spawned successfully.
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:36 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118256.693119, 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:37:36 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] VM Started (Lifecycle Event)
Aug 27 06:37:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:36 user nova-compute[73258]: INFO nova.compute.manager [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Took 8.32 seconds to spawn the instance on the hypervisor.
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:37:36 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:37:36 user nova-compute[73258]: INFO nova.compute.manager [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Took 9.24 seconds to build instance.
Aug 27 06:37:36 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-dc83b5f6-15f9-4cd0-bbdf-9cf8adacc515 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.387s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.574s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:37:37 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:37:37 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:37:37 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Creating image(s)
Aug 27 06:37:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Acquiring lock "/opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Lock "/opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Lock "/opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG nova.policy [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a4804286d8a49719501fcd7c82ab011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1937be8e045ab9d5e4f96128a60a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.209s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.225s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk 1073741824" returned: 0 in 0.109s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.341s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.263s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Successfully created port: c40794f4-8107-411d-b2b9-541a4fc5072d {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Cannot resize image /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Ensure instance console log exists: /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:39 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Successfully updated port: c40794f4-8107-411d-b2b9-541a4fc5072d {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:37:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Acquiring lock "refresh_cache-b51f0635-3ec5-4623-9265-350033b778c6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:37:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Acquired lock "refresh_cache-b51f0635-3ec5-4623-9265-350033b778c6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:37:39 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:37:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:39 user nova-compute[73258]: DEBUG nova.compute.manager [req-1dd0e8c8-bdd9-4d28-a1f7-e9ef08380f11 req-3403f462-3ade-4be2-831d-cfa43856ac9d service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Received event network-changed-c40794f4-8107-411d-b2b9-541a4fc5072d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:39 user nova-compute[73258]: DEBUG nova.compute.manager [req-1dd0e8c8-bdd9-4d28-a1f7-e9ef08380f11 req-3403f462-3ade-4be2-831d-cfa43856ac9d service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Refreshing instance network info cache due to event network-changed-c40794f4-8107-411d-b2b9-541a4fc5072d. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:37:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1dd0e8c8-bdd9-4d28-a1f7-e9ef08380f11 req-3403f462-3ade-4be2-831d-cfa43856ac9d service nova] Acquiring lock "refresh_cache-b51f0635-3ec5-4623-9265-350033b778c6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:37:39 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:37:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Updating instance_info_cache with network_info: [{"id": "c40794f4-8107-411d-b2b9-541a4fc5072d", "address": "fa:16:3e:a6:3c:ca", "network": {"id": "e78617e0-56b0-4b80-bbd2-f370603e4cd3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508001975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a1937be8e045ab9d5e4f96128a60a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40794f4-81", "ovs_interfaceid": "c40794f4-8107-411d-b2b9-541a4fc5072d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Releasing lock "refresh_cache-b51f0635-3ec5-4623-9265-350033b778c6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Instance network_info: |[{"id": "c40794f4-8107-411d-b2b9-541a4fc5072d", "address": "fa:16:3e:a6:3c:ca", "network": {"id": "e78617e0-56b0-4b80-bbd2-f370603e4cd3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508001975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a1937be8e045ab9d5e4f96128a60a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40794f4-81", "ovs_interfaceid": "c40794f4-8107-411d-b2b9-541a4fc5072d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1dd0e8c8-bdd9-4d28-a1f7-e9ef08380f11 req-3403f462-3ade-4be2-831d-cfa43856ac9d service nova] Acquired lock "refresh_cache-b51f0635-3ec5-4623-9265-350033b778c6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.network.neutron [req-1dd0e8c8-bdd9-4d28-a1f7-e9ef08380f11 req-3403f462-3ade-4be2-831d-cfa43856ac9d service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Refreshing network info cache for port c40794f4-8107-411d-b2b9-541a4fc5072d {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Start _get_guest_xml network_info=[{"id": "c40794f4-8107-411d-b2b9-541a4fc5072d", "address": "fa:16:3e:a6:3c:ca", "network": {"id": "e78617e0-56b0-4b80-bbd2-f370603e4cd3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508001975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a1937be8e045ab9d5e4f96128a60a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40794f4-81", "ovs_interfaceid": "c40794f4-8107-411d-b2b9-541a4fc5072d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:37:40 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:37:40 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:37:40 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:37:40 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=7636MB free_disk=24.527725219726562GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-782123991',display_name='tempest-VolumesAssistedSnapshotsTest-server-782123991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-782123991',id=9,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+jM+XlfkMHjbw9mW3kXB8iS+4Lgn0kp4cMUUO7p19071/4uKq/ggu8TG40r3vZ9/hgt6wilput9XdE6EbaM6aPywwajAKoY1JLVvGxWL/zQ+19NediuGYlgssdrAcduw==',key_name='tempest-keypair-1275699090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73a1937be8e045ab9d5e4f96128a60a6',ramdisk_id='',reservation_id='r-vhpd8y9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-316912335',owner_user_name='tempest-VolumesAssistedSnapshotsTest-316912335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a4804286d8a49719501fcd7c82ab011',uuid=b51f0635-3ec5-4623-9265-350033b778c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c40794f4-8107-411d-b2b9-541a4fc5072d", "address": "fa:16:3e:a6:3c:ca", "network": {"id": "e78617e0-56b0-4b80-bbd2-f370603e4cd3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508001975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a1937be8e045ab9d5e4f96128a60a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40794f4-81", "ovs_interfaceid": "c40794f4-8107-411d-b2b9-541a4fc5072d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Converting VIF {"id": "c40794f4-8107-411d-b2b9-541a4fc5072d", "address": "fa:16:3e:a6:3c:ca", "network": {"id": "e78617e0-56b0-4b80-bbd2-f370603e4cd3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508001975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a1937be8e045ab9d5e4f96128a60a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40794f4-81", "ovs_interfaceid": "c40794f4-8107-411d-b2b9-541a4fc5072d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3c:ca,bridge_name='br-int',has_traffic_filtering=True,id=c40794f4-8107-411d-b2b9-541a4fc5072d,network=Network(e78617e0-56b0-4b80-bbd2-f370603e4cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40794f4-81') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.objects.instance [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Lazy-loading 'pci_devices' on Instance uuid b51f0635-3ec5-4623-9265-350033b778c6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:37:40 user nova-compute[73258]:   <uuid>b51f0635-3ec5-4623-9265-350033b778c6</uuid>
Aug 27 06:37:40 user nova-compute[73258]:   <name>instance-00000009</name>
Aug 27 06:37:40 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:37:40 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:37:40 user nova-compute[73258]:   <metadata>
Aug 27 06:37:40 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:37:40 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:37:40 user nova-compute[73258]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-782123991</nova:name>
Aug 27 06:37:40 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:37:40</nova:creationTime>
Aug 27 06:37:40 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:37:40 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:37:40 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:37:40 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:37:40 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:37:40 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:37:40 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:37:40 user nova-compute[73258]:       <nova:owner>
Aug 27 06:37:40 user nova-compute[73258]:         <nova:user uuid="8a4804286d8a49719501fcd7c82ab011">tempest-VolumesAssistedSnapshotsTest-316912335-project-member</nova:user>
Aug 27 06:37:40 user nova-compute[73258]:         <nova:project uuid="73a1937be8e045ab9d5e4f96128a60a6">tempest-VolumesAssistedSnapshotsTest-316912335</nova:project>
Aug 27 06:37:40 user nova-compute[73258]:       </nova:owner>
Aug 27 06:37:40 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:37:40 user nova-compute[73258]:       <nova:ports>
Aug 27 06:37:40 user nova-compute[73258]:         <nova:port uuid="c40794f4-8107-411d-b2b9-541a4fc5072d">
Aug 27 06:37:40 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 06:37:40 user nova-compute[73258]:         </nova:port>
Aug 27 06:37:40 user nova-compute[73258]:       </nova:ports>
Aug 27 06:37:40 user nova-compute[73258]:     </nova:instance>
Aug 27 06:37:40 user nova-compute[73258]:   </metadata>
Aug 27 06:37:40 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:37:40 user nova-compute[73258]:     <system>
Aug 27 06:37:40 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:37:40 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:37:40 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:37:40 user nova-compute[73258]:       <entry name="serial">b51f0635-3ec5-4623-9265-350033b778c6</entry>
Aug 27 06:37:40 user nova-compute[73258]:       <entry name="uuid">b51f0635-3ec5-4623-9265-350033b778c6</entry>
Aug 27 06:37:40 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:37:40 user nova-compute[73258]:     </system>
Aug 27 06:37:40 user nova-compute[73258]:   </sysinfo>
Aug 27 06:37:40 user nova-compute[73258]:   <os>
Aug 27 06:37:40 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:37:40 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:37:40 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:37:40 user nova-compute[73258]:   </os>
Aug 27 06:37:40 user nova-compute[73258]:   <features>
Aug 27 06:37:40 user nova-compute[73258]:     <acpi/>
Aug 27 06:37:40 user nova-compute[73258]:     <apic/>
Aug 27 06:37:40 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:37:40 user nova-compute[73258]:   </features>
Aug 27 06:37:40 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:37:40 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:37:40 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:37:40 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:37:40 user nova-compute[73258]:   </clock>
Aug 27 06:37:40 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:37:40 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:37:40 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:37:40 user nova-compute[73258]:   </cpu>
Aug 27 06:37:40 user nova-compute[73258]:   <devices>
Aug 27 06:37:40 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:37:40 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:37:40 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk"/>
Aug 27 06:37:40 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:37:40 user nova-compute[73258]:     </disk>
Aug 27 06:37:40 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:37:40 user nova-compute[73258]:       <mac address="fa:16:3e:a6:3c:ca"/>
Aug 27 06:37:40 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:37:40 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:37:40 user nova-compute[73258]:       <target dev="tapc40794f4-81"/>
Aug 27 06:37:40 user nova-compute[73258]:     </interface>
Aug 27 06:37:40 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:37:40 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/console.log" append="off"/>
Aug 27 06:37:40 user nova-compute[73258]:     </serial>
Aug 27 06:37:40 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:37:40 user nova-compute[73258]:     <video>
Aug 27 06:37:40 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:37:40 user nova-compute[73258]:     </video>
Aug 27 06:37:40 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:37:40 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:37:40 user nova-compute[73258]:     </rng>
Aug 27 06:37:40 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:37:40 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:37:40 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:37:40 user nova-compute[73258]:     </memballoon>
Aug 27 06:37:40 user nova-compute[73258]:   </devices>
Aug 27 06:37:40 user nova-compute[73258]: </domain>
Aug 27 06:37:40 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-782123991',display_name='tempest-VolumesAssistedSnapshotsTest-server-782123991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-782123991',id=9,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+jM+XlfkMHjbw9mW3kXB8iS+4Lgn0kp4cMUUO7p19071/4uKq/ggu8TG40r3vZ9/hgt6wilput9XdE6EbaM6aPywwajAKoY1JLVvGxWL/zQ+19NediuGYlgssdrAcduw==',key_name='tempest-keypair-1275699090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73a1937be8e045ab9d5e4f96128a60a6',ramdisk_id='',reservation_id='r-vhpd8y9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-316912335',owner_user_name='tempest-VolumesAssistedSnapshotsTest-316912335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a4804286d8a49719501fcd7c82ab011',uuid=b51f0635-3ec5-4623-9265-350033b778c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c40794f4-8107-411d-b2b9-541a4fc5072d", "address": "fa:16:3e:a6:3c:ca", "network": {"id": "e78617e0-56b0-4b80-bbd2-f370603e4cd3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508001975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a1937be8e045ab9d5e4f96128a60a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40794f4-81", "ovs_interfaceid": "c40794f4-8107-411d-b2b9-541a4fc5072d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Converting VIF {"id": "c40794f4-8107-411d-b2b9-541a4fc5072d", "address": "fa:16:3e:a6:3c:ca", "network": {"id": "e78617e0-56b0-4b80-bbd2-f370603e4cd3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508001975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a1937be8e045ab9d5e4f96128a60a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40794f4-81", "ovs_interfaceid": "c40794f4-8107-411d-b2b9-541a4fc5072d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3c:ca,bridge_name='br-int',has_traffic_filtering=True,id=c40794f4-8107-411d-b2b9-541a4fc5072d,network=Network(e78617e0-56b0-4b80-bbd2-f370603e4cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40794f4-81') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG os_vif [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3c:ca,bridge_name='br-int',has_traffic_filtering=True,id=c40794f4-8107-411d-b2b9-541a4fc5072d,network=Network(e78617e0-56b0-4b80-bbd2-f370603e4cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40794f4-81') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc40794f4-81, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc40794f4-81, col_values=(('external_ids', {'iface-id': 'c40794f4-8107-411d-b2b9-541a4fc5072d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:3c:ca', 'vm-uuid': 'b51f0635-3ec5-4623-9265-350033b778c6'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:40 user nova-compute[73258]: INFO os_vif [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3c:ca,bridge_name='br-int',has_traffic_filtering=True,id=c40794f4-8107-411d-b2b9-541a4fc5072d,network=Network(e78617e0-56b0-4b80-bbd2-f370603e4cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40794f4-81')
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:37:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] No VIF found with MAC fa:16:3e:a6:3c:ca, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.network.neutron [req-1dd0e8c8-bdd9-4d28-a1f7-e9ef08380f11 req-3403f462-3ade-4be2-831d-cfa43856ac9d service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Updated VIF entry in instance network info cache for port c40794f4-8107-411d-b2b9-541a4fc5072d. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.network.neutron [req-1dd0e8c8-bdd9-4d28-a1f7-e9ef08380f11 req-3403f462-3ade-4be2-831d-cfa43856ac9d service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Updating instance_info_cache with network_info: [{"id": "c40794f4-8107-411d-b2b9-541a4fc5072d", "address": "fa:16:3e:a6:3c:ca", "network": {"id": "e78617e0-56b0-4b80-bbd2-f370603e4cd3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508001975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a1937be8e045ab9d5e4f96128a60a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40794f4-81", "ovs_interfaceid": "c40794f4-8107-411d-b2b9-541a4fc5072d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bb57b63c-888f-40a0-88c0-97f63fd8297f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 33b995be-307d-4491-a1b4-fb75ececea1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance e76827f8-dbbf-45fa-a84e-7f5dd0c62912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance b51f0635-3ec5-4623-9265-350033b778c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Refreshing inventories for resource provider 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1dd0e8c8-bdd9-4d28-a1f7-e9ef08380f11 req-3403f462-3ade-4be2-831d-cfa43856ac9d service nova] Releasing lock "refresh_cache-b51f0635-3ec5-4623-9265-350033b778c6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Updating ProviderTree inventory for provider 13f05024-5078-4590-94a5-110d29d864c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Updating inventory in ProviderTree for provider 13f05024-5078-4590-94a5-110d29d864c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Refreshing aggregate associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, aggregates: None {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Refreshing trait associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.048s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.compute.manager [req-3ca8106f-ac72-4ab5-96e7-e6d23d51c25d req-68723f75-71cc-409c-8712-30b2edc4f9c3 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Received event network-vif-plugged-5d69f70a-cd94-4b7b-abc9-652fc681c98b {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3ca8106f-ac72-4ab5-96e7-e6d23d51c25d req-68723f75-71cc-409c-8712-30b2edc4f9c3 service nova] Acquiring lock "33b995be-307d-4491-a1b4-fb75ececea1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3ca8106f-ac72-4ab5-96e7-e6d23d51c25d req-68723f75-71cc-409c-8712-30b2edc4f9c3 service nova] Lock "33b995be-307d-4491-a1b4-fb75ececea1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3ca8106f-ac72-4ab5-96e7-e6d23d51c25d req-68723f75-71cc-409c-8712-30b2edc4f9c3 service nova] Lock "33b995be-307d-4491-a1b4-fb75ececea1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:41 user nova-compute[73258]: DEBUG nova.compute.manager [req-3ca8106f-ac72-4ab5-96e7-e6d23d51c25d req-68723f75-71cc-409c-8712-30b2edc4f9c3 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] No waiting events found dispatching network-vif-plugged-5d69f70a-cd94-4b7b-abc9-652fc681c98b {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:37:41 user nova-compute[73258]: WARNING nova.compute.manager [req-3ca8106f-ac72-4ab5-96e7-e6d23d51c25d req-68723f75-71cc-409c-8712-30b2edc4f9c3 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Received unexpected event network-vif-plugged-5d69f70a-cd94-4b7b-abc9-652fc681c98b for instance with vm_state active and task_state None.
Aug 27 06:37:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:42 user nova-compute[73258]: DEBUG nova.compute.manager [req-94b70bfd-3493-4f25-8ac6-473acc6ed896 req-4ae707c7-13f9-4046-9a4b-106cb10f7486 service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Received event network-vif-plugged-c40794f4-8107-411d-b2b9-541a4fc5072d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-94b70bfd-3493-4f25-8ac6-473acc6ed896 req-4ae707c7-13f9-4046-9a4b-106cb10f7486 service nova] Acquiring lock "b51f0635-3ec5-4623-9265-350033b778c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-94b70bfd-3493-4f25-8ac6-473acc6ed896 req-4ae707c7-13f9-4046-9a4b-106cb10f7486 service nova] Lock "b51f0635-3ec5-4623-9265-350033b778c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-94b70bfd-3493-4f25-8ac6-473acc6ed896 req-4ae707c7-13f9-4046-9a4b-106cb10f7486 service nova] Lock "b51f0635-3ec5-4623-9265-350033b778c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:42 user nova-compute[73258]: DEBUG nova.compute.manager [req-94b70bfd-3493-4f25-8ac6-473acc6ed896 req-4ae707c7-13f9-4046-9a4b-106cb10f7486 service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] No waiting events found dispatching network-vif-plugged-c40794f4-8107-411d-b2b9-541a4fc5072d {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:37:42 user nova-compute[73258]: WARNING nova.compute.manager [req-94b70bfd-3493-4f25-8ac6-473acc6ed896 req-4ae707c7-13f9-4046-9a4b-106cb10f7486 service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Received unexpected event network-vif-plugged-c40794f4-8107-411d-b2b9-541a4fc5072d for instance with vm_state building and task_state spawning.
Aug 27 06:37:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Received event network-vif-plugged-5d69f70a-cd94-4b7b-abc9-652fc681c98b {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] Acquiring lock "33b995be-307d-4491-a1b4-fb75ececea1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] Lock "33b995be-307d-4491-a1b4-fb75ececea1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] Lock "33b995be-307d-4491-a1b4-fb75ececea1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] No waiting events found dispatching network-vif-plugged-5d69f70a-cd94-4b7b-abc9-652fc681c98b {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:37:43 user nova-compute[73258]: WARNING nova.compute.manager [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Received unexpected event network-vif-plugged-5d69f70a-cd94-4b7b-abc9-652fc681c98b for instance with vm_state active and task_state None.
Aug 27 06:37:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Received event network-vif-plugged-9210c142-099e-4af9-b48b-fc0e3ddcdc23 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] Acquiring lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] No waiting events found dispatching network-vif-plugged-9210c142-099e-4af9-b48b-fc0e3ddcdc23 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:37:43 user nova-compute[73258]: WARNING nova.compute.manager [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Received unexpected event network-vif-plugged-9210c142-099e-4af9-b48b-fc0e3ddcdc23 for instance with vm_state active and task_state None.
Aug 27 06:37:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Received event network-vif-plugged-9210c142-099e-4af9-b48b-fc0e3ddcdc23 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] Acquiring lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] No waiting events found dispatching network-vif-plugged-9210c142-099e-4af9-b48b-fc0e3ddcdc23 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:37:43 user nova-compute[73258]: WARNING nova.compute.manager [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Received unexpected event network-vif-plugged-9210c142-099e-4af9-b48b-fc0e3ddcdc23 for instance with vm_state active and task_state None.
Aug 27 06:37:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received event network-vif-plugged-e84fffb7-b665-47d1-a38c-525d4ada5d39 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] Acquiring lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] No waiting events found dispatching network-vif-plugged-e84fffb7-b665-47d1-a38c-525d4ada5d39 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:37:43 user nova-compute[73258]: WARNING nova.compute.manager [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received unexpected event network-vif-plugged-e84fffb7-b665-47d1-a38c-525d4ada5d39 for instance with vm_state active and task_state None.
Aug 27 06:37:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received event network-vif-plugged-e84fffb7-b665-47d1-a38c-525d4ada5d39 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] Acquiring lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] No waiting events found dispatching network-vif-plugged-e84fffb7-b665-47d1-a38c-525d4ada5d39 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:37:43 user nova-compute[73258]: WARNING nova.compute.manager [req-3fc8aea6-5343-4372-ac69-b33677f1ffd1 req-7a78b021-443d-4b42-89fb-8e97d796c6ee service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received unexpected event network-vif-plugged-e84fffb7-b665-47d1-a38c-525d4ada5d39 for instance with vm_state active and task_state None.
Aug 27 06:37:44 user nova-compute[73258]: DEBUG nova.compute.manager [req-543a8179-3028-4acd-81b6-bc5cccccb86f req-1e7deb2b-0804-414b-98c3-66b968738b9e service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Received event network-vif-plugged-c40794f4-8107-411d-b2b9-541a4fc5072d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-543a8179-3028-4acd-81b6-bc5cccccb86f req-1e7deb2b-0804-414b-98c3-66b968738b9e service nova] Acquiring lock "b51f0635-3ec5-4623-9265-350033b778c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-543a8179-3028-4acd-81b6-bc5cccccb86f req-1e7deb2b-0804-414b-98c3-66b968738b9e service nova] Lock "b51f0635-3ec5-4623-9265-350033b778c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-543a8179-3028-4acd-81b6-bc5cccccb86f req-1e7deb2b-0804-414b-98c3-66b968738b9e service nova] Lock "b51f0635-3ec5-4623-9265-350033b778c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:44 user nova-compute[73258]: DEBUG nova.compute.manager [req-543a8179-3028-4acd-81b6-bc5cccccb86f req-1e7deb2b-0804-414b-98c3-66b968738b9e service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] No waiting events found dispatching network-vif-plugged-c40794f4-8107-411d-b2b9-541a4fc5072d {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:37:44 user nova-compute[73258]: WARNING nova.compute.manager [req-543a8179-3028-4acd-81b6-bc5cccccb86f req-1e7deb2b-0804-414b-98c3-66b968738b9e service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Received unexpected event network-vif-plugged-c40794f4-8107-411d-b2b9-541a4fc5072d for instance with vm_state building and task_state spawning.
Aug 27 06:37:45 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118265.0864582, b51f0635-3ec5-4623-9265-350033b778c6 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:37:45 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b51f0635-3ec5-4623-9265-350033b778c6] VM Resumed (Lifecycle Event)
Aug 27 06:37:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:37:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:37:45 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Instance spawned successfully.
Aug 27 06:37:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:37:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:37:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:37:45 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b51f0635-3ec5-4623-9265-350033b778c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:37:45 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118265.0875607, b51f0635-3ec5-4623-9265-350033b778c6 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:37:45 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b51f0635-3ec5-4623-9265-350033b778c6] VM Started (Lifecycle Event)
Aug 27 06:37:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:37:45 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b51f0635-3ec5-4623-9265-350033b778c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:37:45 user nova-compute[73258]: INFO nova.compute.manager [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Took 7.72 seconds to spawn the instance on the hypervisor.
Aug 27 06:37:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:37:45 user nova-compute[73258]: INFO nova.compute.manager [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Took 8.83 seconds to build instance.
Aug 27 06:37:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcca4e30-f784-46b7-9b35-ae7d16b270fd tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Lock "b51f0635-3ec5-4623-9265-350033b778c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.111s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Acquiring lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:37:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:37:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:37:52 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:37:52 user nova-compute[73258]: INFO nova.compute.claims [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Claim successful on node user
Aug 27 06:37:53 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:37:53 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:37:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:37:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:37:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:37:53 user nova-compute[73258]: DEBUG nova.network.neutron [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:37:53 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:37:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:37:53 user nova-compute[73258]: DEBUG nova.policy [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba84ad5267474566aaad7bfbef1eb327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff4b3482c19440abf8930632fdedf2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:37:53 user nova-compute[73258]: INFO nova.virt.block_device [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Booting with volume 09b45154-77cc-47a2-8ced-c072a9acc75f at /dev/vda
Aug 27 06:37:53 user nova-compute[73258]: DEBUG os_brick.utils [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:37:53 user nova-compute[73258]: INFO oslo.privsep.daemon [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp10c86khw/privsep.sock']
Aug 27 06:37:53 user sudo[84385]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp10c86khw/privsep.sock
Aug 27 06:37:53 user sudo[84385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 27 06:37:53 user nova-compute[73258]: DEBUG nova.network.neutron [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Successfully created port: d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:37:54 user nova-compute[73258]: DEBUG nova.network.neutron [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Successfully updated port: d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:37:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Acquiring lock "refresh_cache-b1b1b0cd-cd43-459f-aaaa-73ae805f9984" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:37:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Acquired lock "refresh_cache-b1b1b0cd-cd43-459f-aaaa-73ae805f9984" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:37:54 user nova-compute[73258]: DEBUG nova.network.neutron [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:37:54 user nova-compute[73258]: DEBUG nova.compute.manager [req-c5bbca99-284b-445d-a51c-14557d8be740 req-d57ed12a-cb69-44b4-a8af-653cbca41b20 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received event network-changed-d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:37:54 user nova-compute[73258]: DEBUG nova.compute.manager [req-c5bbca99-284b-445d-a51c-14557d8be740 req-d57ed12a-cb69-44b4-a8af-653cbca41b20 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Refreshing instance network info cache due to event network-changed-d1cdcd84-44c1-4385-8671-6481d8a17e57. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:37:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c5bbca99-284b-445d-a51c-14557d8be740 req-d57ed12a-cb69-44b4-a8af-653cbca41b20 service nova] Acquiring lock "refresh_cache-b1b1b0cd-cd43-459f-aaaa-73ae805f9984" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:37:54 user nova-compute[73258]: DEBUG nova.network.neutron [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG nova.network.neutron [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Updating instance_info_cache with network_info: [{"id": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "address": "fa:16:3e:3b:e8:5d", "network": {"id": "99da6780-8423-4561-85a7-9cddac555ead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1622528656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff4b3482c19440abf8930632fdedf2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cdcd84-44", "ovs_interfaceid": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Releasing lock "refresh_cache-b1b1b0cd-cd43-459f-aaaa-73ae805f9984" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Instance network_info: |[{"id": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "address": "fa:16:3e:3b:e8:5d", "network": {"id": "99da6780-8423-4561-85a7-9cddac555ead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1622528656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff4b3482c19440abf8930632fdedf2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cdcd84-44", "ovs_interfaceid": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c5bbca99-284b-445d-a51c-14557d8be740 req-d57ed12a-cb69-44b4-a8af-653cbca41b20 service nova] Acquired lock "refresh_cache-b1b1b0cd-cd43-459f-aaaa-73ae805f9984" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG nova.network.neutron [req-c5bbca99-284b-445d-a51c-14557d8be740 req-d57ed12a-cb69-44b4-a8af-653cbca41b20 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Refreshing network info cache for port d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:37:55 user sudo[84385]: pam_unix(sudo:session): session closed for user root
Aug 27 06:37:55 user nova-compute[73258]: INFO oslo.privsep.daemon [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Spawned new privsep daemon via rootwrap
Aug 27 06:37:55 user nova-compute[73258]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 27 06:37:55 user nova-compute[73258]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 27 06:37:55 user nova-compute[73258]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 27 06:37:55 user nova-compute[73258]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84389
Aug 27 06:37:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b210a5c-85a1-4348-ab35-b2598e9bc3cd]: (2,) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d773f6-b754-4764-be60-b8e13c8ad7a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:37:55 user nova-compute[73258]: WARNING os_brick.initiator.connectors.nvmeof [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 27 06:37:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae5045e-b825-4b7d-af49-4e5c9dbed757]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc2dc3b-c8bf-4eb2-8f2f-2a3aa1c949b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c549adb1-f998-47dd-a07b-2413cdb85a38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:37:55 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:37:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e8d8d0-eb53-4114-b0b0-57ff622097d7]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG os_brick.utils [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] <== get_connector_properties: return (2315ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Updating existing volume attachment record: fa1c4027-6e04-4f2d-a2aa-4215e7234a61 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG nova.network.neutron [req-c5bbca99-284b-445d-a51c-14557d8be740 req-d57ed12a-cb69-44b4-a8af-653cbca41b20 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Updated VIF entry in instance network info cache for port d1cdcd84-44c1-4385-8671-6481d8a17e57. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG nova.network.neutron [req-c5bbca99-284b-445d-a51c-14557d8be740 req-d57ed12a-cb69-44b4-a8af-653cbca41b20 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Updating instance_info_cache with network_info: [{"id": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "address": "fa:16:3e:3b:e8:5d", "network": {"id": "99da6780-8423-4561-85a7-9cddac555ead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1622528656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff4b3482c19440abf8930632fdedf2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cdcd84-44", "ovs_interfaceid": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c5bbca99-284b-445d-a51c-14557d8be740 req-d57ed12a-cb69-44b4-a8af-653cbca41b20 service nova] Releasing lock "refresh_cache-b1b1b0cd-cd43-459f-aaaa-73ae805f9984" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:37:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:37:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:38:07 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Creating image(s)
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Did not create local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Ensure instance console log exists: /opt/stack/data/nova/instances/b1b1b0cd-cd43-459f-aaaa-73ae805f9984/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Start _get_guest_xml network_info=[{"id": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "address": "fa:16:3e:3b:e8:5d", "network": {"id": "99da6780-8423-4561-85a7-9cddac555ead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1622528656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff4b3482c19440abf8930632fdedf2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cdcd84-44", "ovs_interfaceid": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLanNYcx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b1b1b0cd-cd43-459f-aaaa-73ae805f9984', 'attached_at': '', 'detached_at': '', 'volume_id': '09b45154-77cc-47a2-8ced-c072a9acc75f', 'serial': '09b45154-77cc-47a2-8ced-c072a9acc75f'}, 'attachment_id': 'fa1c4027-6e04-4f2d-a2aa-4215e7234a61', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:38:07 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:38:07 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connector [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Factory for ISCSI on None {{(pid=73258) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLanNYcx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:38:07 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:38:07 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:38:07 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d30af6-2a5d-4d92-b55d-3f7dc524f2b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:38:07 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4b19c1-3c3b-47ba-a446-c271ae580b08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f] added
Aug 27 06:38:07 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f889f7-79bc-4680-b6fd-a256edd29833]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0dab1d-942f-41f2-b0cd-60981ec00626]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLanNYcx {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLanNYcx" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f9dfa6-ad13-442f-a85b-545bf33485da]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hLanNYcx'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b2c73f-217a-4be8-aa7f-15aa4d5fd1a9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e58e18-9eb0-4a25-9940-6e297e25fa84]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 06:38:07 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 06:38:07 user nova-compute[73258]:  {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:38:07 user nova-compute[73258]: WARNING os_brick.initiator.connectors.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 06:38:07 user nova-compute[73258]: 
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7febb0fa-4ef9-4967-bdfa-72bd304fd7b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f, portal: 172.16.0.220,3260]
Aug 27 06:38:07 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f, portal: 172.16.0.220,3260] successful.
Aug 27 06:38:07 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[baef64c4-e058-4a55-b901-06c7b6642e39]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6cafa0-4351-4486-b2e5-b042c5387d6e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:38:07 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:38:07 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0b3054-a42d-45fd-b0ef-ad42650b4d49]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:07 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLanNYcx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26637646564633932', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637646564633932', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-365915423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-365915423',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXC+TqgbsZa3q6c5XtC1rMSZD6ezy7FUZNfIQqoaxgbog95i8n8Q42gJYkXEfdMM0sUAvXFMvuFpDd9ZOnMo/2eGVlV1fH/AwaBhBltragdNT3zavkJFQGky/A1N5DJmA==',key_name='tempest-keypair-1590337091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff4b3482c19440abf8930632fdedf2a',ramdisk_id='',reservation_id='r-i6gcfele',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-611468989',owner_user_name='tempest-ServerActionsV293TestJSON-611468989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:37:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba84ad5267474566aaad7bfbef1eb327',uuid=b1b1b0cd-cd43-459f-aaaa-73ae805f9984,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "address": "fa:16:3e:3b:e8:5d", "network": {"id": "99da6780-8423-4561-85a7-9cddac555ead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1622528656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff4b3482c19440abf8930632fdedf2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cdcd84-44", "ovs_interfaceid": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Converting VIF {"id": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "address": "fa:16:3e:3b:e8:5d", "network": {"id": "99da6780-8423-4561-85a7-9cddac555ead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1622528656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff4b3482c19440abf8930632fdedf2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cdcd84-44", "ovs_interfaceid": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e8:5d,bridge_name='br-int',has_traffic_filtering=True,id=d1cdcd84-44c1-4385-8671-6481d8a17e57,network=Network(99da6780-8423-4561-85a7-9cddac555ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cdcd84-44') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG nova.objects.instance [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lazy-loading 'pci_devices' on Instance uuid b1b1b0cd-cd43-459f-aaaa-73ae805f9984 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:38:08 user nova-compute[73258]:   <uuid>b1b1b0cd-cd43-459f-aaaa-73ae805f9984</uuid>
Aug 27 06:38:08 user nova-compute[73258]:   <name>instance-0000000a</name>
Aug 27 06:38:08 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:38:08 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:38:08 user nova-compute[73258]:   <metadata>
Aug 27 06:38:08 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:38:08 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:38:08 user nova-compute[73258]:       <nova:name>tempest-ServerActionsV293TestJSON-server-365915423</nova:name>
Aug 27 06:38:08 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:38:07</nova:creationTime>
Aug 27 06:38:08 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:38:08 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:38:08 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:38:08 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:38:08 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:38:08 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:38:08 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:38:08 user nova-compute[73258]:       <nova:owner>
Aug 27 06:38:08 user nova-compute[73258]:         <nova:user uuid="ba84ad5267474566aaad7bfbef1eb327">tempest-ServerActionsV293TestJSON-611468989-project-member</nova:user>
Aug 27 06:38:08 user nova-compute[73258]:         <nova:project uuid="2ff4b3482c19440abf8930632fdedf2a">tempest-ServerActionsV293TestJSON-611468989</nova:project>
Aug 27 06:38:08 user nova-compute[73258]:       </nova:owner>
Aug 27 06:38:08 user nova-compute[73258]:       <nova:ports>
Aug 27 06:38:08 user nova-compute[73258]:         <nova:port uuid="d1cdcd84-44c1-4385-8671-6481d8a17e57">
Aug 27 06:38:08 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 06:38:08 user nova-compute[73258]:         </nova:port>
Aug 27 06:38:08 user nova-compute[73258]:       </nova:ports>
Aug 27 06:38:08 user nova-compute[73258]:     </nova:instance>
Aug 27 06:38:08 user nova-compute[73258]:   </metadata>
Aug 27 06:38:08 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:38:08 user nova-compute[73258]:     <system>
Aug 27 06:38:08 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:38:08 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:38:08 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:38:08 user nova-compute[73258]:       <entry name="serial">b1b1b0cd-cd43-459f-aaaa-73ae805f9984</entry>
Aug 27 06:38:08 user nova-compute[73258]:       <entry name="uuid">b1b1b0cd-cd43-459f-aaaa-73ae805f9984</entry>
Aug 27 06:38:08 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:38:08 user nova-compute[73258]:     </system>
Aug 27 06:38:08 user nova-compute[73258]:   </sysinfo>
Aug 27 06:38:08 user nova-compute[73258]:   <os>
Aug 27 06:38:08 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:38:08 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:38:08 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:38:08 user nova-compute[73258]:   </os>
Aug 27 06:38:08 user nova-compute[73258]:   <features>
Aug 27 06:38:08 user nova-compute[73258]:     <acpi/>
Aug 27 06:38:08 user nova-compute[73258]:     <apic/>
Aug 27 06:38:08 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:38:08 user nova-compute[73258]:   </features>
Aug 27 06:38:08 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:38:08 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:38:08 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:38:08 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:38:08 user nova-compute[73258]:   </clock>
Aug 27 06:38:08 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:38:08 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:38:08 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:38:08 user nova-compute[73258]:   </cpu>
Aug 27 06:38:08 user nova-compute[73258]:   <devices>
Aug 27 06:38:08 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:38:08 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:38:08 user nova-compute[73258]:       <source dev="/dev/sdb"/>
Aug 27 06:38:08 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:38:08 user nova-compute[73258]:       <serial>09b45154-77cc-47a2-8ced-c072a9acc75f</serial>
Aug 27 06:38:08 user nova-compute[73258]:     </disk>
Aug 27 06:38:08 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:38:08 user nova-compute[73258]:       <mac address="fa:16:3e:3b:e8:5d"/>
Aug 27 06:38:08 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:38:08 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:38:08 user nova-compute[73258]:       <target dev="tapd1cdcd84-44"/>
Aug 27 06:38:08 user nova-compute[73258]:     </interface>
Aug 27 06:38:08 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:38:08 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/b1b1b0cd-cd43-459f-aaaa-73ae805f9984/console.log" append="off"/>
Aug 27 06:38:08 user nova-compute[73258]:     </serial>
Aug 27 06:38:08 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:38:08 user nova-compute[73258]:     <video>
Aug 27 06:38:08 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:38:08 user nova-compute[73258]:     </video>
Aug 27 06:38:08 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:38:08 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:38:08 user nova-compute[73258]:     </rng>
Aug 27 06:38:08 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:38:08 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:38:08 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:38:08 user nova-compute[73258]:     </memballoon>
Aug 27 06:38:08 user nova-compute[73258]:   </devices>
Aug 27 06:38:08 user nova-compute[73258]: </domain>
Aug 27 06:38:08 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-365915423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-365915423',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXC+TqgbsZa3q6c5XtC1rMSZD6ezy7FUZNfIQqoaxgbog95i8n8Q42gJYkXEfdMM0sUAvXFMvuFpDd9ZOnMo/2eGVlV1fH/AwaBhBltragdNT3zavkJFQGky/A1N5DJmA==',key_name='tempest-keypair-1590337091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff4b3482c19440abf8930632fdedf2a',ramdisk_id='',reservation_id='r-i6gcfele',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-611468989',owner_user_name='tempest-ServerActionsV293TestJSON-611468989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:37:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba84ad5267474566aaad7bfbef1eb327',uuid=b1b1b0cd-cd43-459f-aaaa-73ae805f9984,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "address": "fa:16:3e:3b:e8:5d", "network": {"id": "99da6780-8423-4561-85a7-9cddac555ead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1622528656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff4b3482c19440abf8930632fdedf2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cdcd84-44", "ovs_interfaceid": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Converting VIF {"id": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "address": "fa:16:3e:3b:e8:5d", "network": {"id": "99da6780-8423-4561-85a7-9cddac555ead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1622528656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff4b3482c19440abf8930632fdedf2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cdcd84-44", "ovs_interfaceid": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e8:5d,bridge_name='br-int',has_traffic_filtering=True,id=d1cdcd84-44c1-4385-8671-6481d8a17e57,network=Network(99da6780-8423-4561-85a7-9cddac555ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cdcd84-44') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG os_vif [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e8:5d,bridge_name='br-int',has_traffic_filtering=True,id=d1cdcd84-44c1-4385-8671-6481d8a17e57,network=Network(99da6780-8423-4561-85a7-9cddac555ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cdcd84-44') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1cdcd84-44, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1cdcd84-44, col_values=(('external_ids', {'iface-id': 'd1cdcd84-44c1-4385-8671-6481d8a17e57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:e8:5d', 'vm-uuid': 'b1b1b0cd-cd43-459f-aaaa-73ae805f9984'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:38:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:08 user nova-compute[73258]: INFO os_vif [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e8:5d,bridge_name='br-int',has_traffic_filtering=True,id=d1cdcd84-44c1-4385-8671-6481d8a17e57,network=Network(99da6780-8423-4561-85a7-9cddac555ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cdcd84-44')
Aug 27 06:38:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:38:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] No VIF found with MAC fa:16:3e:3b:e8:5d, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:38:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-07e84636-667b-4a0f-9af3-29950de8934b req-81386240-3c60-47bf-9a83-d968c768eb52 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received event network-vif-plugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-07e84636-667b-4a0f-9af3-29950de8934b req-81386240-3c60-47bf-9a83-d968c768eb52 service nova] Acquiring lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:38:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-07e84636-667b-4a0f-9af3-29950de8934b req-81386240-3c60-47bf-9a83-d968c768eb52 service nova] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:38:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-07e84636-667b-4a0f-9af3-29950de8934b req-81386240-3c60-47bf-9a83-d968c768eb52 service nova] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:38:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-07e84636-667b-4a0f-9af3-29950de8934b req-81386240-3c60-47bf-9a83-d968c768eb52 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] No waiting events found dispatching network-vif-plugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:38:10 user nova-compute[73258]: WARNING nova.compute.manager [req-07e84636-667b-4a0f-9af3-29950de8934b req-81386240-3c60-47bf-9a83-d968c768eb52 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received unexpected event network-vif-plugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 for instance with vm_state building and task_state spawning.
Aug 27 06:38:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:12 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118292.4920263, b1b1b0cd-cd43-459f-aaaa-73ae805f9984 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:38:12 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] VM Resumed (Lifecycle Event)
Aug 27 06:38:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:38:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:38:12 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Instance spawned successfully.
Aug 27 06:38:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:38:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:38:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:38:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:38:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:38:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:38:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:38:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:38:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:38:12 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:38:12 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118292.4950328, b1b1b0cd-cd43-459f-aaaa-73ae805f9984 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:38:12 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] VM Started (Lifecycle Event)
Aug 27 06:38:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:38:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:38:12 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:38:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-430cad55-a9ea-4cdf-b3d9-7ab6fc4534a3 req-5cbce6fe-a44c-4b4f-b801-267c1a521d76 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received event network-vif-plugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-430cad55-a9ea-4cdf-b3d9-7ab6fc4534a3 req-5cbce6fe-a44c-4b4f-b801-267c1a521d76 service nova] Acquiring lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:38:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-430cad55-a9ea-4cdf-b3d9-7ab6fc4534a3 req-5cbce6fe-a44c-4b4f-b801-267c1a521d76 service nova] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:38:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-430cad55-a9ea-4cdf-b3d9-7ab6fc4534a3 req-5cbce6fe-a44c-4b4f-b801-267c1a521d76 service nova] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:38:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-430cad55-a9ea-4cdf-b3d9-7ab6fc4534a3 req-5cbce6fe-a44c-4b4f-b801-267c1a521d76 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] No waiting events found dispatching network-vif-plugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:38:12 user nova-compute[73258]: WARNING nova.compute.manager [req-430cad55-a9ea-4cdf-b3d9-7ab6fc4534a3 req-5cbce6fe-a44c-4b4f-b801-267c1a521d76 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received unexpected event network-vif-plugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 for instance with vm_state building and task_state spawning.
Aug 27 06:38:12 user nova-compute[73258]: INFO nova.compute.manager [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Took 5.14 seconds to spawn the instance on the hypervisor.
Aug 27 06:38:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:38:12 user nova-compute[73258]: INFO nova.compute.manager [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Took 20.15 seconds to build instance.
Aug 27 06:38:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f1312624-a114-4e7f-aa23-42e8f79b2f28 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.318s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:38:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:38:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "d7b11762-9244-481b-87dd-757782d68101" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:38:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:38:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:38:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:38:19 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:38:19 user nova-compute[73258]: INFO nova.compute.claims [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Claim successful on node user
Aug 27 06:38:20 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:38:20 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:38:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:38:20 user nova-compute[73258]: INFO nova.virt.block_device [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Booting with volume 82843900-e694-4189-a8db-9c5fc3f8701e at /dev/vda
Aug 27 06:38:20 user nova-compute[73258]: DEBUG os_brick.utils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c624f2ae-9d97-415f-93c7-9535c5a9f24a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67f5c8b-bb10-41d1-8af5-b3a5981147d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9904939-3b8b-447a-937c-4c55ef0f1b3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de28467-85e5-4c66-b837-29587fd18f5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG nova.policy [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43938d8b904147cb993c722199ff8ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc65880fbec492095249cbc8765656a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:38:20 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:38:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[588be471-86ce-4ae9-9800-740097ca1189]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG os_brick.utils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:38:20 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Updating existing volume attachment record: 204a5c6d-f887-451a-b354-529ace261407 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:38:21 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Successfully created port: 933454ca-76f3-4f90-aab9-14e915a58487 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:38:22 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Successfully created port: 384e3fbf-506e-42cb-8050-e05c2ee95749 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:38:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:22 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Successfully created port: e184532a-df10-431e-9ef2-c3a595e56b5d {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:38:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:38:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:38:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:38:23 user nova-compute[73258]: INFO nova.compute.claims [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Claim successful on node user
Aug 27 06:38:23 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Successfully created port: 87427dc4-15ba-4179-999a-217c5eef5fd3 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:38:23 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:38:23 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:38:23 user nova-compute[73258]: INFO nova.virt.block_device [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Booting with volume f4341dc1-1685-44f0-b29f-5212dba42abd at /dev/vda
Aug 27 06:38:23 user nova-compute[73258]: DEBUG os_brick.utils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c32c5bf-1880-400e-8f46-e0f62c464508]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d92a78-3e45-490e-bd61-eb850ab0205f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[170eda18-9633-4dba-aa90-c1489d35d402]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f15d2d-a866-44a5-847f-25902f7386f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG nova.policy [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e08cea7dd1244afb9c29e851e15fa1a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e3e1c0feb243a7aeb858041065ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:38:23 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:38:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[993bb722-e2fe-4c70-ae80-936b7d77e614]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG os_brick.utils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updating existing volume attachment record: f78f2337-eb19-4c3d-ba7a-1e976c81d9d1 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:38:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:24 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Successfully created port: 9688c75d-c1a5-4bab-aa92-e1e3eed530bd {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:38:25 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Successfully created port: 59275472-b18f-4e4b-922f-475dd553833c {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:38:26 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Successfully updated port: 933454ca-76f3-4f90-aab9-14e915a58487 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:38:26 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Successfully created port: e481124c-b62d-4fc9-9f02-ba38c027180e {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:38:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-fe24da4b-d1f2-4cfa-a321-b161727a43bd req-877f413d-4625-4ee5-9990-bd75781a9601 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-changed-933454ca-76f3-4f90-aab9-14e915a58487 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-fe24da4b-d1f2-4cfa-a321-b161727a43bd req-877f413d-4625-4ee5-9990-bd75781a9601 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Refreshing instance network info cache due to event network-changed-933454ca-76f3-4f90-aab9-14e915a58487. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:38:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fe24da4b-d1f2-4cfa-a321-b161727a43bd req-877f413d-4625-4ee5-9990-bd75781a9601 service nova] Acquiring lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fe24da4b-d1f2-4cfa-a321-b161727a43bd req-877f413d-4625-4ee5-9990-bd75781a9601 service nova] Acquired lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:26 user nova-compute[73258]: DEBUG nova.network.neutron [req-fe24da4b-d1f2-4cfa-a321-b161727a43bd req-877f413d-4625-4ee5-9990-bd75781a9601 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Refreshing network info cache for port 933454ca-76f3-4f90-aab9-14e915a58487 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:38:26 user nova-compute[73258]: DEBUG nova.network.neutron [req-fe24da4b-d1f2-4cfa-a321-b161727a43bd req-877f413d-4625-4ee5-9990-bd75781a9601 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:38:26 user nova-compute[73258]: DEBUG nova.network.neutron [req-fe24da4b-d1f2-4cfa-a321-b161727a43bd req-877f413d-4625-4ee5-9990-bd75781a9601 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fe24da4b-d1f2-4cfa-a321-b161727a43bd req-877f413d-4625-4ee5-9990-bd75781a9601 service nova] Releasing lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:27 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Successfully created port: 0914d88d-1909-4bcb-a776-37af31e16b9e {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:38:27 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Successfully updated port: 5c2f38b2-1d02-4e50-bc89-a2fa523fc408 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:38:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-82a953e2-7bb4-4f9d-a462-1344d1fb131f req-69c9a1fa-60f3-4324-9964-1ef2968503fe service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-changed-5c2f38b2-1d02-4e50-bc89-a2fa523fc408 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-82a953e2-7bb4-4f9d-a462-1344d1fb131f req-69c9a1fa-60f3-4324-9964-1ef2968503fe service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Refreshing instance network info cache due to event network-changed-5c2f38b2-1d02-4e50-bc89-a2fa523fc408. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:38:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-82a953e2-7bb4-4f9d-a462-1344d1fb131f req-69c9a1fa-60f3-4324-9964-1ef2968503fe service nova] Acquiring lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-82a953e2-7bb4-4f9d-a462-1344d1fb131f req-69c9a1fa-60f3-4324-9964-1ef2968503fe service nova] Acquired lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:28 user nova-compute[73258]: DEBUG nova.network.neutron [req-82a953e2-7bb4-4f9d-a462-1344d1fb131f req-69c9a1fa-60f3-4324-9964-1ef2968503fe service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Refreshing network info cache for port 5c2f38b2-1d02-4e50-bc89-a2fa523fc408 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:38:28 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Successfully created port: e32a9d4d-57df-4765-b5be-12cea8621fce {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:38:28 user nova-compute[73258]: DEBUG nova.network.neutron [req-82a953e2-7bb4-4f9d-a462-1344d1fb131f req-69c9a1fa-60f3-4324-9964-1ef2968503fe service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:38:28 user nova-compute[73258]: DEBUG nova.network.neutron [req-82a953e2-7bb4-4f9d-a462-1344d1fb131f req-69c9a1fa-60f3-4324-9964-1ef2968503fe service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-82a953e2-7bb4-4f9d-a462-1344d1fb131f req-69c9a1fa-60f3-4324-9964-1ef2968503fe service nova] Releasing lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:38:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:38:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 06:38:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:38:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:38:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:29 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Successfully updated port: f0370f5d-defe-48bd-b320-47db121211e2 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:38:29 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Successfully created port: 783f5103-a178-42e0-a3b0-f523ca4c9439 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:38:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-8c2e30a9-82dc-4592-856a-428c7f59d054 req-e3ab590d-e6b1-4a5e-82d6-ad3d0fcd29fb service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-changed-f0370f5d-defe-48bd-b320-47db121211e2 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-8c2e30a9-82dc-4592-856a-428c7f59d054 req-e3ab590d-e6b1-4a5e-82d6-ad3d0fcd29fb service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Refreshing instance network info cache due to event network-changed-f0370f5d-defe-48bd-b320-47db121211e2. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:38:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8c2e30a9-82dc-4592-856a-428c7f59d054 req-e3ab590d-e6b1-4a5e-82d6-ad3d0fcd29fb service nova] Acquiring lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8c2e30a9-82dc-4592-856a-428c7f59d054 req-e3ab590d-e6b1-4a5e-82d6-ad3d0fcd29fb service nova] Acquired lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:30 user nova-compute[73258]: DEBUG nova.network.neutron [req-8c2e30a9-82dc-4592-856a-428c7f59d054 req-e3ab590d-e6b1-4a5e-82d6-ad3d0fcd29fb service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Refreshing network info cache for port f0370f5d-defe-48bd-b320-47db121211e2 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:38:30 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Successfully updated port: 384e3fbf-506e-42cb-8050-e05c2ee95749 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:38:30 user nova-compute[73258]: DEBUG nova.network.neutron [req-8c2e30a9-82dc-4592-856a-428c7f59d054 req-e3ab590d-e6b1-4a5e-82d6-ad3d0fcd29fb service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:38:30 user nova-compute[73258]: DEBUG nova.network.neutron [req-8c2e30a9-82dc-4592-856a-428c7f59d054 req-e3ab590d-e6b1-4a5e-82d6-ad3d0fcd29fb service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8c2e30a9-82dc-4592-856a-428c7f59d054 req-e3ab590d-e6b1-4a5e-82d6-ad3d0fcd29fb service nova] Releasing lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:30 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Successfully updated port: 59275472-b18f-4e4b-922f-475dd553833c {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:38:31 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Successfully updated port: e184532a-df10-431e-9ef2-c3a595e56b5d {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:38:32 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Successfully updated port: e5820add-1974-4f6c-873e-ef179593b46a {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:38:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-changed-384e3fbf-506e-42cb-8050-e05c2ee95749 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Refreshing instance network info cache due to event network-changed-384e3fbf-506e-42cb-8050-e05c2ee95749. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:38:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] Acquiring lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] Acquired lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:32 user nova-compute[73258]: DEBUG nova.network.neutron [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Refreshing network info cache for port 384e3fbf-506e-42cb-8050-e05c2ee95749 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:38:32 user nova-compute[73258]: DEBUG nova.network.neutron [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:38:32 user nova-compute[73258]: DEBUG nova.network.neutron [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] Releasing lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-changed-59275472-b18f-4e4b-922f-475dd553833c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Refreshing instance network info cache due to event network-changed-59275472-b18f-4e4b-922f-475dd553833c. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:38:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] Acquiring lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] Acquired lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:32 user nova-compute[73258]: DEBUG nova.network.neutron [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Refreshing network info cache for port 59275472-b18f-4e4b-922f-475dd553833c {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:38:32 user nova-compute[73258]: DEBUG nova.network.neutron [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG nova.network.neutron [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] Releasing lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG nova.compute.manager [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-changed-e184532a-df10-431e-9ef2-c3a595e56b5d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG nova.compute.manager [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Refreshing instance network info cache due to event network-changed-e184532a-df10-431e-9ef2-c3a595e56b5d. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] Acquiring lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] Acquired lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG nova.network.neutron [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Refreshing network info cache for port e184532a-df10-431e-9ef2-c3a595e56b5d {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG nova.network.neutron [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG nova.network.neutron [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Successfully updated port: 87427dc4-15ba-4179-999a-217c5eef5fd3 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] Releasing lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG nova.compute.manager [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-changed-e5820add-1974-4f6c-873e-ef179593b46a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG nova.compute.manager [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Refreshing instance network info cache due to event network-changed-e5820add-1974-4f6c-873e-ef179593b46a. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] Acquiring lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] Acquired lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG nova.network.neutron [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Refreshing network info cache for port e5820add-1974-4f6c-873e-ef179593b46a {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG nova.network.neutron [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG nova.network.neutron [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-96718554-6997-4ef4-83f0-c73c23df2136 req-a3634da3-1593-4e12-91ff-8a3fabf48288 service nova] Releasing lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Successfully updated port: ff33d225-ef5e-4565-9278-4763c5b7ff6c {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:38:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:34 user nova-compute[73258]: INFO nova.virt.block_device [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Booting with volume bd8029df-68c8-405f-8347-12cb0137e424 at /dev/vdb
Aug 27 06:38:34 user nova-compute[73258]: DEBUG os_brick.utils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff777aeb-937f-4b42-b138-35780af25b4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c4cb71-e53c-44e1-b433-26e0c3c7b294]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60eae91-a9cd-4917-b565-f5651aa09043]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae848670-3abb-4d84-bd56-5c5ffcbd88e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:38:34 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:38:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[653d2834-0b24-448f-a14e-7f469d808611]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG os_brick.utils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Updating existing volume attachment record: a3dbf675-e0b2-4f69-b524-2df48569332d {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-448b79e2-0748-49bb-9d6b-8c0ffa0bde05 req-96d183c5-d452-406f-aabe-da9a3820b862 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-changed-87427dc4-15ba-4179-999a-217c5eef5fd3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-448b79e2-0748-49bb-9d6b-8c0ffa0bde05 req-96d183c5-d452-406f-aabe-da9a3820b862 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Refreshing instance network info cache due to event network-changed-87427dc4-15ba-4179-999a-217c5eef5fd3. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-448b79e2-0748-49bb-9d6b-8c0ffa0bde05 req-96d183c5-d452-406f-aabe-da9a3820b862 service nova] Acquiring lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-448b79e2-0748-49bb-9d6b-8c0ffa0bde05 req-96d183c5-d452-406f-aabe-da9a3820b862 service nova] Acquired lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG nova.network.neutron [req-448b79e2-0748-49bb-9d6b-8c0ffa0bde05 req-96d183c5-d452-406f-aabe-da9a3820b862 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Refreshing network info cache for port 87427dc4-15ba-4179-999a-217c5eef5fd3 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG nova.network.neutron [req-448b79e2-0748-49bb-9d6b-8c0ffa0bde05 req-96d183c5-d452-406f-aabe-da9a3820b862 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Successfully updated port: 9688c75d-c1a5-4bab-aa92-e1e3eed530bd {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:38:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Acquiring lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Successfully updated port: e481124c-b62d-4fc9-9f02-ba38c027180e {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG nova.network.neutron [req-448b79e2-0748-49bb-9d6b-8c0ffa0bde05 req-96d183c5-d452-406f-aabe-da9a3820b862 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-448b79e2-0748-49bb-9d6b-8c0ffa0bde05 req-96d183c5-d452-406f-aabe-da9a3820b862 service nova] Releasing lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-448b79e2-0748-49bb-9d6b-8c0ffa0bde05 req-96d183c5-d452-406f-aabe-da9a3820b862 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-changed-ff33d225-ef5e-4565-9278-4763c5b7ff6c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-448b79e2-0748-49bb-9d6b-8c0ffa0bde05 req-96d183c5-d452-406f-aabe-da9a3820b862 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Refreshing instance network info cache due to event network-changed-ff33d225-ef5e-4565-9278-4763c5b7ff6c. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-448b79e2-0748-49bb-9d6b-8c0ffa0bde05 req-96d183c5-d452-406f-aabe-da9a3820b862 service nova] Acquiring lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-448b79e2-0748-49bb-9d6b-8c0ffa0bde05 req-96d183c5-d452-406f-aabe-da9a3820b862 service nova] Acquired lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG nova.network.neutron [req-448b79e2-0748-49bb-9d6b-8c0ffa0bde05 req-96d183c5-d452-406f-aabe-da9a3820b862 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Refreshing network info cache for port ff33d225-ef5e-4565-9278-4763c5b7ff6c {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Acquired lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG nova.network.neutron [req-448b79e2-0748-49bb-9d6b-8c0ffa0bde05 req-96d183c5-d452-406f-aabe-da9a3820b862 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG nova.network.neutron [req-448b79e2-0748-49bb-9d6b-8c0ffa0bde05 req-96d183c5-d452-406f-aabe-da9a3820b862 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-448b79e2-0748-49bb-9d6b-8c0ffa0bde05 req-96d183c5-d452-406f-aabe-da9a3820b862 service nova] Releasing lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:35 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:38:36 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Updating instance_info_cache with network_info: [{"id": "22202aee-0bda-40c0-9441-f014a5f99131", "address": "fa:16:3e:4a:cd:08", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22202aee-0b", "ovs_interfaceid": "22202aee-0bda-40c0-9441-f014a5f99131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:38:36 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:38:36 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:38:36 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:38:36 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:38:36 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:38:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:38:36 user nova-compute[73258]: DEBUG nova.compute.manager [req-5ee20090-6c09-4e3d-8862-c7304f390f27 req-748f3ec4-160d-47ee-be55-dc3e588e6eac service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-changed-9688c75d-c1a5-4bab-aa92-e1e3eed530bd {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:36 user nova-compute[73258]: DEBUG nova.compute.manager [req-5ee20090-6c09-4e3d-8862-c7304f390f27 req-748f3ec4-160d-47ee-be55-dc3e588e6eac service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Refreshing instance network info cache due to event network-changed-9688c75d-c1a5-4bab-aa92-e1e3eed530bd. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:38:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5ee20090-6c09-4e3d-8862-c7304f390f27 req-748f3ec4-160d-47ee-be55-dc3e588e6eac service nova] Acquiring lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:36 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:38:36 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Successfully updated port: 0914d88d-1909-4bcb-a776-37af31e16b9e {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:38:37 user nova-compute[73258]: INFO nova.virt.block_device [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Booting with volume bfea6f05-84f2-4b48-9460-5da143c24c4d at /dev/vdb
Aug 27 06:38:37 user nova-compute[73258]: DEBUG os_brick.utils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5961404d-58e2-44f1-95be-6c808a0a11b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6557577-50f4-425c-ba82-b0d51dac7aed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd55e9d-ae34-410e-97b9-7683dfd242d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[81493d2b-bb71-4ee1-9e24-bd48bd49a8a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:38:37 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:38:37 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b3756a-baea-4546-8a03-2af89a749a8b]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG os_brick.utils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updating existing volume attachment record: fe513a38-673f-44ab-b2da-d4867344e9c6 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:38:37 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:38:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:38 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Successfully updated port: e32a9d4d-57df-4765-b5be-12cea8621fce {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:38:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:38 user nova-compute[73258]: DEBUG nova.compute.manager [req-bcd81f63-c17a-40b9-b119-41b198916d9b req-7a0948a0-cc7d-48f5-a055-a92e951162ff service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-changed-0914d88d-1909-4bcb-a776-37af31e16b9e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:38 user nova-compute[73258]: DEBUG nova.compute.manager [req-bcd81f63-c17a-40b9-b119-41b198916d9b req-7a0948a0-cc7d-48f5-a055-a92e951162ff service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Refreshing instance network info cache due to event network-changed-0914d88d-1909-4bcb-a776-37af31e16b9e. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:38:38 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bcd81f63-c17a-40b9-b119-41b198916d9b req-7a0948a0-cc7d-48f5-a055-a92e951162ff service nova] Acquiring lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:38 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bcd81f63-c17a-40b9-b119-41b198916d9b req-7a0948a0-cc7d-48f5-a055-a92e951162ff service nova] Acquired lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:38 user nova-compute[73258]: DEBUG nova.network.neutron [req-bcd81f63-c17a-40b9-b119-41b198916d9b req-7a0948a0-cc7d-48f5-a055-a92e951162ff service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Refreshing network info cache for port 0914d88d-1909-4bcb-a776-37af31e16b9e {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:38:38 user nova-compute[73258]: DEBUG nova.network.neutron [req-bcd81f63-c17a-40b9-b119-41b198916d9b req-7a0948a0-cc7d-48f5-a055-a92e951162ff service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:38:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG nova.network.neutron [req-bcd81f63-c17a-40b9-b119-41b198916d9b req-7a0948a0-cc7d-48f5-a055-a92e951162ff service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bcd81f63-c17a-40b9-b119-41b198916d9b req-7a0948a0-cc7d-48f5-a055-a92e951162ff service nova] Releasing lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG nova.compute.manager [req-bcd81f63-c17a-40b9-b119-41b198916d9b req-7a0948a0-cc7d-48f5-a055-a92e951162ff service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-changed-e32a9d4d-57df-4765-b5be-12cea8621fce {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG nova.compute.manager [req-bcd81f63-c17a-40b9-b119-41b198916d9b req-7a0948a0-cc7d-48f5-a055-a92e951162ff service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Refreshing instance network info cache due to event network-changed-e32a9d4d-57df-4765-b5be-12cea8621fce. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bcd81f63-c17a-40b9-b119-41b198916d9b req-7a0948a0-cc7d-48f5-a055-a92e951162ff service nova] Acquiring lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bcd81f63-c17a-40b9-b119-41b198916d9b req-7a0948a0-cc7d-48f5-a055-a92e951162ff service nova] Acquired lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG nova.network.neutron [req-bcd81f63-c17a-40b9-b119-41b198916d9b req-7a0948a0-cc7d-48f5-a055-a92e951162ff service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Refreshing network info cache for port e32a9d4d-57df-4765-b5be-12cea8621fce {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG nova.network.neutron [req-bcd81f63-c17a-40b9-b119-41b198916d9b req-7a0948a0-cc7d-48f5-a055-a92e951162ff service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG nova.network.neutron [req-bcd81f63-c17a-40b9-b119-41b198916d9b req-7a0948a0-cc7d-48f5-a055-a92e951162ff service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bcd81f63-c17a-40b9-b119-41b198916d9b req-7a0948a0-cc7d-48f5-a055-a92e951162ff service nova] Releasing lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Acquiring lock "bb57b63c-888f-40a0-88c0-97f63fd8297f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "bb57b63c-888f-40a0-88c0-97f63fd8297f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG nova.objects.instance [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lazy-loading 'flavor' on Instance uuid bb57b63c-888f-40a0-88c0-97f63fd8297f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Updating instance_info_cache with network_info: [{"id": "933454ca-76f3-4f90-aab9-14e915a58487", "address": "fa:16:3e:41:30:a9", "network": {"id": "a2ca5db5-8c6d-44d0-acf5-c46a564a0247", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058086289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933454ca-76", "ovs_interfaceid": "933454ca-76f3-4f90-aab9-14e915a58487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "address": "fa:16:3e:34:10:b5", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2f38b2-1d", "ovs_interfaceid": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f0370f5d-defe-48bd-b320-47db121211e2", "address": "fa:16:3e:f6:03:41", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0370f5d-de", "ovs_interfaceid": "f0370f5d-defe-48bd-b320-47db121211e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "384e3fbf-506e-42cb-8050-e05c2ee95749", "address": "fa:16:3e:4d:cd:a0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384e3fbf-50", "ovs_interfaceid": "384e3fbf-506e-42cb-8050-e05c2ee95749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e184532a-df10-431e-9ef2-c3a595e56b5d", "address": "fa:16:3e:a6:7a:e0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184532a-df", "ovs_interfaceid": "e184532a-df10-431e-9ef2-c3a595e56b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87427dc4-15ba-4179-999a-217c5eef5fd3", "address": "fa:16:3e:41:44:fc", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87427dc4-15", "ovs_interfaceid": "87427dc4-15ba-4179-999a-217c5eef5fd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "address": "fa:16:3e:ca:07:e5", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9688c75d-c1", "ovs_interfaceid": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "bb57b63c-888f-40a0-88c0-97f63fd8297f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.257s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Releasing lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Instance network_info: |[{"id": "933454ca-76f3-4f90-aab9-14e915a58487", "address": "fa:16:3e:41:30:a9", "network": {"id": "a2ca5db5-8c6d-44d0-acf5-c46a564a0247", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058086289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933454ca-76", "ovs_interfaceid": "933454ca-76f3-4f90-aab9-14e915a58487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "address": "fa:16:3e:34:10:b5", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2f38b2-1d", "ovs_interfaceid": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f0370f5d-defe-48bd-b320-47db121211e2", "address": "fa:16:3e:f6:03:41", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0370f5d-de", "ovs_interfaceid": "f0370f5d-defe-48bd-b320-47db121211e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "384e3fbf-506e-42cb-8050-e05c2ee95749", "address": "fa:16:3e:4d:cd:a0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384e3fbf-50", "ovs_interfaceid": "384e3fbf-506e-42cb-8050-e05c2ee95749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e184532a-df10-431e-9ef2-c3a595e56b5d", "address": "fa:16:3e:a6:7a:e0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184532a-df", "ovs_interfaceid": "e184532a-df10-431e-9ef2-c3a595e56b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87427dc4-15ba-4179-999a-217c5eef5fd3", "address": "fa:16:3e:41:44:fc", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87427dc4-15", "ovs_interfaceid": "87427dc4-15ba-4179-999a-217c5eef5fd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "address": "fa:16:3e:ca:07:e5", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9688c75d-c1", "ovs_interfaceid": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5ee20090-6c09-4e3d-8862-c7304f390f27 req-748f3ec4-160d-47ee-be55-dc3e588e6eac service nova] Acquired lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG nova.network.neutron [req-5ee20090-6c09-4e3d-8862-c7304f390f27 req-748f3ec4-160d-47ee-be55-dc3e588e6eac service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Refreshing network info cache for port 9688c75d-c1a5-4bab-aa92-e1e3eed530bd {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Successfully updated port: 783f5103-a178-42e0-a3b0-f523ca4c9439 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Acquiring lock "bb57b63c-888f-40a0-88c0-97f63fd8297f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "bb57b63c-888f-40a0-88c0-97f63fd8297f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:38:39 user nova-compute[73258]: INFO nova.compute.manager [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Attaching volume 9b8cad13-f88c-4976-86a6-1ceda173159b to /dev/vdb
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Acquiring lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Acquired lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:39 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG os_brick.utils [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2330ea13-0976-4d14-8a91-ea6dd691bac9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[60aeb348-a81d-4cc1-adeb-028751e963a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab5d2dd-627d-444d-b974-2fa8a4700d45]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf60263-2ae2-45dd-bbb4-c1c6f2ee0d1b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:38:40 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[922bddda-1c08-458f-93a9-6c8ae43256c3]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG os_brick.utils [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Updating existing volume attachment record: 2f5264f0-43de-402d-a1d1-3e7f787a2d04 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG nova.network.neutron [req-5ee20090-6c09-4e3d-8862-c7304f390f27 req-748f3ec4-160d-47ee-be55-dc3e588e6eac service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Updated VIF entry in instance network info cache for port 9688c75d-c1a5-4bab-aa92-e1e3eed530bd. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG nova.network.neutron [req-5ee20090-6c09-4e3d-8862-c7304f390f27 req-748f3ec4-160d-47ee-be55-dc3e588e6eac service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Updating instance_info_cache with network_info: [{"id": "933454ca-76f3-4f90-aab9-14e915a58487", "address": "fa:16:3e:41:30:a9", "network": {"id": "a2ca5db5-8c6d-44d0-acf5-c46a564a0247", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058086289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933454ca-76", "ovs_interfaceid": "933454ca-76f3-4f90-aab9-14e915a58487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "address": "fa:16:3e:34:10:b5", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2f38b2-1d", "ovs_interfaceid": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f0370f5d-defe-48bd-b320-47db121211e2", "address": "fa:16:3e:f6:03:41", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0370f5d-de", "ovs_interfaceid": "f0370f5d-defe-48bd-b320-47db121211e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "384e3fbf-506e-42cb-8050-e05c2ee95749", "address": "fa:16:3e:4d:cd:a0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384e3fbf-50", "ovs_interfaceid": "384e3fbf-506e-42cb-8050-e05c2ee95749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e184532a-df10-431e-9ef2-c3a595e56b5d", "address": "fa:16:3e:a6:7a:e0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184532a-df", "ovs_interfaceid": "e184532a-df10-431e-9ef2-c3a595e56b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87427dc4-15ba-4179-999a-217c5eef5fd3", "address": "fa:16:3e:41:44:fc", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87427dc4-15", "ovs_interfaceid": "87427dc4-15ba-4179-999a-217c5eef5fd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "address": "fa:16:3e:ca:07:e5", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9688c75d-c1", "ovs_interfaceid": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5ee20090-6c09-4e3d-8862-c7304f390f27 req-748f3ec4-160d-47ee-be55-dc3e588e6eac service nova] Releasing lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG nova.compute.manager [req-5ee20090-6c09-4e3d-8862-c7304f390f27 req-748f3ec4-160d-47ee-be55-dc3e588e6eac service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-changed-e481124c-b62d-4fc9-9f02-ba38c027180e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG nova.compute.manager [req-5ee20090-6c09-4e3d-8862-c7304f390f27 req-748f3ec4-160d-47ee-be55-dc3e588e6eac service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Refreshing instance network info cache due to event network-changed-e481124c-b62d-4fc9-9f02-ba38c027180e. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5ee20090-6c09-4e3d-8862-c7304f390f27 req-748f3ec4-160d-47ee-be55-dc3e588e6eac service nova] Acquiring lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG nova.compute.manager [req-8941e649-80ca-4108-ad44-a6442c6c28fc req-acebdc10-3e99-4e51-829f-d06af74b61b6 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-changed-783f5103-a178-42e0-a3b0-f523ca4c9439 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG nova.compute.manager [req-8941e649-80ca-4108-ad44-a6442c6c28fc req-acebdc10-3e99-4e51-829f-d06af74b61b6 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Refreshing instance network info cache due to event network-changed-783f5103-a178-42e0-a3b0-f523ca4c9439. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8941e649-80ca-4108-ad44-a6442c6c28fc req-acebdc10-3e99-4e51-829f-d06af74b61b6 service nova] Acquiring lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:38:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.compute.manager [req-10d60b6c-c8d0-4fea-a3d8-b16cfc48230f req-a49ea8dd-daba-4f5b-bcc1-08922d585b7c service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Received event network-changed-22202aee-0bda-40c0-9441-f014a5f99131 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.compute.manager [req-10d60b6c-c8d0-4fea-a3d8-b16cfc48230f req-a49ea8dd-daba-4f5b-bcc1-08922d585b7c service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Refreshing instance network info cache due to event network-changed-22202aee-0bda-40c0-9441-f014a5f99131. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-10d60b6c-c8d0-4fea-a3d8-b16cfc48230f req-a49ea8dd-daba-4f5b-bcc1-08922d585b7c service nova] Acquiring lock "refresh_cache-e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-10d60b6c-c8d0-4fea-a3d8-b16cfc48230f req-a49ea8dd-daba-4f5b-bcc1-08922d585b7c service nova] Acquired lock "refresh_cache-e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.network.neutron [req-10d60b6c-c8d0-4fea-a3d8-b16cfc48230f req-a49ea8dd-daba-4f5b-bcc1-08922d585b7c service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Refreshing network info cache for port 22202aee-0bda-40c0-9441-f014a5f99131 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:38:42 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:38:42 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=6937MB free_disk=24.419635772705078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bb57b63c-888f-40a0-88c0-97f63fd8297f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 33b995be-307d-4491-a1b4-fb75ececea1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance e76827f8-dbbf-45fa-a84e-7f5dd0c62912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance b51f0635-3ec5-4623-9265-350033b778c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance b1b1b0cd-cd43-459f-aaaa-73ae805f9984 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance d7b11762-9244-481b-87dd-757782d68101 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 32d3fdfc-82ad-46ee-b673-4e73f43b85e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:38:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.593s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:38:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:43 user nova-compute[73258]: DEBUG nova.network.neutron [req-10d60b6c-c8d0-4fea-a3d8-b16cfc48230f req-a49ea8dd-daba-4f5b-bcc1-08922d585b7c service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Updated VIF entry in instance network info cache for port 22202aee-0bda-40c0-9441-f014a5f99131. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:38:43 user nova-compute[73258]: DEBUG nova.network.neutron [req-10d60b6c-c8d0-4fea-a3d8-b16cfc48230f req-a49ea8dd-daba-4f5b-bcc1-08922d585b7c service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Updating instance_info_cache with network_info: [{"id": "22202aee-0bda-40c0-9441-f014a5f99131", "address": "fa:16:3e:4a:cd:08", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22202aee-0b", "ovs_interfaceid": "22202aee-0bda-40c0-9441-f014a5f99131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-10d60b6c-c8d0-4fea-a3d8-b16cfc48230f req-a49ea8dd-daba-4f5b-bcc1-08922d585b7c service nova] Releasing lock "refresh_cache-e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:44 user nova-compute[73258]: DEBUG nova.compute.manager [req-e5ad8e3c-5ef0-4896-96a1-91fb03aaa2eb req-e1e08745-2ba4-49d0-ad8e-3ed3c5a38e7a service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received event network-changed-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:44 user nova-compute[73258]: DEBUG nova.compute.manager [req-e5ad8e3c-5ef0-4896-96a1-91fb03aaa2eb req-e1e08745-2ba4-49d0-ad8e-3ed3c5a38e7a service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Refreshing instance network info cache due to event network-changed-a345de09-b566-4d5c-8df6-5e706f31bc62. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:38:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e5ad8e3c-5ef0-4896-96a1-91fb03aaa2eb req-e1e08745-2ba4-49d0-ad8e-3ed3c5a38e7a service nova] Acquiring lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e5ad8e3c-5ef0-4896-96a1-91fb03aaa2eb req-e1e08745-2ba4-49d0-ad8e-3ed3c5a38e7a service nova] Acquired lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:44 user nova-compute[73258]: DEBUG nova.network.neutron [req-e5ad8e3c-5ef0-4896-96a1-91fb03aaa2eb req-e1e08745-2ba4-49d0-ad8e-3ed3c5a38e7a service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Refreshing network info cache for port a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:38:45 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updating instance_info_cache with network_info: [{"id": "59275472-b18f-4e4b-922f-475dd553833c", "address": "fa:16:3e:05:21:15", "network": {"id": "5eaba2f5-e1ca-4a9b-8195-bc8798d89753", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-374547766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59275472-b1", "ovs_interfaceid": "59275472-b18f-4e4b-922f-475dd553833c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5820add-1974-4f6c-873e-ef179593b46a", "address": "fa:16:3e:b1:35:89", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5820add-19", "ovs_interfaceid": "e5820add-1974-4f6c-873e-ef179593b46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "address": "fa:16:3e:5a:25:32", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff33d225-ef", "ovs_interfaceid": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e481124c-b62d-4fc9-9f02-ba38c027180e", "address": "fa:16:3e:ef:7e:25", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape481124c-b6", "ovs_interfaceid": "e481124c-b62d-4fc9-9f02-ba38c027180e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0914d88d-1909-4bcb-a776-37af31e16b9e", "address": "fa:16:3e:a0:a3:84", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914d88d-19", "ovs_interfaceid": "0914d88d-1909-4bcb-a776-37af31e16b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e32a9d4d-57df-4765-b5be-12cea8621fce", "address": "fa:16:3e:10:c4:37", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32a9d4d-57", "ovs_interfaceid": "e32a9d4d-57df-4765-b5be-12cea8621fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "783f5103-a178-42e0-a3b0-f523ca4c9439", "address": "fa:16:3e:4d:78:05", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap783f5103-a1", "ovs_interfaceid": "783f5103-a178-42e0-a3b0-f523ca4c9439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Releasing lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Instance network_info: |[{"id": "59275472-b18f-4e4b-922f-475dd553833c", "address": "fa:16:3e:05:21:15", "network": {"id": "5eaba2f5-e1ca-4a9b-8195-bc8798d89753", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-374547766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59275472-b1", "ovs_interfaceid": "59275472-b18f-4e4b-922f-475dd553833c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5820add-1974-4f6c-873e-ef179593b46a", "address": "fa:16:3e:b1:35:89", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5820add-19", "ovs_interfaceid": "e5820add-1974-4f6c-873e-ef179593b46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "address": "fa:16:3e:5a:25:32", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff33d225-ef", "ovs_interfaceid": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e481124c-b62d-4fc9-9f02-ba38c027180e", "address": "fa:16:3e:ef:7e:25", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape481124c-b6", "ovs_interfaceid": "e481124c-b62d-4fc9-9f02-ba38c027180e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0914d88d-1909-4bcb-a776-37af31e16b9e", "address": "fa:16:3e:a0:a3:84", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914d88d-19", "ovs_interfaceid": "0914d88d-1909-4bcb-a776-37af31e16b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e32a9d4d-57df-4765-b5be-12cea8621fce", "address": "fa:16:3e:10:c4:37", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32a9d4d-57", "ovs_interfaceid": "e32a9d4d-57df-4765-b5be-12cea8621fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "783f5103-a178-42e0-a3b0-f523ca4c9439", "address": "fa:16:3e:4d:78:05", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap783f5103-a1", "ovs_interfaceid": "783f5103-a178-42e0-a3b0-f523ca4c9439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:38:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5ee20090-6c09-4e3d-8862-c7304f390f27 req-748f3ec4-160d-47ee-be55-dc3e588e6eac service nova] Acquired lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:45 user nova-compute[73258]: DEBUG nova.network.neutron [req-5ee20090-6c09-4e3d-8862-c7304f390f27 req-748f3ec4-160d-47ee-be55-dc3e588e6eac service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Refreshing network info cache for port e481124c-b62d-4fc9-9f02-ba38c027180e {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:38:45 user nova-compute[73258]: DEBUG nova.compute.manager [req-8ecbd762-5703-48fb-ba98-93a4be16cb8c req-04bd28a6-d1ce-49e6-b7f8-afad0d1cdb74 service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Received event network-changed-f2f7670e-c9a1-437f-8143-4f7cfc60a035 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:45 user nova-compute[73258]: DEBUG nova.compute.manager [req-8ecbd762-5703-48fb-ba98-93a4be16cb8c req-04bd28a6-d1ce-49e6-b7f8-afad0d1cdb74 service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Refreshing instance network info cache due to event network-changed-f2f7670e-c9a1-437f-8143-4f7cfc60a035. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:38:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8ecbd762-5703-48fb-ba98-93a4be16cb8c req-04bd28a6-d1ce-49e6-b7f8-afad0d1cdb74 service nova] Acquiring lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8ecbd762-5703-48fb-ba98-93a4be16cb8c req-04bd28a6-d1ce-49e6-b7f8-afad0d1cdb74 service nova] Acquired lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:45 user nova-compute[73258]: DEBUG nova.network.neutron [req-8ecbd762-5703-48fb-ba98-93a4be16cb8c req-04bd28a6-d1ce-49e6-b7f8-afad0d1cdb74 service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Refreshing network info cache for port f2f7670e-c9a1-437f-8143-4f7cfc60a035 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:38:45 user nova-compute[73258]: DEBUG nova.network.neutron [req-e5ad8e3c-5ef0-4896-96a1-91fb03aaa2eb req-e1e08745-2ba4-49d0-ad8e-3ed3c5a38e7a service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Updated VIF entry in instance network info cache for port a345de09-b566-4d5c-8df6-5e706f31bc62. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:38:45 user nova-compute[73258]: DEBUG nova.network.neutron [req-e5ad8e3c-5ef0-4896-96a1-91fb03aaa2eb req-e1e08745-2ba4-49d0-ad8e-3ed3c5a38e7a service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Updating instance_info_cache with network_info: [{"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e5ad8e3c-5ef0-4896-96a1-91fb03aaa2eb req-e1e08745-2ba4-49d0-ad8e-3ed3c5a38e7a service nova] Releasing lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:46 user nova-compute[73258]: DEBUG nova.network.neutron [req-8ecbd762-5703-48fb-ba98-93a4be16cb8c req-04bd28a6-d1ce-49e6-b7f8-afad0d1cdb74 service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Updated VIF entry in instance network info cache for port f2f7670e-c9a1-437f-8143-4f7cfc60a035. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:38:46 user nova-compute[73258]: DEBUG nova.network.neutron [req-8ecbd762-5703-48fb-ba98-93a4be16cb8c req-04bd28a6-d1ce-49e6-b7f8-afad0d1cdb74 service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Updating instance_info_cache with network_info: [{"id": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "address": "fa:16:3e:82:0b:22", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f7670e-c9", "ovs_interfaceid": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8ecbd762-5703-48fb-ba98-93a4be16cb8c req-04bd28a6-d1ce-49e6-b7f8-afad0d1cdb74 service nova] Releasing lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:46 user nova-compute[73258]: DEBUG nova.network.neutron [req-5ee20090-6c09-4e3d-8862-c7304f390f27 req-748f3ec4-160d-47ee-be55-dc3e588e6eac service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updated VIF entry in instance network info cache for port e481124c-b62d-4fc9-9f02-ba38c027180e. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:38:46 user nova-compute[73258]: DEBUG nova.network.neutron [req-5ee20090-6c09-4e3d-8862-c7304f390f27 req-748f3ec4-160d-47ee-be55-dc3e588e6eac service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updating instance_info_cache with network_info: [{"id": "59275472-b18f-4e4b-922f-475dd553833c", "address": "fa:16:3e:05:21:15", "network": {"id": "5eaba2f5-e1ca-4a9b-8195-bc8798d89753", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-374547766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59275472-b1", "ovs_interfaceid": "59275472-b18f-4e4b-922f-475dd553833c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5820add-1974-4f6c-873e-ef179593b46a", "address": "fa:16:3e:b1:35:89", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5820add-19", "ovs_interfaceid": "e5820add-1974-4f6c-873e-ef179593b46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "address": "fa:16:3e:5a:25:32", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff33d225-ef", "ovs_interfaceid": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e481124c-b62d-4fc9-9f02-ba38c027180e", "address": "fa:16:3e:ef:7e:25", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape481124c-b6", "ovs_interfaceid": "e481124c-b62d-4fc9-9f02-ba38c027180e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0914d88d-1909-4bcb-a776-37af31e16b9e", "address": "fa:16:3e:a0:a3:84", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914d88d-19", "ovs_interfaceid": "0914d88d-1909-4bcb-a776-37af31e16b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e32a9d4d-57df-4765-b5be-12cea8621fce", "address": "fa:16:3e:10:c4:37", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32a9d4d-57", "ovs_interfaceid": "e32a9d4d-57df-4765-b5be-12cea8621fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "783f5103-a178-42e0-a3b0-f523ca4c9439", "address": "fa:16:3e:4d:78:05", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap783f5103-a1", "ovs_interfaceid": "783f5103-a178-42e0-a3b0-f523ca4c9439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5ee20090-6c09-4e3d-8862-c7304f390f27 req-748f3ec4-160d-47ee-be55-dc3e588e6eac service nova] Releasing lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8941e649-80ca-4108-ad44-a6442c6c28fc req-acebdc10-3e99-4e51-829f-d06af74b61b6 service nova] Acquired lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:46 user nova-compute[73258]: DEBUG nova.network.neutron [req-8941e649-80ca-4108-ad44-a6442c6c28fc req-acebdc10-3e99-4e51-829f-d06af74b61b6 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Refreshing network info cache for port 783f5103-a178-42e0-a3b0-f523ca4c9439 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:38:46 user nova-compute[73258]: DEBUG nova.network.neutron [req-8941e649-80ca-4108-ad44-a6442c6c28fc req-acebdc10-3e99-4e51-829f-d06af74b61b6 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updated VIF entry in instance network info cache for port 783f5103-a178-42e0-a3b0-f523ca4c9439. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:38:46 user nova-compute[73258]: DEBUG nova.network.neutron [req-8941e649-80ca-4108-ad44-a6442c6c28fc req-acebdc10-3e99-4e51-829f-d06af74b61b6 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updating instance_info_cache with network_info: [{"id": "59275472-b18f-4e4b-922f-475dd553833c", "address": "fa:16:3e:05:21:15", "network": {"id": "5eaba2f5-e1ca-4a9b-8195-bc8798d89753", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-374547766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59275472-b1", "ovs_interfaceid": "59275472-b18f-4e4b-922f-475dd553833c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5820add-1974-4f6c-873e-ef179593b46a", "address": "fa:16:3e:b1:35:89", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5820add-19", "ovs_interfaceid": "e5820add-1974-4f6c-873e-ef179593b46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "address": "fa:16:3e:5a:25:32", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff33d225-ef", "ovs_interfaceid": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e481124c-b62d-4fc9-9f02-ba38c027180e", "address": "fa:16:3e:ef:7e:25", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape481124c-b6", "ovs_interfaceid": "e481124c-b62d-4fc9-9f02-ba38c027180e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0914d88d-1909-4bcb-a776-37af31e16b9e", "address": "fa:16:3e:a0:a3:84", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914d88d-19", "ovs_interfaceid": "0914d88d-1909-4bcb-a776-37af31e16b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e32a9d4d-57df-4765-b5be-12cea8621fce", "address": "fa:16:3e:10:c4:37", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32a9d4d-57", "ovs_interfaceid": "e32a9d4d-57df-4765-b5be-12cea8621fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "783f5103-a178-42e0-a3b0-f523ca4c9439", "address": "fa:16:3e:4d:78:05", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap783f5103-a1", "ovs_interfaceid": "783f5103-a178-42e0-a3b0-f523ca4c9439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8941e649-80ca-4108-ad44-a6442c6c28fc req-acebdc10-3e99-4e51-829f-d06af74b61b6 service nova] Releasing lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG nova.compute.manager [req-3a1487f0-4090-49d2-8826-611e824c6cbc req-cb4274af-a114-4515-97d8-e24b69c409c3 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-changed-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG nova.compute.manager [req-3a1487f0-4090-49d2-8826-611e824c6cbc req-cb4274af-a114-4515-97d8-e24b69c409c3 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Refreshing instance network info cache due to event network-changed-a695f0b6-9494-4a0c-9bd1-853631b8d8f4. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3a1487f0-4090-49d2-8826-611e824c6cbc req-cb4274af-a114-4515-97d8-e24b69c409c3 service nova] Acquiring lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3a1487f0-4090-49d2-8826-611e824c6cbc req-cb4274af-a114-4515-97d8-e24b69c409c3 service nova] Acquired lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG nova.network.neutron [req-3a1487f0-4090-49d2-8826-611e824c6cbc req-cb4274af-a114-4515-97d8-e24b69c409c3 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Refreshing network info cache for port a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:38:47 user nova-compute[73258]: INFO nova.virt.block_device [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Booting with volume 0ee2716a-3f45-4dcb-90f8-b4119f23b318 at /dev/vdc
Aug 27 06:38:47 user nova-compute[73258]: DEBUG os_brick.utils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[578e851f-8b46-4620-97a8-112718ca4171]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f94686-355e-4aaa-9b37-cf91ab5e5d61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[26752139-fd8d-4b25-98b1-32b605f9375d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c7e6a8-844b-478f-b4f6-71a3e67fbecb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:38:47 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:38:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6b0e17-238a-477a-96fe-8d3d46aec324]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG os_brick.utils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Updating existing volume attachment record: bf129a75-87e2-4eba-821a-2c6564aafae7 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG nova.network.neutron [req-3a1487f0-4090-49d2-8826-611e824c6cbc req-cb4274af-a114-4515-97d8-e24b69c409c3 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Updated VIF entry in instance network info cache for port a695f0b6-9494-4a0c-9bd1-853631b8d8f4. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG nova.network.neutron [req-3a1487f0-4090-49d2-8826-611e824c6cbc req-cb4274af-a114-4515-97d8-e24b69c409c3 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Updating instance_info_cache with network_info: [{"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:38:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3a1487f0-4090-49d2-8826-611e824c6cbc req-cb4274af-a114-4515-97d8-e24b69c409c3 service nova] Releasing lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:38:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:48 user nova-compute[73258]: DEBUG nova.compute.manager [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:38:48 user nova-compute[73258]: INFO nova.compute.manager [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] instance snapshotting
Aug 27 06:38:48 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Beginning live snapshot process
Aug 27 06:38:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json -f qcow2 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json -f qcow2 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.172s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplqxl_bob/7d64d0a164d24077911b17471408fcce.delta 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplqxl_bob/7d64d0a164d24077911b17471408fcce.delta 1073741824" returned: 0 in 0.057s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:49 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 27 06:38:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73258) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 27 06:38:49 user nova-compute[73258]: INFO nova.virt.libvirt.host [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] UEFI support detected
Aug 27 06:38:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:38:50 user nova-compute[73258]: INFO nova.virt.block_device [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Booting with volume 4212a9b2-2bd0-431f-8257-85a3d0bc9a53 at /dev/vdc
Aug 27 06:38:50 user nova-compute[73258]: DEBUG os_brick.utils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d443665e-badb-4f8b-9611-7f2144f10223]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebf63df-702f-4aae-b9da-559427f96dd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efb24e2-713e-4bc6-bdde-334fe87d3393]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d92df95-2bc7-404f-a0dd-7b04afc0e009]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:38:50 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:38:50 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[58be22e9-99d1-42a9-a21e-702a9536e48f]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG os_brick.utils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updating existing volume attachment record: cd71313e-69b1-4f85-b875-3c4e9abd4d33 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:38:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] COPY block job progress, current cursor: 26673152 final cursor: 75497472 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:38:51 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:38:51 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 06:38:51 user nova-compute[73258]: DEBUG nova.privsep.utils [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 06:38:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplqxl_bob/7d64d0a164d24077911b17471408fcce.delta /opt/stack/data/nova/instances/snapshots/tmplqxl_bob/7d64d0a164d24077911b17471408fcce {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplqxl_bob/7d64d0a164d24077911b17471408fcce.delta /opt/stack/data/nova/instances/snapshots/tmplqxl_bob/7d64d0a164d24077911b17471408fcce" returned: 0 in 0.680s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:52 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Snapshot extracted, beginning image upload
Aug 27 06:38:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEeyaovH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:38:52 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:38:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:38:52 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:38:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:38:52 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e68fd6a-0281-48b4-8dde-0cf6cce8490c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:38:52 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbf4a7a-f910-4748-ba74-87d9aa3ba5fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b] added
Aug 27 06:38:52 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[964893a2-d599-4d65-a4a7-e4f0708ab7ea]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4da5a40-b4ea-4dfd-b392-f5abd3bf3689]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEeyaovH {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEeyaovH" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ca3678-87da-462d-85e7-d889529d2786]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JEeyaovH'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be7df05-d803-473b-ac96-a023de72fb58]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:38:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61a6182-0b1a-421a-be18-8dc0b46946e6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:38:53 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:38:53 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c14af5d-5223-4b40-8e99-2d4edb43f483]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b, portal: 172.16.0.220,3260]
Aug 27 06:38:53 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b, portal: 172.16.0.220,3260] successful.
Aug 27 06:38:53 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG nova.objects.instance [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lazy-loading 'flavor' on Instance uuid e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[add33eb5-4ade-4d49-b623-84bb0571b74d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9848d04-08de-4f7a-9124-87b3d0a4747c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:38:53 user nova-compute[73258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b (non-flash)
Aug 27 06:38:53 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:38:53 user nova-compute[73258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b (non-flash)
Aug 27 06:38:53 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[86676d0b-05f7-498d-8077-3f182a5bca66]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEeyaovH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:38:53 user nova-compute[73258]: INFO nova.compute.manager [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Attaching volume ade6b05b-3bdd-4a39-8413-91c6e4394127 to /dev/vdb
Aug 27 06:38:53 user nova-compute[73258]: DEBUG os_brick.utils [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdc8900-8758-45d1-8df2-8ff1885a9a76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c324bf1-26dd-4413-afe6-6ee80516ad64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1934548-f6fe-4c76-bf51-afa6805e5070]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b64c5fe-3532-4b60-a38a-cb315f3e589c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:38:53 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:38:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[11aa9a9a-001b-476d-8224-d4b3089b6fa7]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG os_brick.utils [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Updating existing volume attachment record: c8406d1c-b3a5-43af-9fc9-f302c3eb04f9 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:38:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:38:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26461363737653563', 'path': '/dev/sdc'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:38:54 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461363737653563', 'path': '/dev/sdc'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:38:54 user nova-compute[73258]: DEBUG nova.objects.instance [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lazy-loading 'flavor' on Instance uuid bb57b63c-888f-40a0-88c0-97f63fd8297f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:38:54 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:38:54 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:38:54 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 06:38:54 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:38:54 user nova-compute[73258]:   <serial>9b8cad13-f88c-4976-86a6-1ceda173159b</serial>
Aug 27 06:38:54 user nova-compute[73258]: </disk>
Aug 27 06:38:54 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:38:54 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:38:54 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:38:54 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] No VIF found with MAC fa:16:3e:78:b4:e4, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:38:54 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Snapshot image upload complete
Aug 27 06:38:54 user nova-compute[73258]: INFO nova.compute.manager [None req-559e55d2-0175-4540-931e-e4d1939a289f tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Took 6.28 seconds to snapshot the instance on the hypervisor.
Aug 27 06:38:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:38:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c87daf2a-e157-4a44-a360-1fd76277d1cb tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "bb57b63c-888f-40a0-88c0-97f63fd8297f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.762s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:39:00 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Creating image(s)
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Did not create local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Ensure instance console log exists: /opt/stack/data/nova/instances/d7b11762-9244-481b-87dd-757782d68101/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Start _get_guest_xml network_info=[{"id": "933454ca-76f3-4f90-aab9-14e915a58487", "address": "fa:16:3e:41:30:a9", "network": {"id": "a2ca5db5-8c6d-44d0-acf5-c46a564a0247", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058086289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933454ca-76", "ovs_interfaceid": "933454ca-76f3-4f90-aab9-14e915a58487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "address": "fa:16:3e:34:10:b5", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2f38b2-1d", "ovs_interfaceid": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f0370f5d-defe-48bd-b320-47db121211e2", "address": "fa:16:3e:f6:03:41", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0370f5d-de", "ovs_interfaceid": "f0370f5d-defe-48bd-b320-47db121211e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "384e3fbf-506e-42cb-8050-e05c2ee95749", "address": "fa:16:3e:4d:cd:a0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384e3fbf-50", "ovs_interfaceid": "384e3fbf-506e-42cb-8050-e05c2ee95749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e184532a-df10-431e-9ef2-c3a595e56b5d", "address": "fa:16:3e:a6:7a:e0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184532a-df", "ovs_interfaceid": "e184532a-df10-431e-9ef2-c3a595e56b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87427dc4-15ba-4179-999a-217c5eef5fd3", "address": "fa:16:3e:41:44:fc", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87427dc4-15", "ovs_interfaceid": "87427dc4-15ba-4179-999a-217c5eef5fd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "address": "fa:16:3e:ca:07:e5", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9688c75d-c1", "ovs_interfaceid": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfioIUzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd7b11762-9244-481b-87dd-757782d68101', 'attached_at': '', 'detached_at': '', 'volume_id': '82843900-e694-4189-a8db-9c5fc3f8701e', 'serial': '82843900-e694-4189-a8db-9c5fc3f8701e'}, 'attachment_id': '204a5c6d-f887-451a-b354-529ace261407', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWHXCOAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd7b11762-9244-481b-87dd-757782d68101', 'attached_at': '', 'detached_at': '', 'volume_id': 'bd8029df-68c8-405f-8347-12cb0137e424', 'serial': 'bd8029df-68c8-405f-8347-12cb0137e424'}, 'attachment_id': 'a3dbf675-e0b2-4f69-b524-2df48569332d', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 1, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EChVXTMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd7b11762-9244-481b-87dd-757782d68101', 'attached_at': '', 'detached_at': '', 'volume_id': '0ee2716a-3f45-4dcb-90f8-b4119f23b318', 'serial': '0ee2716a-3f45-4dcb-90f8-b4119f23b318'}, 'attachment_id': 'bf129a75-87e2-4eba-821a-2c6564aafae7', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 2, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:39:00 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:39:00 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfioIUzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:00 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:00 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:00 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:39:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b5e401-90e5-4223-8c9f-4f0add763dca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:39:00 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeff1fd7-4039-4ec4-8d3c-fdd04b6b0a8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e] added
Aug 27 06:39:00 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf43d5b-8973-472d-99d6-26dcd05663c3]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc6d3bd-c591-4127-8876-d040cee9e345]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfioIUzb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfioIUzb" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e200ecd-db82-46c4-bf43-e46c77eef537]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wfioIUzb'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f40498d-301e-4463-8bcf-33df82a9b9ec]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e80533c-ba4c-4f69-981d-cd5c5ee41878]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:01 user nova-compute[73258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b (non-flash)
Aug 27 06:39:01 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:01 user nova-compute[73258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b (non-flash)
Aug 27 06:39:01 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf6c745-2025-4b80-b218-6192255e2bec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e, portal: 172.16.0.220,3260]
Aug 27 06:39:01 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e, portal: 172.16.0.220,3260] successful.
Aug 27 06:39:01 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.106s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56a0d00-efe9-401e-9f24-98986a169bea]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32e0c5d-a5f4-4a85-ad59-441e4d07050a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:01 user nova-compute[73258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b (non-flash)
Aug 27 06:39:01 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:01 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:01 user nova-compute[73258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b (non-flash)
Aug 27 06:39:01 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:01 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95c11c4-d195-4881-8d7e-aa3a2018e908]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfioIUzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Acquiring lock "bb57b63c-888f-40a0-88c0-97f63fd8297f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "bb57b63c-888f-40a0-88c0-97f63fd8297f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Acquiring lock "bb57b63c-888f-40a0-88c0-97f63fd8297f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "bb57b63c-888f-40a0-88c0-97f63fd8297f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "bb57b63c-888f-40a0-88c0-97f63fd8297f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:01 user nova-compute[73258]: INFO nova.compute.manager [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Terminating instance
Aug 27 06:39:01 user nova-compute[73258]: DEBUG nova.compute.manager [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:02 user nova-compute[73258]: INFO nova.compute.manager [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Shelving
Aug 27 06:39:02 user nova-compute[73258]: DEBUG nova.compute.manager [req-9357892f-804d-4082-904a-0c1458a47ab5 req-bb31cac1-1a60-43f2-b5cd-c488a98b16de service nova] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Received event network-vif-unplugged-1b826212-ad3e-49a6-a97d-7b4f0c7f5830 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9357892f-804d-4082-904a-0c1458a47ab5 req-bb31cac1-1a60-43f2-b5cd-c488a98b16de service nova] Acquiring lock "bb57b63c-888f-40a0-88c0-97f63fd8297f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9357892f-804d-4082-904a-0c1458a47ab5 req-bb31cac1-1a60-43f2-b5cd-c488a98b16de service nova] Lock "bb57b63c-888f-40a0-88c0-97f63fd8297f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9357892f-804d-4082-904a-0c1458a47ab5 req-bb31cac1-1a60-43f2-b5cd-c488a98b16de service nova] Lock "bb57b63c-888f-40a0-88c0-97f63fd8297f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG nova.compute.manager [req-9357892f-804d-4082-904a-0c1458a47ab5 req-bb31cac1-1a60-43f2-b5cd-c488a98b16de service nova] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] No waiting events found dispatching network-vif-unplugged-1b826212-ad3e-49a6-a97d-7b4f0c7f5830 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG nova.compute.manager [req-9357892f-804d-4082-904a-0c1458a47ab5 req-bb31cac1-1a60-43f2-b5cd-c488a98b16de service nova] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Received event network-vif-unplugged-1b826212-ad3e-49a6-a97d-7b4f0c7f5830 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23862366637383536', 'path': '/dev/sdd'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862366637383536', 'path': '/dev/sdd'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWHXCOAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:02 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:02 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:02 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[168b0b69-47a8-45c8-b385-689b5e0f366d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:39:02 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d42fd85-0eed-443c-a05c-36c8555b6a8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424] added
Aug 27 06:39:02 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cc17f6-313f-4cec-90f2-3bc16a46061b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[01886a8c-df8a-4f83-9b57-8c48ab998dce]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hWHXCOAa {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hWHXCOAa" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca2c24d-c607-40a4-8591-fab2667031b3]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hWHXCOAa'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48f6d23-0cd2-4ca9-a14b-264f3fffd457]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd21912-0039-475f-b205-71405cad8fb6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:02 user nova-compute[73258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b (non-flash)
Aug 27 06:39:02 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:02 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:02 user nova-compute[73258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b (non-flash)
Aug 27 06:39:02 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:02 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG nova.compute.manager [req-86a72251-058c-46e1-a0ac-39946462398e req-fd25117a-5072-41ec-94b7-5a25d1447ca4 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received event network-vif-unplugged-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-86a72251-058c-46e1-a0ac-39946462398e req-fd25117a-5072-41ec-94b7-5a25d1447ca4 service nova] Acquiring lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-86a72251-058c-46e1-a0ac-39946462398e req-fd25117a-5072-41ec-94b7-5a25d1447ca4 service nova] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-86a72251-058c-46e1-a0ac-39946462398e req-fd25117a-5072-41ec-94b7-5a25d1447ca4 service nova] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG nova.compute.manager [req-86a72251-058c-46e1-a0ac-39946462398e req-fd25117a-5072-41ec-94b7-5a25d1447ca4 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] No waiting events found dispatching network-vif-unplugged-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:02 user nova-compute[73258]: WARNING nova.compute.manager [req-86a72251-058c-46e1-a0ac-39946462398e req-fd25117a-5072-41ec-94b7-5a25d1447ca4 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received unexpected event network-vif-unplugged-a345de09-b566-4d5c-8df6-5e706f31bc62 for instance with vm_state active and task_state shelving.
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b764e69-b517-417f-ac14-f8fc606f88d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424, portal: 172.16.0.220,3260]
Aug 27 06:39:02 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424, portal: 172.16.0.220,3260] successful.
Aug 27 06:39:02 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e444822-fdba-4394-9d10-49432caeb26e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[297909fc-c6e0-467e-be55-12299b647f7c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:02 user nova-compute[73258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b (non-flash)
Aug 27 06:39:02 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:02 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:02 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:02 user nova-compute[73258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b (non-flash)
Aug 27 06:39:02 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:02 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:02 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b8a901-b799-4d12-a161-5718d72fed57]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWHXCOAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:02 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Instance destroyed successfully.
Aug 27 06:39:02 user nova-compute[73258]: DEBUG nova.objects.instance [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lazy-loading 'resources' on Instance uuid bb57b63c-888f-40a0-88c0-97f63fd8297f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:36:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-919904346',display_name='tempest-DeleteServersTestJSON-server-919904346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-919904346',id=1,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:37:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25e4e2704bd54e42a2ef6798115ae8dd',ramdisk_id='',reservation_id='r-71csclza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1135220088',owner_user_name='tempest-DeleteServersTestJSON-1135220088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:37:03Z,user_data=None,user_id='dcfbf648e8db4ea0abd192e7b03c369d',uuid=bb57b63c-888f-40a0-88c0-97f63fd8297f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "address": "fa:16:3e:78:b4:e4", "network": {"id": "17e248c2-cdb2-407a-9707-690809f91d19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-577762610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25e4e2704bd54e42a2ef6798115ae8dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b826212-ad", "ovs_interfaceid": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Converting VIF {"id": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "address": "fa:16:3e:78:b4:e4", "network": {"id": "17e248c2-cdb2-407a-9707-690809f91d19", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-577762610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25e4e2704bd54e42a2ef6798115ae8dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b826212-ad", "ovs_interfaceid": "1b826212-ad3e-49a6-a97d-7b4f0c7f5830", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:b4:e4,bridge_name='br-int',has_traffic_filtering=True,id=1b826212-ad3e-49a6-a97d-7b4f0c7f5830,network=Network(17e248c2-cdb2-407a-9707-690809f91d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b826212-ad') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_vif [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:b4:e4,bridge_name='br-int',has_traffic_filtering=True,id=1b826212-ad3e-49a6-a97d-7b4f0c7f5830,network=Network(17e248c2-cdb2-407a-9707-690809f91d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b826212-ad') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b826212-ad, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:02 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Instance destroyed successfully.
Aug 27 06:39:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:02 user nova-compute[73258]: INFO os_vif [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:b4:e4,bridge_name='br-int',has_traffic_filtering=True,id=1b826212-ad3e-49a6-a97d-7b4f0c7f5830,network=Network(17e248c2-cdb2-407a-9707-690809f91d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b826212-ad')
Aug 27 06:39:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEeyaovH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:02 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:03 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Beginning cold snapshot process
Aug 27 06:39:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG nova.privsep.utils [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk /opt/stack/data/nova/instances/snapshots/tmptyd8kvoz/11bb33ea55b043708400288dad52f837 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23239373861646239', 'path': '/dev/sde'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239373861646239', 'path': '/dev/sde'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.684s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde7903c-7f9e-4a7b-8edc-8cfa72242cff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EChVXTMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:03 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b94775d-044d-4b65-a053-1c0a93855da0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:03 user nova-compute[73258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b (non-flash)
Aug 27 06:39:03 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:03 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:03 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:03 user nova-compute[73258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b (non-flash)
Aug 27 06:39:03 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:03 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:03 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa430347130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b'): ({'sdc'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Removing single pathed devices sdc {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[43129ee7-73a8-405e-b56f-5702904fc333]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[81706b14-ca19-4402-adb6-09796cb5c2b9]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Flushing IO for device /dev/sdc {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a22def2-3bdc-4e15-8fda-d979fc1faf8c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5101e0e-44a2-40ef-bef6-db97396d2619]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1b77c6-62f6-4ac2-8c42-710a43f856ce]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[df774b8f-a214-4012-9a26-fec05eef77c4]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b, portal: 172.16.0.220,3260]
Aug 27 06:39:03 user nova-compute[73258]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b, portal: 172.16.0.220,3260] successful.
Aug 27 06:39:03 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b8cad13-f88c-4976-86a6-1ceda173159b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7eab2e-469e-43ec-b985-ed8a9758433a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] <== disconnect_volume: return (986ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:39:03 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Deleting instance files /opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f_del
Aug 27 06:39:03 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Deletion of /opt/stack/data/nova/instances/bb57b63c-888f-40a0-88c0-97f63fd8297f_del complete
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.260s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:03 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:03 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:39:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6b3ffd-815e-4851-88e5-d65307b8767c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:39:04 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45d9873-ddcd-4400-9115-cc4282262a48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318] added
Aug 27 06:39:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:04 user nova-compute[73258]: INFO nova.compute.manager [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Took 2.22 seconds to destroy the instance on the hypervisor.
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[34eeabd3-6f96-4613-bef1-37d5bcd6572f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk /opt/stack/data/nova/instances/snapshots/tmptyd8kvoz/11bb33ea55b043708400288dad52f837" returned: 0 in 1.368s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.compute.manager [req-955ccb99-aac3-45e1-999b-90d9af05e496 req-df87873a-466f-4123-93e6-38445cb88f19 service nova] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Received event network-vif-plugged-1b826212-ad3e-49a6-a97d-7b4f0c7f5830 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-955ccb99-aac3-45e1-999b-90d9af05e496 req-df87873a-466f-4123-93e6-38445cb88f19 service nova] Acquiring lock "bb57b63c-888f-40a0-88c0-97f63fd8297f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-955ccb99-aac3-45e1-999b-90d9af05e496 req-df87873a-466f-4123-93e6-38445cb88f19 service nova] Lock "bb57b63c-888f-40a0-88c0-97f63fd8297f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-955ccb99-aac3-45e1-999b-90d9af05e496 req-df87873a-466f-4123-93e6-38445cb88f19 service nova] Lock "bb57b63c-888f-40a0-88c0-97f63fd8297f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.compute.manager [req-955ccb99-aac3-45e1-999b-90d9af05e496 req-df87873a-466f-4123-93e6-38445cb88f19 service nova] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] No waiting events found dispatching network-vif-plugged-1b826212-ad3e-49a6-a97d-7b4f0c7f5830 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:04 user nova-compute[73258]: WARNING nova.compute.manager [req-955ccb99-aac3-45e1-999b-90d9af05e496 req-df87873a-466f-4123-93e6-38445cb88f19 service nova] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Received unexpected event network-vif-plugged-1b826212-ad3e-49a6-a97d-7b4f0c7f5830 for instance with vm_state active and task_state deleting.
Aug 27 06:39:04 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Snapshot extracted, beginning image upload
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.compute.manager [req-a80bf2da-e6e9-468c-bb25-4aa5fefe4fed req-ef307dfb-5566-4828-8bb9-902c42f9ce6c service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received event network-vif-plugged-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a80bf2da-e6e9-468c-bb25-4aa5fefe4fed req-ef307dfb-5566-4828-8bb9-902c42f9ce6c service nova] Acquiring lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a80bf2da-e6e9-468c-bb25-4aa5fefe4fed req-ef307dfb-5566-4828-8bb9-902c42f9ce6c service nova] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a80bf2da-e6e9-468c-bb25-4aa5fefe4fed req-ef307dfb-5566-4828-8bb9-902c42f9ce6c service nova] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.compute.manager [req-a80bf2da-e6e9-468c-bb25-4aa5fefe4fed req-ef307dfb-5566-4828-8bb9-902c42f9ce6c service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] No waiting events found dispatching network-vif-plugged-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:04 user nova-compute[73258]: WARNING nova.compute.manager [req-a80bf2da-e6e9-468c-bb25-4aa5fefe4fed req-ef307dfb-5566-4828-8bb9-902c42f9ce6c service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received unexpected event network-vif-plugged-a345de09-b566-4d5c-8df6-5e706f31bc62 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5e0b08-9a41-40b2-a3ad-1fc94ebe5913]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EChVXTMP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EChVXTMP" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cff804-ccaa-43a5-9fe9-1807e2b48ba6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EChVXTMP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ccfc34-b3c9-42fe-a858-2697d1b72d73]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b88fa1a-f35b-432d-ab6a-8685a6c2c8b4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:04 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:04 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:04 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:04 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:39:04 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Creating image(s)
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Did not create local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Ensure instance console log exists: /opt/stack/data/nova/instances/32d3fdfc-82ad-46ee-b673-4e73f43b85e7/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Start _get_guest_xml network_info=[{"id": "59275472-b18f-4e4b-922f-475dd553833c", "address": "fa:16:3e:05:21:15", "network": {"id": "5eaba2f5-e1ca-4a9b-8195-bc8798d89753", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-374547766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59275472-b1", "ovs_interfaceid": "59275472-b18f-4e4b-922f-475dd553833c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5820add-1974-4f6c-873e-ef179593b46a", "address": "fa:16:3e:b1:35:89", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5820add-19", "ovs_interfaceid": "e5820add-1974-4f6c-873e-ef179593b46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "address": "fa:16:3e:5a:25:32", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff33d225-ef", "ovs_interfaceid": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e481124c-b62d-4fc9-9f02-ba38c027180e", "address": "fa:16:3e:ef:7e:25", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape481124c-b6", "ovs_interfaceid": "e481124c-b62d-4fc9-9f02-ba38c027180e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0914d88d-1909-4bcb-a776-37af31e16b9e", "address": "fa:16:3e:a0:a3:84", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914d88d-19", "ovs_interfaceid": "0914d88d-1909-4bcb-a776-37af31e16b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e32a9d4d-57df-4765-b5be-12cea8621fce", "address": "fa:16:3e:10:c4:37", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32a9d4d-57", "ovs_interfaceid": "e32a9d4d-57df-4765-b5be-12cea8621fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "783f5103-a178-42e0-a3b0-f523ca4c9439", "address": "fa:16:3e:4d:78:05", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap783f5103-a1", "ovs_interfaceid": "783f5103-a178-42e0-a3b0-f523ca4c9439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxRcghvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '32d3fdfc-82ad-46ee-b673-4e73f43b85e7', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4341dc1-1685-44f0-b29f-5212dba42abd', 'serial': 'f4341dc1-1685-44f0-b29f-5212dba42abd'}, 'attachment_id': 'f78f2337-eb19-4c3d-ba7a-1e976c81d9d1', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NPfkTEFV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '32d3fdfc-82ad-46ee-b673-4e73f43b85e7', 'attached_at': '', 'detached_at': '', 'volume_id': 'bfea6f05-84f2-4b48-9460-5da143c24c4d', 'serial': 'bfea6f05-84f2-4b48-9460-5da143c24c4d'}, 'attachment_id': 'fe513a38-673f-44ab-b2da-d4867344e9c6', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 1, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLazsToF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '32d3fdfc-82ad-46ee-b673-4e73f43b85e7', 'attached_at': '', 'detached_at': '', 'volume_id': '4212a9b2-2bd0-431f-8257-85a3d0bc9a53', 'serial': '4212a9b2-2bd0-431f-8257-85a3d0bc9a53'}, 'attachment_id': 'cd71313e-69b1-4f85-b875-3c4e9abd4d33', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 2, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae7825b-c712-4a01-ac7e-95522cb16bb7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318, portal: 172.16.0.220,3260]
Aug 27 06:39:04 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318, portal: 172.16.0.220,3260] successful.
Aug 27 06:39:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:04 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:39:04 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxRcghvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:04 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[16775807-d2ab-43df-a542-f9d1a406de03]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[45741c1c-25da-42fc-8297-d9d49f32a669]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:04 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:04 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:04 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:04 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:04 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:04 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.857s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] HCTL ('34', '-', '-', 0) found on session 6 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4d1306-34f6-4700-93e3-5d6872cfd557]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Searching for a device in session 6 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:39:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EChVXTMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:39:05 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Took 1.20 seconds to deallocate network for instance.
Aug 27 06:39:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.890s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] <== connect_volume: return (2150ms) {'type': 'block', 'scsi_wwn': '23634323365633064', 'path': '/dev/sdc'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634323365633064', 'path': '/dev/sdc'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.063s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:05 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:05 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:39:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60edeeb-2791-461f-bfd3-86b2740384e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:39:05 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "933454ca-76f3-4f90-aab9-14e915a58487", "address": "fa:16:3e:41:30:a9", "network": {"id": "a2ca5db5-8c6d-44d0-acf5-c46a564a0247", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058086289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933454ca-76", "ovs_interfaceid": "933454ca-76f3-4f90-aab9-14e915a58487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "933454ca-76f3-4f90-aab9-14e915a58487", "address": "fa:16:3e:41:30:a9", "network": {"id": "a2ca5db5-8c6d-44d0-acf5-c46a564a0247", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058086289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933454ca-76", "ovs_interfaceid": "933454ca-76f3-4f90-aab9-14e915a58487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:30:a9,bridge_name='br-int',has_traffic_filtering=True,id=933454ca-76f3-4f90-aab9-14e915a58487,network=Network(a2ca5db5-8c6d-44d0-acf5-c46a564a0247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933454ca-76') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "address": "fa:16:3e:34:10:b5", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2f38b2-1d", "ovs_interfaceid": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "address": "fa:16:3e:34:10:b5", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2f38b2-1d", "ovs_interfaceid": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:10:b5,bridge_name='br-int',has_traffic_filtering=True,id=5c2f38b2-1d02-4e50-bc89-a2fa523fc408,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5c2f38b2-1d') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0370f5d-defe-48bd-b320-47db121211e2", "address": "fa:16:3e:f6:03:41", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0370f5d-de", "ovs_interfaceid": "f0370f5d-defe-48bd-b320-47db121211e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "f0370f5d-defe-48bd-b320-47db121211e2", "address": "fa:16:3e:f6:03:41", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0370f5d-de", "ovs_interfaceid": "f0370f5d-defe-48bd-b320-47db121211e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:03:41,bridge_name='br-int',has_traffic_filtering=True,id=f0370f5d-defe-48bd-b320-47db121211e2,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0370f5d-de') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "384e3fbf-506e-42cb-8050-e05c2ee95749", "address": "fa:16:3e:4d:cd:a0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384e3fbf-50", "ovs_interfaceid": "384e3fbf-506e-42cb-8050-e05c2ee95749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "384e3fbf-506e-42cb-8050-e05c2ee95749", "address": "fa:16:3e:4d:cd:a0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384e3fbf-50", "ovs_interfaceid": "384e3fbf-506e-42cb-8050-e05c2ee95749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:cd:a0,bridge_name='br-int',has_traffic_filtering=True,id=384e3fbf-506e-42cb-8050-e05c2ee95749,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384e3fbf-50') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e184532a-df10-431e-9ef2-c3a595e56b5d", "address": "fa:16:3e:a6:7a:e0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184532a-df", "ovs_interfaceid": "e184532a-df10-431e-9ef2-c3a595e56b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "e184532a-df10-431e-9ef2-c3a595e56b5d", "address": "fa:16:3e:a6:7a:e0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184532a-df", "ovs_interfaceid": "e184532a-df10-431e-9ef2-c3a595e56b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7a:e0,bridge_name='br-int',has_traffic_filtering=True,id=e184532a-df10-431e-9ef2-c3a595e56b5d,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape184532a-df') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87427dc4-15ba-4179-999a-217c5eef5fd3", "address": "fa:16:3e:41:44:fc", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87427dc4-15", "ovs_interfaceid": "87427dc4-15ba-4179-999a-217c5eef5fd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "87427dc4-15ba-4179-999a-217c5eef5fd3", "address": "fa:16:3e:41:44:fc", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87427dc4-15", "ovs_interfaceid": "87427dc4-15ba-4179-999a-217c5eef5fd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:44:fc,bridge_name='br-int',has_traffic_filtering=True,id=87427dc4-15ba-4179-999a-217c5eef5fd3,network=Network(0e81e535-2163-479d-beb5-a099d4366ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87427dc4-15') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "address": "fa:16:3e:ca:07:e5", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9688c75d-c1", "ovs_interfaceid": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "address": "fa:16:3e:ca:07:e5", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9688c75d-c1", "ovs_interfaceid": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:07:e5,bridge_name='br-int',has_traffic_filtering=True,id=9688c75d-c1a5-4bab-aa92-e1e3eed530bd,network=Network(0e81e535-2163-479d-beb5-a099d4366ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9688c75d-c1') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.objects.instance [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lazy-loading 'pci_devices' on Instance uuid d7b11762-9244-481b-87dd-757782d68101 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9253e51a-fc51-469a-9e82-74f8a714cb37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd] added
Aug 27 06:39:05 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:39:05 user nova-compute[73258]:   <uuid>d7b11762-9244-481b-87dd-757782d68101</uuid>
Aug 27 06:39:05 user nova-compute[73258]:   <name>instance-0000000b</name>
Aug 27 06:39:05 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:39:05 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:39:05 user nova-compute[73258]:   <metadata>
Aug 27 06:39:05 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:39:05 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:39:05 user nova-compute[73258]:       <nova:name>tempest-device-tagging-server-92854641</nova:name>
Aug 27 06:39:05 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:39:00</nova:creationTime>
Aug 27 06:39:05 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:39:05 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:39:05 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:39:05 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:39:05 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:39:05 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:39:05 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:39:05 user nova-compute[73258]:       <nova:owner>
Aug 27 06:39:05 user nova-compute[73258]:         <nova:user uuid="43938d8b904147cb993c722199ff8ebb">tempest-TaggedBootDevicesTest_v242-1736258197-project-member</nova:user>
Aug 27 06:39:05 user nova-compute[73258]:         <nova:project uuid="cfc65880fbec492095249cbc8765656a">tempest-TaggedBootDevicesTest_v242-1736258197</nova:project>
Aug 27 06:39:05 user nova-compute[73258]:       </nova:owner>
Aug 27 06:39:05 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:39:05 user nova-compute[73258]:       <nova:ports>
Aug 27 06:39:05 user nova-compute[73258]:         <nova:port uuid="933454ca-76f3-4f90-aab9-14e915a58487">
Aug 27 06:39:05 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 06:39:05 user nova-compute[73258]:         </nova:port>
Aug 27 06:39:05 user nova-compute[73258]:         <nova:port uuid="5c2f38b2-1d02-4e50-bc89-a2fa523fc408">
Aug 27 06:39:05 user nova-compute[73258]:           <nova:ip type="fixed" address="10.1.1.85" ipVersion="4"/>
Aug 27 06:39:05 user nova-compute[73258]:         </nova:port>
Aug 27 06:39:05 user nova-compute[73258]:         <nova:port uuid="f0370f5d-defe-48bd-b320-47db121211e2">
Aug 27 06:39:05 user nova-compute[73258]:           <nova:ip type="fixed" address="10.1.1.60" ipVersion="4"/>
Aug 27 06:39:05 user nova-compute[73258]:         </nova:port>
Aug 27 06:39:05 user nova-compute[73258]:         <nova:port uuid="384e3fbf-506e-42cb-8050-e05c2ee95749">
Aug 27 06:39:05 user nova-compute[73258]:           <nova:ip type="fixed" address="10.1.1.93" ipVersion="4"/>
Aug 27 06:39:05 user nova-compute[73258]:         </nova:port>
Aug 27 06:39:05 user nova-compute[73258]:         <nova:port uuid="e184532a-df10-431e-9ef2-c3a595e56b5d">
Aug 27 06:39:05 user nova-compute[73258]:           <nova:ip type="fixed" address="10.1.1.179" ipVersion="4"/>
Aug 27 06:39:05 user nova-compute[73258]:         </nova:port>
Aug 27 06:39:05 user nova-compute[73258]:         <nova:port uuid="87427dc4-15ba-4179-999a-217c5eef5fd3">
Aug 27 06:39:05 user nova-compute[73258]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 27 06:39:05 user nova-compute[73258]:         </nova:port>
Aug 27 06:39:05 user nova-compute[73258]:         <nova:port uuid="9688c75d-c1a5-4bab-aa92-e1e3eed530bd">
Aug 27 06:39:05 user nova-compute[73258]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 27 06:39:05 user nova-compute[73258]:         </nova:port>
Aug 27 06:39:05 user nova-compute[73258]:       </nova:ports>
Aug 27 06:39:05 user nova-compute[73258]:     </nova:instance>
Aug 27 06:39:05 user nova-compute[73258]:   </metadata>
Aug 27 06:39:05 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:39:05 user nova-compute[73258]:     <system>
Aug 27 06:39:05 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:39:05 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:39:05 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:39:05 user nova-compute[73258]:       <entry name="serial">d7b11762-9244-481b-87dd-757782d68101</entry>
Aug 27 06:39:05 user nova-compute[73258]:       <entry name="uuid">d7b11762-9244-481b-87dd-757782d68101</entry>
Aug 27 06:39:05 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:39:05 user nova-compute[73258]:     </system>
Aug 27 06:39:05 user nova-compute[73258]:   </sysinfo>
Aug 27 06:39:05 user nova-compute[73258]:   <os>
Aug 27 06:39:05 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:39:05 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:39:05 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:39:05 user nova-compute[73258]:   </os>
Aug 27 06:39:05 user nova-compute[73258]:   <features>
Aug 27 06:39:05 user nova-compute[73258]:     <acpi/>
Aug 27 06:39:05 user nova-compute[73258]:     <apic/>
Aug 27 06:39:05 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:39:05 user nova-compute[73258]:   </features>
Aug 27 06:39:05 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:39:05 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:39:05 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:39:05 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:39:05 user nova-compute[73258]:   </clock>
Aug 27 06:39:05 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:39:05 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:39:05 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:39:05 user nova-compute[73258]:   </cpu>
Aug 27 06:39:05 user nova-compute[73258]:   <devices>
Aug 27 06:39:05 user nova-compute[73258]:     <disk type="file" device="cdrom">
Aug 27 06:39:05 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 06:39:05 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/d7b11762-9244-481b-87dd-757782d68101/disk.config"/>
Aug 27 06:39:05 user nova-compute[73258]:       <target dev="hda" bus="ide"/>
Aug 27 06:39:05 user nova-compute[73258]:     </disk>
Aug 27 06:39:05 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:39:05 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:39:05 user nova-compute[73258]:       <source dev="/dev/sdd"/>
Aug 27 06:39:05 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:39:05 user nova-compute[73258]:       <serial>82843900-e694-4189-a8db-9c5fc3f8701e</serial>
Aug 27 06:39:05 user nova-compute[73258]:     </disk>
Aug 27 06:39:05 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:39:05 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:39:05 user nova-compute[73258]:       <source dev="/dev/sde"/>
Aug 27 06:39:05 user nova-compute[73258]:       <target dev="vdb" bus="virtio"/>
Aug 27 06:39:05 user nova-compute[73258]:       <serial>bd8029df-68c8-405f-8347-12cb0137e424</serial>
Aug 27 06:39:05 user nova-compute[73258]:     </disk>
Aug 27 06:39:05 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:39:05 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:39:05 user nova-compute[73258]:       <source dev="/dev/sdc"/>
Aug 27 06:39:05 user nova-compute[73258]:       <target dev="vdc" bus="virtio"/>
Aug 27 06:39:05 user nova-compute[73258]:       <serial>0ee2716a-3f45-4dcb-90f8-b4119f23b318</serial>
Aug 27 06:39:05 user nova-compute[73258]:     </disk>
Aug 27 06:39:05 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:39:05 user nova-compute[73258]:       <mac address="fa:16:3e:41:30:a9"/>
Aug 27 06:39:05 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:39:05 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:39:05 user nova-compute[73258]:       <target dev="tap933454ca-76"/>
Aug 27 06:39:05 user nova-compute[73258]:     </interface>
Aug 27 06:39:05 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:39:05 user nova-compute[73258]:       <mac address="fa:16:3e:34:10:b5"/>
Aug 27 06:39:05 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:39:05 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:39:05 user nova-compute[73258]:       <target dev="tap5c2f38b2-1d"/>
Aug 27 06:39:05 user nova-compute[73258]:     </interface>
Aug 27 06:39:05 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:39:05 user nova-compute[73258]:       <mac address="fa:16:3e:f6:03:41"/>
Aug 27 06:39:05 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:39:05 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:39:05 user nova-compute[73258]:       <target dev="tapf0370f5d-de"/>
Aug 27 06:39:05 user nova-compute[73258]:     </interface>
Aug 27 06:39:05 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:39:05 user nova-compute[73258]:       <mac address="fa:16:3e:4d:cd:a0"/>
Aug 27 06:39:05 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:39:05 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:39:05 user nova-compute[73258]:       <target dev="tap384e3fbf-50"/>
Aug 27 06:39:05 user nova-compute[73258]:     </interface>
Aug 27 06:39:05 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:39:05 user nova-compute[73258]:       <mac address="fa:16:3e:a6:7a:e0"/>
Aug 27 06:39:05 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:39:05 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:39:05 user nova-compute[73258]:       <target dev="tape184532a-df"/>
Aug 27 06:39:05 user nova-compute[73258]:     </interface>
Aug 27 06:39:05 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:39:05 user nova-compute[73258]:       <mac address="fa:16:3e:41:44:fc"/>
Aug 27 06:39:05 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:39:05 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:39:05 user nova-compute[73258]:       <target dev="tap87427dc4-15"/>
Aug 27 06:39:05 user nova-compute[73258]:     </interface>
Aug 27 06:39:05 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:39:05 user nova-compute[73258]:       <mac address="fa:16:3e:ca:07:e5"/>
Aug 27 06:39:05 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:39:05 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:39:05 user nova-compute[73258]:       <target dev="tap9688c75d-c1"/>
Aug 27 06:39:05 user nova-compute[73258]:     </interface>
Aug 27 06:39:05 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:39:05 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/d7b11762-9244-481b-87dd-757782d68101/console.log" append="off"/>
Aug 27 06:39:05 user nova-compute[73258]:     </serial>
Aug 27 06:39:05 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:39:05 user nova-compute[73258]:     <video>
Aug 27 06:39:05 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:39:05 user nova-compute[73258]:     </video>
Aug 27 06:39:05 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:39:05 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:39:05 user nova-compute[73258]:     </rng>
Aug 27 06:39:05 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:39:05 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:39:05 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:39:05 user nova-compute[73258]:     </memballoon>
Aug 27 06:39:05 user nova-compute[73258]:   </devices>
Aug 27 06:39:05 user nova-compute[73258]: </domain>
Aug 27 06:39:05 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "933454ca-76f3-4f90-aab9-14e915a58487", "address": "fa:16:3e:41:30:a9", "network": {"id": "a2ca5db5-8c6d-44d0-acf5-c46a564a0247", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058086289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933454ca-76", "ovs_interfaceid": "933454ca-76f3-4f90-aab9-14e915a58487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "933454ca-76f3-4f90-aab9-14e915a58487", "address": "fa:16:3e:41:30:a9", "network": {"id": "a2ca5db5-8c6d-44d0-acf5-c46a564a0247", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058086289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933454ca-76", "ovs_interfaceid": "933454ca-76f3-4f90-aab9-14e915a58487", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:30:a9,bridge_name='br-int',has_traffic_filtering=True,id=933454ca-76f3-4f90-aab9-14e915a58487,network=Network(a2ca5db5-8c6d-44d0-acf5-c46a564a0247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933454ca-76') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG os_vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:30:a9,bridge_name='br-int',has_traffic_filtering=True,id=933454ca-76f3-4f90-aab9-14e915a58487,network=Network(a2ca5db5-8c6d-44d0-acf5-c46a564a0247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933454ca-76') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f3f033-a6a8-4a50-8bcb-2977eedd38b4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap933454ca-76, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap933454ca-76, col_values=(('external_ids', {'iface-id': '933454ca-76f3-4f90-aab9-14e915a58487', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:30:a9', 'vm-uuid': 'd7b11762-9244-481b-87dd-757782d68101'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bfc146-20a5-4501-a1e8-85fd5af76316]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxRcghvK {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: INFO os_vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:30:a9,bridge_name='br-int',has_traffic_filtering=True,id=933454ca-76f3-4f90-aab9-14e915a58487,network=Network(a2ca5db5-8c6d-44d0-acf5-c46a564a0247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933454ca-76')
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "address": "fa:16:3e:34:10:b5", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2f38b2-1d", "ovs_interfaceid": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "address": "fa:16:3e:34:10:b5", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2f38b2-1d", "ovs_interfaceid": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:10:b5,bridge_name='br-int',has_traffic_filtering=True,id=5c2f38b2-1d02-4e50-bc89-a2fa523fc408,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5c2f38b2-1d') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:10:b5,bridge_name='br-int',has_traffic_filtering=True,id=5c2f38b2-1d02-4e50-bc89-a2fa523fc408,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5c2f38b2-1d') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c2f38b2-1d, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5c2f38b2-1d, col_values=(('external_ids', {'iface-id': '5c2f38b2-1d02-4e50-bc89-a2fa523fc408', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:10:b5', 'vm-uuid': 'd7b11762-9244-481b-87dd-757782d68101'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxRcghvK" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fed0d9-5e27-4917-8f7c-51d91cd5bc02]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YxRcghvK'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: INFO os_vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:10:b5,bridge_name='br-int',has_traffic_filtering=True,id=5c2f38b2-1d02-4e50-bc89-a2fa523fc408,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5c2f38b2-1d')
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0370f5d-defe-48bd-b320-47db121211e2", "address": "fa:16:3e:f6:03:41", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0370f5d-de", "ovs_interfaceid": "f0370f5d-defe-48bd-b320-47db121211e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "f0370f5d-defe-48bd-b320-47db121211e2", "address": "fa:16:3e:f6:03:41", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0370f5d-de", "ovs_interfaceid": "f0370f5d-defe-48bd-b320-47db121211e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:03:41,bridge_name='br-int',has_traffic_filtering=True,id=f0370f5d-defe-48bd-b320-47db121211e2,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0370f5d-de') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:03:41,bridge_name='br-int',has_traffic_filtering=True,id=f0370f5d-defe-48bd-b320-47db121211e2,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0370f5d-de') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc76f6a-1e74-4b88-8028-d8cfa5c75f9e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0370f5d-de, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0370f5d-de, col_values=(('external_ids', {'iface-id': 'f0370f5d-defe-48bd-b320-47db121211e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:03:41', 'vm-uuid': 'd7b11762-9244-481b-87dd-757782d68101'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ff195b-e768-4664-a540-06bd139af461]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:06 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:06 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:06 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:06 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:06 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:06 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:06 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:06 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: INFO os_vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:03:41,bridge_name='br-int',has_traffic_filtering=True,id=f0370f5d-defe-48bd-b320-47db121211e2,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0370f5d-de')
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "384e3fbf-506e-42cb-8050-e05c2ee95749", "address": "fa:16:3e:4d:cd:a0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384e3fbf-50", "ovs_interfaceid": "384e3fbf-506e-42cb-8050-e05c2ee95749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "384e3fbf-506e-42cb-8050-e05c2ee95749", "address": "fa:16:3e:4d:cd:a0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384e3fbf-50", "ovs_interfaceid": "384e3fbf-506e-42cb-8050-e05c2ee95749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:cd:a0,bridge_name='br-int',has_traffic_filtering=True,id=384e3fbf-506e-42cb-8050-e05c2ee95749,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384e3fbf-50') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:cd:a0,bridge_name='br-int',has_traffic_filtering=True,id=384e3fbf-506e-42cb-8050-e05c2ee95749,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384e3fbf-50') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap384e3fbf-50, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap384e3fbf-50, col_values=(('external_ids', {'iface-id': '384e3fbf-506e-42cb-8050-e05c2ee95749', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:cd:a0', 'vm-uuid': 'd7b11762-9244-481b-87dd-757782d68101'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: INFO nova.compute.manager [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Took 0.90 seconds to detach 1 volumes for instance.
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae0e9ed-fe9b-4bbc-8e41-de1486f1d2a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:06 user nova-compute[73258]: INFO os_vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:cd:a0,bridge_name='br-int',has_traffic_filtering=True,id=384e3fbf-506e-42cb-8050-e05c2ee95749,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384e3fbf-50')
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e184532a-df10-431e-9ef2-c3a595e56b5d", "address": "fa:16:3e:a6:7a:e0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184532a-df", "ovs_interfaceid": "e184532a-df10-431e-9ef2-c3a595e56b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "e184532a-df10-431e-9ef2-c3a595e56b5d", "address": "fa:16:3e:a6:7a:e0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184532a-df", "ovs_interfaceid": "e184532a-df10-431e-9ef2-c3a595e56b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7a:e0,bridge_name='br-int',has_traffic_filtering=True,id=e184532a-df10-431e-9ef2-c3a595e56b5d,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape184532a-df') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7a:e0,bridge_name='br-int',has_traffic_filtering=True,id=e184532a-df10-431e-9ef2-c3a595e56b5d,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape184532a-df') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd, portal: 172.16.0.220,3260]
Aug 27 06:39:06 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd, portal: 172.16.0.220,3260] successful.
Aug 27 06:39:06 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.compute.manager [req-e2dee775-df10-4b11-9bda-6da631ad66ad req-5e82b3c9-042e-4870-9cf4-2796278069c6 service nova] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Received event network-vif-deleted-1b826212-ad3e-49a6-a97d-7b4f0c7f5830 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape184532a-df, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape184532a-df, col_values=(('external_ids', {'iface-id': 'e184532a-df10-431e-9ef2-c3a595e56b5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:7a:e0', 'vm-uuid': 'd7b11762-9244-481b-87dd-757782d68101'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54e5cf7-e5a1-4f91-8f9a-cba273cbe325]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[808495c5-3566-4fbd-a620-235c1e7c67f0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:06 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:06 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:06 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:06 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:06 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:06 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:06 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:06 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:06 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:06 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: INFO os_vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7a:e0,bridge_name='br-int',has_traffic_filtering=True,id=e184532a-df10-431e-9ef2-c3a595e56b5d,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape184532a-df')
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87427dc4-15ba-4179-999a-217c5eef5fd3", "address": "fa:16:3e:41:44:fc", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87427dc4-15", "ovs_interfaceid": "87427dc4-15ba-4179-999a-217c5eef5fd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "87427dc4-15ba-4179-999a-217c5eef5fd3", "address": "fa:16:3e:41:44:fc", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87427dc4-15", "ovs_interfaceid": "87427dc4-15ba-4179-999a-217c5eef5fd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:44:fc,bridge_name='br-int',has_traffic_filtering=True,id=87427dc4-15ba-4179-999a-217c5eef5fd3,network=Network(0e81e535-2163-479d-beb5-a099d4366ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87427dc4-15') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:44:fc,bridge_name='br-int',has_traffic_filtering=True,id=87427dc4-15ba-4179-999a-217c5eef5fd3,network=Network(0e81e535-2163-479d-beb5-a099d4366ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87427dc4-15') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87427dc4-15, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap87427dc4-15, col_values=(('external_ids', {'iface-id': '87427dc4-15ba-4179-999a-217c5eef5fd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:44:fc', 'vm-uuid': 'd7b11762-9244-481b-87dd-757782d68101'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadbe52f-eea6-475b-b5a4-0dfb1bde67f5]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxRcghvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: INFO os_vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:44:fc,bridge_name='br-int',has_traffic_filtering=True,id=87427dc4-15ba-4179-999a-217c5eef5fd3,network=Network(0e81e535-2163-479d-beb5-a099d4366ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87427dc4-15')
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "address": "fa:16:3e:ca:07:e5", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9688c75d-c1", "ovs_interfaceid": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "address": "fa:16:3e:ca:07:e5", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9688c75d-c1", "ovs_interfaceid": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:07:e5,bridge_name='br-int',has_traffic_filtering=True,id=9688c75d-c1a5-4bab-aa92-e1e3eed530bd,network=Network(0e81e535-2163-479d-beb5-a099d4366ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9688c75d-c1') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG os_vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:07:e5,bridge_name='br-int',has_traffic_filtering=True,id=9688c75d-c1a5-4bab-aa92-e1e3eed530bd,network=Network(0e81e535-2163-479d-beb5-a099d4366ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9688c75d-c1') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9688c75d-c1, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9688c75d-c1, col_values=(('external_ids', {'iface-id': '9688c75d-c1a5-4bab-aa92-e1e3eed530bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:07:e5', 'vm-uuid': 'd7b11762-9244-481b-87dd-757782d68101'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:06 user nova-compute[73258]: INFO os_vif [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:07:e5,bridge_name='br-int',has_traffic_filtering=True,id=9688c75d-c1a5-4bab-aa92-e1e3eed530bd,network=Network(0e81e535-2163-479d-beb5-a099d4366ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9688c75d-c1')
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] No BDM found with device name hda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] No VIF found with MAC fa:16:3e:41:30:a9, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] No VIF found with MAC fa:16:3e:a6:7a:e0, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:39:06 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Using config drive
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.514s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:06 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Creating config drive at /opt/stack/data/nova/instances/d7b11762-9244-481b-87dd-757782d68101/disk.config
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d7b11762-9244-481b-87dd-757782d68101/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpij3fhgsu {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:06 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Deleted allocations for instance bb57b63c-888f-40a0-88c0-97f63fd8297f
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d7b11762-9244-481b-87dd-757782d68101/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpij3fhgsu" returned: 0 in 0.063s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1e55ca1d-9402-4622-9de8-3bd71e75879d tempest-DeleteServersTestJSON-1135220088 tempest-DeleteServersTestJSON-1135220088-project-member] Lock "bb57b63c-888f-40a0-88c0-97f63fd8297f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.130s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCIbhQjv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:07 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:07 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Snapshot image upload complete
Aug 27 06:39:07 user nova-compute[73258]: DEBUG nova.compute.manager [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:39:07 user nova-compute[73258]: INFO nova.compute.manager [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Shelve offloading
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.452s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] <== connect_volume: return (2515ms) {'type': 'block', 'scsi_wwn': '23037363834376139', 'path': '/dev/sdf'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037363834376139', 'path': '/dev/sdf'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.110s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:07 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:07 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:07 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Instance destroyed successfully.
Aug 27 06:39:07 user nova-compute[73258]: DEBUG nova.compute.manager [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1ed8b4-bc55-4645-a18c-15e4ba70e67f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:39:07 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquired lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG nova.network.neutron [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NPfkTEFV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:07 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7ca8a7-4dbf-4676-bda5-ce8193250136]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127] added
Aug 27 06:39:07 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f7476a-2e98-4c93-8511-7e1f2981dbfa]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfcd7ae-29e6-4ac1-91fe-3a74313a5095]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eCIbhQjv {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eCIbhQjv" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cb023a-440c-4217-aa5c-2311bcddb0bc]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eCIbhQjv'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ead0f2-24bf-46a3-8ac5-f4dd3fe7c753]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d76ce48-2b85-4036-b532-5dc9bcf08946]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:07 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:07 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:07 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:07 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:07 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:07 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:07 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:07 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:07 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:07 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5281e3f7-6495-4c3b-b5f7-2cfbb995ad36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127, portal: 172.16.0.220,3260]
Aug 27 06:39:07 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127, portal: 172.16.0.220,3260] successful.
Aug 27 06:39:07 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6bf80e-b5d9-4f12-a6ea-7ebfa06273bf]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca21522d-f9c9-406a-9e3a-90288b708d9b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:07 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:07 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:07 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:07 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:07 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:07 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:07 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:07 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:07 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:07 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:07 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:07 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74bc59c-da0e-4493-a1a8-56d715baf909]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCIbhQjv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG nova.network.neutron [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Updating instance_info_cache with network_info: [{"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:39:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Releasing lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:08 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Instance destroyed successfully.
Aug 27 06:39:08 user nova-compute[73258]: DEBUG nova.objects.instance [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'resources' on Instance uuid 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1601086860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1601086860',id=4,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKN9oL6K1unToy1vBLfJDEhspBZ+6nInEDeFMBSIOkLauRGrGEb7fgBw3l691stm4aY7EPmi5rpZ3MPjWGELc3hQ/yUBUE8pZ2TuVjgtNW/eoGdif/reII4vfSxWa8rL1A==',key_name='tempest-keypair-1616777814',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:37:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='235a4f958e494352aaa119a4d44a52c5',ramdisk_id='',reservation_id='r-v9phxkt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1261077306',owner_user_name='tempest-AttachVolumeShelveTestJSON-1261077306-project-member',shelved_at='2023-08-27T06:39:07.258029',shelved_host='user',shelved_image_id='82376e8d-053f-4d6a-84f9-8200143c7462'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:39:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff1f51bb7163499c94ebbc93a051b4df',uuid=32ca4a64-5e49-4bbb-bf96-d3f8cf39146e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converting VIF {"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9f:3e,bridge_name='br-int',has_traffic_filtering=True,id=a345de09-b566-4d5c-8df6-5e706f31bc62,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa345de09-b5') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG os_vif [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9f:3e,bridge_name='br-int',has_traffic_filtering=True,id=a345de09-b566-4d5c-8df6-5e706f31bc62,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa345de09-b5') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa345de09-b5, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-e6014be6-12f8-4fae-8ea0-99fbd62731f1 req-1d3dd858-d9d5-4d29-9932-fd634d852c20 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received event network-changed-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-e6014be6-12f8-4fae-8ea0-99fbd62731f1 req-1d3dd858-d9d5-4d29-9932-fd634d852c20 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Refreshing instance network info cache due to event network-changed-a345de09-b566-4d5c-8df6-5e706f31bc62. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e6014be6-12f8-4fae-8ea0-99fbd62731f1 req-1d3dd858-d9d5-4d29-9932-fd634d852c20 service nova] Acquiring lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e6014be6-12f8-4fae-8ea0-99fbd62731f1 req-1d3dd858-d9d5-4d29-9932-fd634d852c20 service nova] Acquired lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG nova.network.neutron [req-e6014be6-12f8-4fae-8ea0-99fbd62731f1 req-1d3dd858-d9d5-4d29-9932-fd634d852c20 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Refreshing network info cache for port a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-de568301-abde-4e88-a379-44f77a8b5f62 req-3b2bc213-8d6e-4dac-9c63-1fc1ce112057 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-933454ca-76f3-4f90-aab9-14e915a58487 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-de568301-abde-4e88-a379-44f77a8b5f62 req-3b2bc213-8d6e-4dac-9c63-1fc1ce112057 service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-de568301-abde-4e88-a379-44f77a8b5f62 req-3b2bc213-8d6e-4dac-9c63-1fc1ce112057 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-de568301-abde-4e88-a379-44f77a8b5f62 req-3b2bc213-8d6e-4dac-9c63-1fc1ce112057 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-de568301-abde-4e88-a379-44f77a8b5f62 req-3b2bc213-8d6e-4dac-9c63-1fc1ce112057 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-933454ca-76f3-4f90-aab9-14e915a58487 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:08 user nova-compute[73258]: WARNING nova.compute.manager [req-de568301-abde-4e88-a379-44f77a8b5f62 req-3b2bc213-8d6e-4dac-9c63-1fc1ce112057 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-933454ca-76f3-4f90-aab9-14e915a58487 for instance with vm_state building and task_state spawning.
Aug 27 06:39:08 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] <== connect_volume: return (1483ms) {'type': 'block', 'scsi_wwn': '23039356436316634', 'path': '/dev/sdg'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039356436316634', 'path': '/dev/sdg'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.340s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:08 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:08 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:08 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG nova.objects.instance [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lazy-loading 'flavor' on Instance uuid e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[449458a4-fc06-4554-8725-ed533930747d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:39:08 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:39:08 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:39:08 user nova-compute[73258]:   <source dev="/dev/sdg"/>
Aug 27 06:39:08 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:39:08 user nova-compute[73258]:   <serial>ade6b05b-3bdd-4a39-8413-91c6e4394127</serial>
Aug 27 06:39:08 user nova-compute[73258]: </disk>
Aug 27 06:39:08 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5d72dc-aac2-4da0-9c62-c645d2210d28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d] added
Aug 27 06:39:08 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5482904c-a8a2-4a48-bc76-defb090ebb77]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:08 user nova-compute[73258]: INFO os_vif [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9f:3e,bridge_name='br-int',has_traffic_filtering=True,id=a345de09-b566-4d5c-8df6-5e706f31bc62,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa345de09-b5')
Aug 27 06:39:08 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Deleting instance files /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e_del
Aug 27 06:39:08 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Deletion of /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e_del complete
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b062d9-5b73-4b35-b57a-dbe7f17f99a6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NPfkTEFV {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NPfkTEFV" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3736dac3-1c90-426e-9fe0-62f820514ffa]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NPfkTEFV'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c2873b-f226-476e-8594-c063f3061fdd]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:08 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Deleted allocations for instance 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e63b3e-4e82-4eb3-a072-58520fabe701]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:08 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:08 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:08 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:08 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:08 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:08 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:08 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:08 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:08 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:08 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:08 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:08 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG nova.objects.instance [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'numa_topology' on Instance uuid 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG nova.objects.base [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Object Instance<32ca4a64-5e49-4bbb-bf96-d3f8cf39146e> lazy-loaded attributes: resources,numa_topology {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[625343f4-3113-429b-ac6c-878510735201]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d, portal: 172.16.0.220,3260]
Aug 27 06:39:09 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d, portal: 172.16.0.220,3260] successful.
Aug 27 06:39:09 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[720b0b2e-3d57-4ecd-bda4-66593e0eb17c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-f0241210-7c2c-4401-a40d-7476a0be3173 req-ee012221-0655-45ff-8c9a-6fba5b5d66fb service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-5c2f38b2-1d02-4e50-bc89-a2fa523fc408 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f0241210-7c2c-4401-a40d-7476a0be3173 req-ee012221-0655-45ff-8c9a-6fba5b5d66fb service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f0241210-7c2c-4401-a40d-7476a0be3173 req-ee012221-0655-45ff-8c9a-6fba5b5d66fb service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f0241210-7c2c-4401-a40d-7476a0be3173 req-ee012221-0655-45ff-8c9a-6fba5b5d66fb service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-f0241210-7c2c-4401-a40d-7476a0be3173 req-ee012221-0655-45ff-8c9a-6fba5b5d66fb service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-5c2f38b2-1d02-4e50-bc89-a2fa523fc408 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:09 user nova-compute[73258]: WARNING nova.compute.manager [req-f0241210-7c2c-4401-a40d-7476a0be3173 req-ee012221-0655-45ff-8c9a-6fba5b5d66fb service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-5c2f38b2-1d02-4e50-bc89-a2fa523fc408 for instance with vm_state building and task_state spawning.
Aug 27 06:39:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0eb06e-5883-46ac-8afd-6aa8b94c8a60]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:09 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:09 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:09 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:09 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:09 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:09 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:09 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:09 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:09 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:09 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:09 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:09 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:09 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:09 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.456s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36ef412-6a22-4172-a27e-f67b5ef78237]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NPfkTEFV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] No VIF found with MAC fa:16:3e:4a:cd:08, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG nova.network.neutron [req-e6014be6-12f8-4fae-8ea0-99fbd62731f1 req-1d3dd858-d9d5-4d29-9932-fd634d852c20 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Updated VIF entry in instance network info cache for port a345de09-b566-4d5c-8df6-5e706f31bc62. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG nova.network.neutron [req-e6014be6-12f8-4fae-8ea0-99fbd62731f1 req-1d3dd858-d9d5-4d29-9932-fd634d852c20 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Updating instance_info_cache with network_info: [{"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa345de09-b5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e6014be6-12f8-4fae-8ea0-99fbd62731f1 req-1d3dd858-d9d5-4d29-9932-fd634d852c20 service nova] Releasing lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.714s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5c45c304-fb3d-40a6-8a23-7ae6819c94c6 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.458s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-64becbae-0784-4e9f-b552-81cbcaa8ad1d tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.767s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.507s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] <== connect_volume: return (2848ms) {'type': 'block', 'scsi_wwn': '23930666334623735', 'path': '/dev/sdh'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930666334623735', 'path': '/dev/sdh'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLazsToF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:10 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:10 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:10 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2bf5ce-7616-41e6-8814-a6c460d3a790]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:39:10 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[16947c26-05bd-47c6-9fdb-b019fe9f6c6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53] added
Aug 27 06:39:10 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8475ff3b-da65-49f7-bcf7-ae317211a399]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef73afb2-df53-4290-88e8-9eac3d1959df]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HLazsToF {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HLazsToF" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25b9553-5cb9-4041-b804-9cf665dc74ca]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HLazsToF'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e85b461-12a1-45b4-ae2e-00270821c1ad]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02f336c-b5ad-477a-9626-f926e7ad2d97]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:10 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:10 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:10 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:10 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:10 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:10 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:10 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:10 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:10 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:10 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:10 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:10 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:10 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:10 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-a96b6220-4368-4e3f-bd6b-6acf0307ab01 req-531009dd-e2fd-47e8-a735-73eeda95bf77 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-f0370f5d-defe-48bd-b320-47db121211e2 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a96b6220-4368-4e3f-bd6b-6acf0307ab01 req-531009dd-e2fd-47e8-a735-73eeda95bf77 service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a96b6220-4368-4e3f-bd6b-6acf0307ab01 req-531009dd-e2fd-47e8-a735-73eeda95bf77 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a96b6220-4368-4e3f-bd6b-6acf0307ab01 req-531009dd-e2fd-47e8-a735-73eeda95bf77 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-a96b6220-4368-4e3f-bd6b-6acf0307ab01 req-531009dd-e2fd-47e8-a735-73eeda95bf77 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-f0370f5d-defe-48bd-b320-47db121211e2 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:10 user nova-compute[73258]: WARNING nova.compute.manager [req-a96b6220-4368-4e3f-bd6b-6acf0307ab01 req-531009dd-e2fd-47e8-a735-73eeda95bf77 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-f0370f5d-defe-48bd-b320-47db121211e2 for instance with vm_state building and task_state spawning.
Aug 27 06:39:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-a96b6220-4368-4e3f-bd6b-6acf0307ab01 req-531009dd-e2fd-47e8-a735-73eeda95bf77 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-f0370f5d-defe-48bd-b320-47db121211e2 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a96b6220-4368-4e3f-bd6b-6acf0307ab01 req-531009dd-e2fd-47e8-a735-73eeda95bf77 service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a96b6220-4368-4e3f-bd6b-6acf0307ab01 req-531009dd-e2fd-47e8-a735-73eeda95bf77 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a96b6220-4368-4e3f-bd6b-6acf0307ab01 req-531009dd-e2fd-47e8-a735-73eeda95bf77 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-a96b6220-4368-4e3f-bd6b-6acf0307ab01 req-531009dd-e2fd-47e8-a735-73eeda95bf77 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-f0370f5d-defe-48bd-b320-47db121211e2 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:10 user nova-compute[73258]: WARNING nova.compute.manager [req-a96b6220-4368-4e3f-bd6b-6acf0307ab01 req-531009dd-e2fd-47e8-a735-73eeda95bf77 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-f0370f5d-defe-48bd-b320-47db121211e2 for instance with vm_state building and task_state spawning.
Aug 27 06:39:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-bb36c079-2c18-4b23-a8aa-f11560460f1b req-bd0d65bf-4c47-4c1b-af8a-d301304c84a4 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-933454ca-76f3-4f90-aab9-14e915a58487 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bb36c079-2c18-4b23-a8aa-f11560460f1b req-bd0d65bf-4c47-4c1b-af8a-d301304c84a4 service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bb36c079-2c18-4b23-a8aa-f11560460f1b req-bd0d65bf-4c47-4c1b-af8a-d301304c84a4 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bb36c079-2c18-4b23-a8aa-f11560460f1b req-bd0d65bf-4c47-4c1b-af8a-d301304c84a4 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-bb36c079-2c18-4b23-a8aa-f11560460f1b req-bd0d65bf-4c47-4c1b-af8a-d301304c84a4 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-933454ca-76f3-4f90-aab9-14e915a58487 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:10 user nova-compute[73258]: WARNING nova.compute.manager [req-bb36c079-2c18-4b23-a8aa-f11560460f1b req-bd0d65bf-4c47-4c1b-af8a-d301304c84a4 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-933454ca-76f3-4f90-aab9-14e915a58487 for instance with vm_state building and task_state spawning.
Aug 27 06:39:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG nova.compute.manager [req-a12fe4fa-641f-4a77-ad8c-1048885623a6 req-25f3c378-c629-40b8-beaf-31d7b7b06f34 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-5c2f38b2-1d02-4e50-bc89-a2fa523fc408 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a12fe4fa-641f-4a77-ad8c-1048885623a6 req-25f3c378-c629-40b8-beaf-31d7b7b06f34 service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a12fe4fa-641f-4a77-ad8c-1048885623a6 req-25f3c378-c629-40b8-beaf-31d7b7b06f34 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a12fe4fa-641f-4a77-ad8c-1048885623a6 req-25f3c378-c629-40b8-beaf-31d7b7b06f34 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG nova.compute.manager [req-a12fe4fa-641f-4a77-ad8c-1048885623a6 req-25f3c378-c629-40b8-beaf-31d7b7b06f34 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-5c2f38b2-1d02-4e50-bc89-a2fa523fc408 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:11 user nova-compute[73258]: WARNING nova.compute.manager [req-a12fe4fa-641f-4a77-ad8c-1048885623a6 req-25f3c378-c629-40b8-beaf-31d7b7b06f34 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-5c2f38b2-1d02-4e50-bc89-a2fa523fc408 for instance with vm_state building and task_state spawning.
Aug 27 06:39:11 user nova-compute[73258]: DEBUG nova.compute.manager [req-a12fe4fa-641f-4a77-ad8c-1048885623a6 req-25f3c378-c629-40b8-beaf-31d7b7b06f34 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-384e3fbf-506e-42cb-8050-e05c2ee95749 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a12fe4fa-641f-4a77-ad8c-1048885623a6 req-25f3c378-c629-40b8-beaf-31d7b7b06f34 service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a12fe4fa-641f-4a77-ad8c-1048885623a6 req-25f3c378-c629-40b8-beaf-31d7b7b06f34 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a12fe4fa-641f-4a77-ad8c-1048885623a6 req-25f3c378-c629-40b8-beaf-31d7b7b06f34 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG nova.compute.manager [req-a12fe4fa-641f-4a77-ad8c-1048885623a6 req-25f3c378-c629-40b8-beaf-31d7b7b06f34 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-384e3fbf-506e-42cb-8050-e05c2ee95749 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:11 user nova-compute[73258]: WARNING nova.compute.manager [req-a12fe4fa-641f-4a77-ad8c-1048885623a6 req-25f3c378-c629-40b8-beaf-31d7b7b06f34 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-384e3fbf-506e-42cb-8050-e05c2ee95749 for instance with vm_state building and task_state spawning.
Aug 27 06:39:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --login" returned: 0 in 1.095s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[90697586-e541-45f1-96f3-ae42ff4c543c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53, portal: 172.16.0.220,3260]
Aug 27 06:39:11 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53, portal: 172.16.0.220,3260] successful.
Aug 27 06:39:11 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f53027-05a4-4f16-9618-5adc9619050d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba5f515-f2ef-4b32-911c-521c11b4536d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:11 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:11 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:11 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:11 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:11 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:11 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:11 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:11 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:11 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:11 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:11 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:11 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:11 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:11 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:11 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:11 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.419s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be9ade5-c585-4a97-bf35-85bc70be29d6]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLazsToF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.459s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] <== connect_volume: return (2461ms) {'type': 'block', 'scsi_wwn': '23562396539353664', 'path': '/dev/sdi'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562396539353664', 'path': '/dev/sdi'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-e184532a-df10-431e-9ef2-c3a595e56b5d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-e184532a-df10-431e-9ef2-c3a595e56b5d {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:12 user nova-compute[73258]: WARNING nova.compute.manager [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-e184532a-df10-431e-9ef2-c3a595e56b5d for instance with vm_state building and task_state spawning.
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-e184532a-df10-431e-9ef2-c3a595e56b5d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-e184532a-df10-431e-9ef2-c3a595e56b5d {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:12 user nova-compute[73258]: WARNING nova.compute.manager [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-e184532a-df10-431e-9ef2-c3a595e56b5d for instance with vm_state building and task_state spawning.
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-9688c75d-c1a5-4bab-aa92-e1e3eed530bd {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-9688c75d-c1a5-4bab-aa92-e1e3eed530bd {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:12 user nova-compute[73258]: WARNING nova.compute.manager [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-9688c75d-c1a5-4bab-aa92-e1e3eed530bd for instance with vm_state building and task_state spawning.
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-9688c75d-c1a5-4bab-aa92-e1e3eed530bd {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-9688c75d-c1a5-4bab-aa92-e1e3eed530bd {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:12 user nova-compute[73258]: WARNING nova.compute.manager [req-e438dc89-1273-462c-b1f8-638c6fecac4b req-3b851b9e-3cca-4f4d-bd6c-5ee918afc12c service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-9688c75d-c1a5-4bab-aa92-e1e3eed530bd for instance with vm_state building and task_state spawning.
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59275472-b18f-4e4b-922f-475dd553833c", "address": "fa:16:3e:05:21:15", "network": {"id": "5eaba2f5-e1ca-4a9b-8195-bc8798d89753", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-374547766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59275472-b1", "ovs_interfaceid": "59275472-b18f-4e4b-922f-475dd553833c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "59275472-b18f-4e4b-922f-475dd553833c", "address": "fa:16:3e:05:21:15", "network": {"id": "5eaba2f5-e1ca-4a9b-8195-bc8798d89753", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-374547766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59275472-b1", "ovs_interfaceid": "59275472-b18f-4e4b-922f-475dd553833c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:21:15,bridge_name='br-int',has_traffic_filtering=True,id=59275472-b18f-4e4b-922f-475dd553833c,network=Network(5eaba2f5-e1ca-4a9b-8195-bc8798d89753),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59275472-b1') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5820add-1974-4f6c-873e-ef179593b46a", "address": "fa:16:3e:b1:35:89", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5820add-19", "ovs_interfaceid": "e5820add-1974-4f6c-873e-ef179593b46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "e5820add-1974-4f6c-873e-ef179593b46a", "address": "fa:16:3e:b1:35:89", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5820add-19", "ovs_interfaceid": "e5820add-1974-4f6c-873e-ef179593b46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:35:89,bridge_name='br-int',has_traffic_filtering=True,id=e5820add-1974-4f6c-873e-ef179593b46a,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape5820add-19') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "address": "fa:16:3e:5a:25:32", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff33d225-ef", "ovs_interfaceid": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "address": "fa:16:3e:5a:25:32", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff33d225-ef", "ovs_interfaceid": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:25:32,bridge_name='br-int',has_traffic_filtering=True,id=ff33d225-ef5e-4565-9278-4763c5b7ff6c,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff33d225-ef') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e481124c-b62d-4fc9-9f02-ba38c027180e", "address": "fa:16:3e:ef:7e:25", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape481124c-b6", "ovs_interfaceid": "e481124c-b62d-4fc9-9f02-ba38c027180e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "e481124c-b62d-4fc9-9f02-ba38c027180e", "address": "fa:16:3e:ef:7e:25", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape481124c-b6", "ovs_interfaceid": "e481124c-b62d-4fc9-9f02-ba38c027180e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:7e:25,bridge_name='br-int',has_traffic_filtering=True,id=e481124c-b62d-4fc9-9f02-ba38c027180e,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape481124c-b6') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0914d88d-1909-4bcb-a776-37af31e16b9e", "address": "fa:16:3e:a0:a3:84", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914d88d-19", "ovs_interfaceid": "0914d88d-1909-4bcb-a776-37af31e16b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "0914d88d-1909-4bcb-a776-37af31e16b9e", "address": "fa:16:3e:a0:a3:84", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914d88d-19", "ovs_interfaceid": "0914d88d-1909-4bcb-a776-37af31e16b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a3:84,bridge_name='br-int',has_traffic_filtering=True,id=0914d88d-1909-4bcb-a776-37af31e16b9e,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0914d88d-19') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e32a9d4d-57df-4765-b5be-12cea8621fce", "address": "fa:16:3e:10:c4:37", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32a9d4d-57", "ovs_interfaceid": "e32a9d4d-57df-4765-b5be-12cea8621fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "e32a9d4d-57df-4765-b5be-12cea8621fce", "address": "fa:16:3e:10:c4:37", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32a9d4d-57", "ovs_interfaceid": "e32a9d4d-57df-4765-b5be-12cea8621fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:c4:37,bridge_name='br-int',has_traffic_filtering=True,id=e32a9d4d-57df-4765-b5be-12cea8621fce,network=Network(d1088fa3-bbf4-4136-b3bd-3014c8cd4254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape32a9d4d-57') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "783f5103-a178-42e0-a3b0-f523ca4c9439", "address": "fa:16:3e:4d:78:05", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap783f5103-a1", "ovs_interfaceid": "783f5103-a178-42e0-a3b0-f523ca4c9439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "783f5103-a178-42e0-a3b0-f523ca4c9439", "address": "fa:16:3e:4d:78:05", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap783f5103-a1", "ovs_interfaceid": "783f5103-a178-42e0-a3b0-f523ca4c9439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:78:05,bridge_name='br-int',has_traffic_filtering=True,id=783f5103-a178-42e0-a3b0-f523ca4c9439,network=Network(d1088fa3-bbf4-4136-b3bd-3014c8cd4254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap783f5103-a1') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lazy-loading 'pci_devices' on Instance uuid 32d3fdfc-82ad-46ee-b673-4e73f43b85e7 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:39:12 user nova-compute[73258]:   <uuid>32d3fdfc-82ad-46ee-b673-4e73f43b85e7</uuid>
Aug 27 06:39:12 user nova-compute[73258]:   <name>instance-0000000c</name>
Aug 27 06:39:12 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:39:12 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:39:12 user nova-compute[73258]:   <metadata>
Aug 27 06:39:12 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:39:12 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:39:12 user nova-compute[73258]:       <nova:name>tempest-device-tagging-server-781962375</nova:name>
Aug 27 06:39:12 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:39:04</nova:creationTime>
Aug 27 06:39:12 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:39:12 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:39:12 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:39:12 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:39:12 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:39:12 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:39:12 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:39:12 user nova-compute[73258]:       <nova:owner>
Aug 27 06:39:12 user nova-compute[73258]:         <nova:user uuid="e08cea7dd1244afb9c29e851e15fa1a0">tempest-TaggedBootDevicesTest-913935157-project-member</nova:user>
Aug 27 06:39:12 user nova-compute[73258]:         <nova:project uuid="80e3e1c0feb243a7aeb858041065ffba">tempest-TaggedBootDevicesTest-913935157</nova:project>
Aug 27 06:39:12 user nova-compute[73258]:       </nova:owner>
Aug 27 06:39:12 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:39:12 user nova-compute[73258]:       <nova:ports>
Aug 27 06:39:12 user nova-compute[73258]:         <nova:port uuid="59275472-b18f-4e4b-922f-475dd553833c">
Aug 27 06:39:12 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 06:39:12 user nova-compute[73258]:         </nova:port>
Aug 27 06:39:12 user nova-compute[73258]:         <nova:port uuid="e5820add-1974-4f6c-873e-ef179593b46a">
Aug 27 06:39:12 user nova-compute[73258]:           <nova:ip type="fixed" address="10.1.1.124" ipVersion="4"/>
Aug 27 06:39:12 user nova-compute[73258]:         </nova:port>
Aug 27 06:39:12 user nova-compute[73258]:         <nova:port uuid="ff33d225-ef5e-4565-9278-4763c5b7ff6c">
Aug 27 06:39:12 user nova-compute[73258]:           <nova:ip type="fixed" address="10.1.1.54" ipVersion="4"/>
Aug 27 06:39:12 user nova-compute[73258]:         </nova:port>
Aug 27 06:39:12 user nova-compute[73258]:         <nova:port uuid="e481124c-b62d-4fc9-9f02-ba38c027180e">
Aug 27 06:39:12 user nova-compute[73258]:           <nova:ip type="fixed" address="10.1.1.50" ipVersion="4"/>
Aug 27 06:39:12 user nova-compute[73258]:         </nova:port>
Aug 27 06:39:12 user nova-compute[73258]:         <nova:port uuid="0914d88d-1909-4bcb-a776-37af31e16b9e">
Aug 27 06:39:12 user nova-compute[73258]:           <nova:ip type="fixed" address="10.1.1.65" ipVersion="4"/>
Aug 27 06:39:12 user nova-compute[73258]:         </nova:port>
Aug 27 06:39:12 user nova-compute[73258]:         <nova:port uuid="e32a9d4d-57df-4765-b5be-12cea8621fce">
Aug 27 06:39:12 user nova-compute[73258]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 27 06:39:12 user nova-compute[73258]:         </nova:port>
Aug 27 06:39:12 user nova-compute[73258]:         <nova:port uuid="783f5103-a178-42e0-a3b0-f523ca4c9439">
Aug 27 06:39:12 user nova-compute[73258]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 27 06:39:12 user nova-compute[73258]:         </nova:port>
Aug 27 06:39:12 user nova-compute[73258]:       </nova:ports>
Aug 27 06:39:12 user nova-compute[73258]:     </nova:instance>
Aug 27 06:39:12 user nova-compute[73258]:   </metadata>
Aug 27 06:39:12 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:39:12 user nova-compute[73258]:     <system>
Aug 27 06:39:12 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:39:12 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:39:12 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:39:12 user nova-compute[73258]:       <entry name="serial">32d3fdfc-82ad-46ee-b673-4e73f43b85e7</entry>
Aug 27 06:39:12 user nova-compute[73258]:       <entry name="uuid">32d3fdfc-82ad-46ee-b673-4e73f43b85e7</entry>
Aug 27 06:39:12 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:39:12 user nova-compute[73258]:     </system>
Aug 27 06:39:12 user nova-compute[73258]:   </sysinfo>
Aug 27 06:39:12 user nova-compute[73258]:   <os>
Aug 27 06:39:12 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:39:12 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:39:12 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:39:12 user nova-compute[73258]:   </os>
Aug 27 06:39:12 user nova-compute[73258]:   <features>
Aug 27 06:39:12 user nova-compute[73258]:     <acpi/>
Aug 27 06:39:12 user nova-compute[73258]:     <apic/>
Aug 27 06:39:12 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:39:12 user nova-compute[73258]:   </features>
Aug 27 06:39:12 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:39:12 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:39:12 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:39:12 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:39:12 user nova-compute[73258]:   </clock>
Aug 27 06:39:12 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:39:12 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:39:12 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:39:12 user nova-compute[73258]:   </cpu>
Aug 27 06:39:12 user nova-compute[73258]:   <devices>
Aug 27 06:39:12 user nova-compute[73258]:     <disk type="file" device="cdrom">
Aug 27 06:39:12 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 06:39:12 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/32d3fdfc-82ad-46ee-b673-4e73f43b85e7/disk.config"/>
Aug 27 06:39:12 user nova-compute[73258]:       <target dev="hda" bus="ide"/>
Aug 27 06:39:12 user nova-compute[73258]:     </disk>
Aug 27 06:39:12 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:39:12 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:39:12 user nova-compute[73258]:       <source dev="/dev/sdf"/>
Aug 27 06:39:12 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:39:12 user nova-compute[73258]:       <serial>f4341dc1-1685-44f0-b29f-5212dba42abd</serial>
Aug 27 06:39:12 user nova-compute[73258]:     </disk>
Aug 27 06:39:12 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:39:12 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:39:12 user nova-compute[73258]:       <source dev="/dev/sdh"/>
Aug 27 06:39:12 user nova-compute[73258]:       <target dev="vdb" bus="virtio"/>
Aug 27 06:39:12 user nova-compute[73258]:       <serial>bfea6f05-84f2-4b48-9460-5da143c24c4d</serial>
Aug 27 06:39:12 user nova-compute[73258]:     </disk>
Aug 27 06:39:12 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:39:12 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:39:12 user nova-compute[73258]:       <source dev="/dev/sdi"/>
Aug 27 06:39:12 user nova-compute[73258]:       <target dev="vdc" bus="virtio"/>
Aug 27 06:39:12 user nova-compute[73258]:       <serial>4212a9b2-2bd0-431f-8257-85a3d0bc9a53</serial>
Aug 27 06:39:12 user nova-compute[73258]:     </disk>
Aug 27 06:39:12 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:39:12 user nova-compute[73258]:       <mac address="fa:16:3e:05:21:15"/>
Aug 27 06:39:12 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:39:12 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:39:12 user nova-compute[73258]:       <target dev="tap59275472-b1"/>
Aug 27 06:39:12 user nova-compute[73258]:     </interface>
Aug 27 06:39:12 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:39:12 user nova-compute[73258]:       <mac address="fa:16:3e:b1:35:89"/>
Aug 27 06:39:12 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:39:12 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:39:12 user nova-compute[73258]:       <target dev="tape5820add-19"/>
Aug 27 06:39:12 user nova-compute[73258]:     </interface>
Aug 27 06:39:12 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:39:12 user nova-compute[73258]:       <mac address="fa:16:3e:5a:25:32"/>
Aug 27 06:39:12 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:39:12 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:39:12 user nova-compute[73258]:       <target dev="tapff33d225-ef"/>
Aug 27 06:39:12 user nova-compute[73258]:     </interface>
Aug 27 06:39:12 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:39:12 user nova-compute[73258]:       <mac address="fa:16:3e:ef:7e:25"/>
Aug 27 06:39:12 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:39:12 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:39:12 user nova-compute[73258]:       <target dev="tape481124c-b6"/>
Aug 27 06:39:12 user nova-compute[73258]:     </interface>
Aug 27 06:39:12 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:39:12 user nova-compute[73258]:       <mac address="fa:16:3e:a0:a3:84"/>
Aug 27 06:39:12 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:39:12 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:39:12 user nova-compute[73258]:       <target dev="tap0914d88d-19"/>
Aug 27 06:39:12 user nova-compute[73258]:     </interface>
Aug 27 06:39:12 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:39:12 user nova-compute[73258]:       <mac address="fa:16:3e:10:c4:37"/>
Aug 27 06:39:12 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:39:12 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:39:12 user nova-compute[73258]:       <target dev="tape32a9d4d-57"/>
Aug 27 06:39:12 user nova-compute[73258]:     </interface>
Aug 27 06:39:12 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:39:12 user nova-compute[73258]:       <mac address="fa:16:3e:4d:78:05"/>
Aug 27 06:39:12 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:39:12 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:39:12 user nova-compute[73258]:       <target dev="tap783f5103-a1"/>
Aug 27 06:39:12 user nova-compute[73258]:     </interface>
Aug 27 06:39:12 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:39:12 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/32d3fdfc-82ad-46ee-b673-4e73f43b85e7/console.log" append="off"/>
Aug 27 06:39:12 user nova-compute[73258]:     </serial>
Aug 27 06:39:12 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:39:12 user nova-compute[73258]:     <video>
Aug 27 06:39:12 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:39:12 user nova-compute[73258]:     </video>
Aug 27 06:39:12 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:39:12 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:39:12 user nova-compute[73258]:     </rng>
Aug 27 06:39:12 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:39:12 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:39:12 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:39:12 user nova-compute[73258]:     </memballoon>
Aug 27 06:39:12 user nova-compute[73258]:   </devices>
Aug 27 06:39:12 user nova-compute[73258]: </domain>
Aug 27 06:39:12 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59275472-b18f-4e4b-922f-475dd553833c", "address": "fa:16:3e:05:21:15", "network": {"id": "5eaba2f5-e1ca-4a9b-8195-bc8798d89753", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-374547766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59275472-b1", "ovs_interfaceid": "59275472-b18f-4e4b-922f-475dd553833c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "59275472-b18f-4e4b-922f-475dd553833c", "address": "fa:16:3e:05:21:15", "network": {"id": "5eaba2f5-e1ca-4a9b-8195-bc8798d89753", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-374547766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59275472-b1", "ovs_interfaceid": "59275472-b18f-4e4b-922f-475dd553833c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:21:15,bridge_name='br-int',has_traffic_filtering=True,id=59275472-b18f-4e4b-922f-475dd553833c,network=Network(5eaba2f5-e1ca-4a9b-8195-bc8798d89753),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59275472-b1') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG os_vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:21:15,bridge_name='br-int',has_traffic_filtering=True,id=59275472-b18f-4e4b-922f-475dd553833c,network=Network(5eaba2f5-e1ca-4a9b-8195-bc8798d89753),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59275472-b1') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-47eb6ef2-6155-4a96-be93-615ea10ead6d req-055569ce-c1d6-4714-b90b-77f66a196b81 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Received event network-changed-5d69f70a-cd94-4b7b-abc9-652fc681c98b {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-47eb6ef2-6155-4a96-be93-615ea10ead6d req-055569ce-c1d6-4714-b90b-77f66a196b81 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Refreshing instance network info cache due to event network-changed-5d69f70a-cd94-4b7b-abc9-652fc681c98b. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-47eb6ef2-6155-4a96-be93-615ea10ead6d req-055569ce-c1d6-4714-b90b-77f66a196b81 service nova] Acquiring lock "refresh_cache-33b995be-307d-4491-a1b4-fb75ececea1d" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-47eb6ef2-6155-4a96-be93-615ea10ead6d req-055569ce-c1d6-4714-b90b-77f66a196b81 service nova] Acquired lock "refresh_cache-33b995be-307d-4491-a1b4-fb75ececea1d" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.neutron [req-47eb6ef2-6155-4a96-be93-615ea10ead6d req-055569ce-c1d6-4714-b90b-77f66a196b81 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Refreshing network info cache for port 5d69f70a-cd94-4b7b-abc9-652fc681c98b {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59275472-b1, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap59275472-b1, col_values=(('external_ids', {'iface-id': '59275472-b18f-4e4b-922f-475dd553833c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:21:15', 'vm-uuid': '32d3fdfc-82ad-46ee-b673-4e73f43b85e7'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: INFO os_vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:21:15,bridge_name='br-int',has_traffic_filtering=True,id=59275472-b18f-4e4b-922f-475dd553833c,network=Network(5eaba2f5-e1ca-4a9b-8195-bc8798d89753),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59275472-b1')
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5820add-1974-4f6c-873e-ef179593b46a", "address": "fa:16:3e:b1:35:89", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5820add-19", "ovs_interfaceid": "e5820add-1974-4f6c-873e-ef179593b46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "e5820add-1974-4f6c-873e-ef179593b46a", "address": "fa:16:3e:b1:35:89", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5820add-19", "ovs_interfaceid": "e5820add-1974-4f6c-873e-ef179593b46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:35:89,bridge_name='br-int',has_traffic_filtering=True,id=e5820add-1974-4f6c-873e-ef179593b46a,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape5820add-19') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG os_vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:35:89,bridge_name='br-int',has_traffic_filtering=True,id=e5820add-1974-4f6c-873e-ef179593b46a,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape5820add-19') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5820add-19, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape5820add-19, col_values=(('external_ids', {'iface-id': 'e5820add-1974-4f6c-873e-ef179593b46a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:35:89', 'vm-uuid': '32d3fdfc-82ad-46ee-b673-4e73f43b85e7'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: INFO os_vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:35:89,bridge_name='br-int',has_traffic_filtering=True,id=e5820add-1974-4f6c-873e-ef179593b46a,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape5820add-19')
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "address": "fa:16:3e:5a:25:32", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff33d225-ef", "ovs_interfaceid": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "address": "fa:16:3e:5a:25:32", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff33d225-ef", "ovs_interfaceid": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:25:32,bridge_name='br-int',has_traffic_filtering=True,id=ff33d225-ef5e-4565-9278-4763c5b7ff6c,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff33d225-ef') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG os_vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:25:32,bridge_name='br-int',has_traffic_filtering=True,id=ff33d225-ef5e-4565-9278-4763c5b7ff6c,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff33d225-ef') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff33d225-ef, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff33d225-ef, col_values=(('external_ids', {'iface-id': 'ff33d225-ef5e-4565-9278-4763c5b7ff6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:25:32', 'vm-uuid': '32d3fdfc-82ad-46ee-b673-4e73f43b85e7'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: INFO os_vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:25:32,bridge_name='br-int',has_traffic_filtering=True,id=ff33d225-ef5e-4565-9278-4763c5b7ff6c,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff33d225-ef')
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e481124c-b62d-4fc9-9f02-ba38c027180e", "address": "fa:16:3e:ef:7e:25", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape481124c-b6", "ovs_interfaceid": "e481124c-b62d-4fc9-9f02-ba38c027180e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "e481124c-b62d-4fc9-9f02-ba38c027180e", "address": "fa:16:3e:ef:7e:25", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape481124c-b6", "ovs_interfaceid": "e481124c-b62d-4fc9-9f02-ba38c027180e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:7e:25,bridge_name='br-int',has_traffic_filtering=True,id=e481124c-b62d-4fc9-9f02-ba38c027180e,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape481124c-b6') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG os_vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:7e:25,bridge_name='br-int',has_traffic_filtering=True,id=e481124c-b62d-4fc9-9f02-ba38c027180e,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape481124c-b6') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape481124c-b6, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape481124c-b6, col_values=(('external_ids', {'iface-id': 'e481124c-b62d-4fc9-9f02-ba38c027180e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:7e:25', 'vm-uuid': '32d3fdfc-82ad-46ee-b673-4e73f43b85e7'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: INFO os_vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:7e:25,bridge_name='br-int',has_traffic_filtering=True,id=e481124c-b62d-4fc9-9f02-ba38c027180e,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape481124c-b6')
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0914d88d-1909-4bcb-a776-37af31e16b9e", "address": "fa:16:3e:a0:a3:84", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914d88d-19", "ovs_interfaceid": "0914d88d-1909-4bcb-a776-37af31e16b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "0914d88d-1909-4bcb-a776-37af31e16b9e", "address": "fa:16:3e:a0:a3:84", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914d88d-19", "ovs_interfaceid": "0914d88d-1909-4bcb-a776-37af31e16b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a3:84,bridge_name='br-int',has_traffic_filtering=True,id=0914d88d-1909-4bcb-a776-37af31e16b9e,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0914d88d-19') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG os_vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a3:84,bridge_name='br-int',has_traffic_filtering=True,id=0914d88d-1909-4bcb-a776-37af31e16b9e,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0914d88d-19') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:39:12 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118352.9892516, d7b11762-9244-481b-87dd-757782d68101 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:39:12 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d7b11762-9244-481b-87dd-757782d68101] VM Resumed (Lifecycle Event)
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0914d88d-19, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0914d88d-19, col_values=(('external_ids', {'iface-id': '0914d88d-1909-4bcb-a776-37af31e16b9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:a3:84', 'vm-uuid': '32d3fdfc-82ad-46ee-b673-4e73f43b85e7'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d7b11762-9244-481b-87dd-757782d68101] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:13 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: d7b11762-9244-481b-87dd-757782d68101] Instance spawned successfully.
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d7b11762-9244-481b-87dd-757782d68101] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:39:13 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d7b11762-9244-481b-87dd-757782d68101] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118352.9951634, d7b11762-9244-481b-87dd-757782d68101 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:39:13 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d7b11762-9244-481b-87dd-757782d68101] VM Started (Lifecycle Event)
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:13 user nova-compute[73258]: INFO os_vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a3:84,bridge_name='br-int',has_traffic_filtering=True,id=0914d88d-1909-4bcb-a776-37af31e16b9e,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0914d88d-19')
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e32a9d4d-57df-4765-b5be-12cea8621fce", "address": "fa:16:3e:10:c4:37", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32a9d4d-57", "ovs_interfaceid": "e32a9d4d-57df-4765-b5be-12cea8621fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "e32a9d4d-57df-4765-b5be-12cea8621fce", "address": "fa:16:3e:10:c4:37", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32a9d4d-57", "ovs_interfaceid": "e32a9d4d-57df-4765-b5be-12cea8621fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:c4:37,bridge_name='br-int',has_traffic_filtering=True,id=e32a9d4d-57df-4765-b5be-12cea8621fce,network=Network(d1088fa3-bbf4-4136-b3bd-3014c8cd4254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape32a9d4d-57') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG os_vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:c4:37,bridge_name='br-int',has_traffic_filtering=True,id=e32a9d4d-57df-4765-b5be-12cea8621fce,network=Network(d1088fa3-bbf4-4136-b3bd-3014c8cd4254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape32a9d4d-57') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d7b11762-9244-481b-87dd-757782d68101] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape32a9d4d-57, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape32a9d4d-57, col_values=(('external_ids', {'iface-id': 'e32a9d4d-57df-4765-b5be-12cea8621fce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:c4:37', 'vm-uuid': '32d3fdfc-82ad-46ee-b673-4e73f43b85e7'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d7b11762-9244-481b-87dd-757782d68101] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:39:13 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d7b11762-9244-481b-87dd-757782d68101] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:13 user nova-compute[73258]: INFO os_vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:c4:37,bridge_name='br-int',has_traffic_filtering=True,id=e32a9d4d-57df-4765-b5be-12cea8621fce,network=Network(d1088fa3-bbf4-4136-b3bd-3014c8cd4254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape32a9d4d-57')
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "783f5103-a178-42e0-a3b0-f523ca4c9439", "address": "fa:16:3e:4d:78:05", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap783f5103-a1", "ovs_interfaceid": "783f5103-a178-42e0-a3b0-f523ca4c9439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "783f5103-a178-42e0-a3b0-f523ca4c9439", "address": "fa:16:3e:4d:78:05", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap783f5103-a1", "ovs_interfaceid": "783f5103-a178-42e0-a3b0-f523ca4c9439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:78:05,bridge_name='br-int',has_traffic_filtering=True,id=783f5103-a178-42e0-a3b0-f523ca4c9439,network=Network(d1088fa3-bbf4-4136-b3bd-3014c8cd4254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap783f5103-a1') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG os_vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:78:05,bridge_name='br-int',has_traffic_filtering=True,id=783f5103-a178-42e0-a3b0-f523ca4c9439,network=Network(d1088fa3-bbf4-4136-b3bd-3014c8cd4254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap783f5103-a1') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap783f5103-a1, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap783f5103-a1, col_values=(('external_ids', {'iface-id': '783f5103-a178-42e0-a3b0-f523ca4c9439', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:78:05', 'vm-uuid': '32d3fdfc-82ad-46ee-b673-4e73f43b85e7'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:13 user nova-compute[73258]: INFO nova.compute.manager [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Took 12.34 seconds to spawn the instance on the hypervisor.
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:13 user nova-compute[73258]: INFO os_vif [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:78:05,bridge_name='br-int',has_traffic_filtering=True,id=783f5103-a178-42e0-a3b0-f523ca4c9439,network=Network(d1088fa3-bbf4-4136-b3bd-3014c8cd4254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap783f5103-a1')
Aug 27 06:39:13 user nova-compute[73258]: INFO nova.compute.manager [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Took 53.33 seconds to build instance.
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-384e3fbf-506e-42cb-8050-e05c2ee95749 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-384e3fbf-506e-42cb-8050-e05c2ee95749 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:13 user nova-compute[73258]: WARNING nova.compute.manager [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-384e3fbf-506e-42cb-8050-e05c2ee95749 for instance with vm_state active and task_state None.
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-87427dc4-15ba-4179-999a-217c5eef5fd3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-87427dc4-15ba-4179-999a-217c5eef5fd3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:13 user nova-compute[73258]: WARNING nova.compute.manager [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-87427dc4-15ba-4179-999a-217c5eef5fd3 for instance with vm_state active and task_state None.
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Received event network-changed-9210c142-099e-4af9-b48b-fc0e3ddcdc23 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Refreshing instance network info cache due to event network-changed-9210c142-099e-4af9-b48b-fc0e3ddcdc23. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] Acquiring lock "refresh_cache-e76827f8-dbbf-45fa-a84e-7f5dd0c62912" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] Acquired lock "refresh_cache-e76827f8-dbbf-45fa-a84e-7f5dd0c62912" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.network.neutron [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Refreshing network info cache for port 9210c142-099e-4af9-b48b-fc0e3ddcdc23 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9af5513f-9910-44c9-9662-4404c22e4f7a tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "d7b11762-9244-481b-87dd-757782d68101" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 53.438s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] No BDM found with device name hda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] No VIF found with MAC fa:16:3e:05:21:15, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] No VIF found with MAC fa:16:3e:a0:a3:84, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:39:13 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Using config drive
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.network.neutron [req-47eb6ef2-6155-4a96-be93-615ea10ead6d req-055569ce-c1d6-4714-b90b-77f66a196b81 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Updated VIF entry in instance network info cache for port 5d69f70a-cd94-4b7b-abc9-652fc681c98b. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.network.neutron [req-47eb6ef2-6155-4a96-be93-615ea10ead6d req-055569ce-c1d6-4714-b90b-77f66a196b81 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Updating instance_info_cache with network_info: [{"id": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "address": "fa:16:3e:f1:e9:0f", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d69f70a-cd", "ovs_interfaceid": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-47eb6ef2-6155-4a96-be93-615ea10ead6d req-055569ce-c1d6-4714-b90b-77f66a196b81 service nova] Releasing lock "refresh_cache-33b995be-307d-4491-a1b4-fb75ececea1d" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:39:13 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Creating config drive at /opt/stack/data/nova/instances/32d3fdfc-82ad-46ee-b673-4e73f43b85e7/disk.config
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/32d3fdfc-82ad-46ee-b673-4e73f43b85e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph00y521e {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/32d3fdfc-82ad-46ee-b673-4e73f43b85e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph00y521e" returned: 0 in 0.056s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "3ad98f0c-e26f-4913-bf49-755cd63ece60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "3ad98f0c-e26f-4913-bf49-755cd63ece60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:39:13 user nova-compute[73258]: INFO nova.compute.claims [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Claim successful on node user
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.network.neutron [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Updated VIF entry in instance network info cache for port 9210c142-099e-4af9-b48b-fc0e3ddcdc23. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.network.neutron [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Updating instance_info_cache with network_info: [{"id": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "address": "fa:16:3e:f8:77:a4", "network": {"id": "3819e7d4-2dc4-42e1-b2d6-8db84f0bb603", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-44170955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef630acc68949fd914df77f6cde70d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9210c142-09", "ovs_interfaceid": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] Releasing lock "refresh_cache-e76827f8-dbbf-45fa-a84e-7f5dd0c62912" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-87427dc4-15ba-4179-999a-217c5eef5fd3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-87427dc4-15ba-4179-999a-217c5eef5fd3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:13 user nova-compute[73258]: WARNING nova.compute.manager [req-85f41c23-f733-4d1f-b3a4-70985e85bea9 req-674709f2-cf52-44f7-bf40-b983ea51c1df service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-87427dc4-15ba-4179-999a-217c5eef5fd3 for instance with vm_state active and task_state None.
Aug 27 06:39:14 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG nova.network.neutron [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:39:14 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:39:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG nova.policy [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd74559df08d44e298ba6e2ccbaaefae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43f32eaadfd4f7eacc418385cc5e474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:39:14 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Creating image(s)
Aug 27 06:39:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "/opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "/opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.227s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.207s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/disk 1073741824" returned: 0 in 0.055s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG nova.network.neutron [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Successfully created port: be5db165-8b27-41aa-b600-d5cae17b3739 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.239s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Cannot resize image /opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Ensure instance console log exists: /opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-cd3c9d6f-1eda-44e2-b81a-8d3cfa39cb35 req-ec12e937-67bc-4a4d-b954-015e4884faf8 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-59275472-b18f-4e4b-922f-475dd553833c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cd3c9d6f-1eda-44e2-b81a-8d3cfa39cb35 req-ec12e937-67bc-4a4d-b954-015e4884faf8 service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cd3c9d6f-1eda-44e2-b81a-8d3cfa39cb35 req-ec12e937-67bc-4a4d-b954-015e4884faf8 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cd3c9d6f-1eda-44e2-b81a-8d3cfa39cb35 req-ec12e937-67bc-4a4d-b954-015e4884faf8 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-cd3c9d6f-1eda-44e2-b81a-8d3cfa39cb35 req-ec12e937-67bc-4a4d-b954-015e4884faf8 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-59275472-b18f-4e4b-922f-475dd553833c {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:15 user nova-compute[73258]: WARNING nova.compute.manager [req-cd3c9d6f-1eda-44e2-b81a-8d3cfa39cb35 req-ec12e937-67bc-4a4d-b954-015e4884faf8 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-59275472-b18f-4e4b-922f-475dd553833c for instance with vm_state building and task_state spawning.
Aug 27 06:39:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "33b995be-307d-4491-a1b4-fb75ececea1d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "33b995be-307d-4491-a1b4-fb75ececea1d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG nova.objects.instance [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lazy-loading 'flavor' on Instance uuid 33b995be-307d-4491-a1b4-fb75ececea1d {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "33b995be-307d-4491-a1b4-fb75ececea1d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.compute.manager [req-a6481a1c-af3c-4433-a763-d309cec2475f req-8461a679-7238-4eaf-896b-1dee4d7a12ee service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-e5820add-1974-4f6c-873e-ef179593b46a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a6481a1c-af3c-4433-a763-d309cec2475f req-8461a679-7238-4eaf-896b-1dee4d7a12ee service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a6481a1c-af3c-4433-a763-d309cec2475f req-8461a679-7238-4eaf-896b-1dee4d7a12ee service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a6481a1c-af3c-4433-a763-d309cec2475f req-8461a679-7238-4eaf-896b-1dee4d7a12ee service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.compute.manager [req-a6481a1c-af3c-4433-a763-d309cec2475f req-8461a679-7238-4eaf-896b-1dee4d7a12ee service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-e5820add-1974-4f6c-873e-ef179593b46a {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:16 user nova-compute[73258]: WARNING nova.compute.manager [req-a6481a1c-af3c-4433-a763-d309cec2475f req-8461a679-7238-4eaf-896b-1dee4d7a12ee service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-e5820add-1974-4f6c-873e-ef179593b46a for instance with vm_state building and task_state spawning.
Aug 27 06:39:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "33b995be-307d-4491-a1b4-fb75ececea1d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "33b995be-307d-4491-a1b4-fb75ececea1d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:16 user nova-compute[73258]: INFO nova.compute.manager [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Attaching volume 78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 to /dev/vdb
Aug 27 06:39:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.network.neutron [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Successfully updated port: be5db165-8b27-41aa-b600-d5cae17b3739 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "refresh_cache-3ad98f0c-e26f-4913-bf49-755cd63ece60" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquired lock "refresh_cache-3ad98f0c-e26f-4913-bf49-755cd63ece60" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.network.neutron [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.compute.manager [req-f5fe8031-0eb7-4a21-b896-42cb513ea0ab req-dd3244b3-3623-4347-ab88-275d159d6810 service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Received event network-changed-be5db165-8b27-41aa-b600-d5cae17b3739 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.compute.manager [req-f5fe8031-0eb7-4a21-b896-42cb513ea0ab req-dd3244b3-3623-4347-ab88-275d159d6810 service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Refreshing instance network info cache due to event network-changed-be5db165-8b27-41aa-b600-d5cae17b3739. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f5fe8031-0eb7-4a21-b896-42cb513ea0ab req-dd3244b3-3623-4347-ab88-275d159d6810 service nova] Acquiring lock "refresh_cache-3ad98f0c-e26f-4913-bf49-755cd63ece60" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG os_brick.utils [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c049b41d-510a-4d86-9611-8fdd3340a552]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.network.neutron [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9e9649-d0cd-4063-8d9c-d38991ee20c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[26427926-5a7b-4d60-86c7-75b03213c1cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[973502f5-a4fd-4f0f-84a3-2f837ac4b19d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:39:16 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa75453-5a32-4dd4-ae44-d50e79292132]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG os_brick.utils [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Updating existing volume attachment record: 92bae814-8e4e-4d25-8a2d-655ccc60998c {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Acquiring lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.objects.instance [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lazy-loading 'flavor' on Instance uuid e76827f8-dbbf-45fa-a84e-7f5dd0c62912 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.network.neutron [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Updating instance_info_cache with network_info: [{"id": "be5db165-8b27-41aa-b600-d5cae17b3739", "address": "fa:16:3e:1f:f3:8c", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5db165-8b", "ovs_interfaceid": "be5db165-8b27-41aa-b600-d5cae17b3739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Releasing lock "refresh_cache-3ad98f0c-e26f-4913-bf49-755cd63ece60" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Instance network_info: |[{"id": "be5db165-8b27-41aa-b600-d5cae17b3739", "address": "fa:16:3e:1f:f3:8c", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5db165-8b", "ovs_interfaceid": "be5db165-8b27-41aa-b600-d5cae17b3739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f5fe8031-0eb7-4a21-b896-42cb513ea0ab req-dd3244b3-3623-4347-ab88-275d159d6810 service nova] Acquired lock "refresh_cache-3ad98f0c-e26f-4913-bf49-755cd63ece60" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.network.neutron [req-f5fe8031-0eb7-4a21-b896-42cb513ea0ab req-dd3244b3-3623-4347-ab88-275d159d6810 service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Refreshing network info cache for port be5db165-8b27-41aa-b600-d5cae17b3739 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Start _get_guest_xml network_info=[{"id": "be5db165-8b27-41aa-b600-d5cae17b3739", "address": "fa:16:3e:1f:f3:8c", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5db165-8b", "ovs_interfaceid": "be5db165-8b27-41aa-b600-d5cae17b3739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:39:16 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:39:16 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:39:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:39:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1198913328',display_name='tempest-AttachVolumeNegativeTest-server-1198913328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1198913328',id=13,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSv9f865BAjjL/VrtPAy26T1z8cZ8RXLF7lXF9lveH5S3xpAfUQM7e5rY9AKjWCh8N1w1VYX9/tVOJ7rAh3cN4xomVK7wGcgkVxgNExnP6lVsEfI6+GQiRzuJd/+YMnIQ==',key_name='tempest-keypair-1732221652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f43f32eaadfd4f7eacc418385cc5e474',ramdisk_id='',reservation_id='r-0fqxnv7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-537954646',owner_user_name='tempest-AttachVolumeNegativeTest-537954646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:39:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd74559df08d44e298ba6e2ccbaaefae',uuid=3ad98f0c-e26f-4913-bf49-755cd63ece60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be5db165-8b27-41aa-b600-d5cae17b3739", "address": "fa:16:3e:1f:f3:8c", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5db165-8b", "ovs_interfaceid": "be5db165-8b27-41aa-b600-d5cae17b3739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converting VIF {"id": "be5db165-8b27-41aa-b600-d5cae17b3739", "address": "fa:16:3e:1f:f3:8c", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5db165-8b", "ovs_interfaceid": "be5db165-8b27-41aa-b600-d5cae17b3739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:f3:8c,bridge_name='br-int',has_traffic_filtering=True,id=be5db165-8b27-41aa-b600-d5cae17b3739,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe5db165-8b') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.objects.instance [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ad98f0c-e26f-4913-bf49-755cd63ece60 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:39:17 user nova-compute[73258]:   <uuid>3ad98f0c-e26f-4913-bf49-755cd63ece60</uuid>
Aug 27 06:39:17 user nova-compute[73258]:   <name>instance-0000000d</name>
Aug 27 06:39:17 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:39:17 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:39:17 user nova-compute[73258]:   <metadata>
Aug 27 06:39:17 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:39:17 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:39:17 user nova-compute[73258]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1198913328</nova:name>
Aug 27 06:39:17 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:39:16</nova:creationTime>
Aug 27 06:39:17 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:39:17 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:39:17 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:39:17 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:39:17 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:39:17 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:39:17 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:39:17 user nova-compute[73258]:       <nova:owner>
Aug 27 06:39:17 user nova-compute[73258]:         <nova:user uuid="fd74559df08d44e298ba6e2ccbaaefae">tempest-AttachVolumeNegativeTest-537954646-project-member</nova:user>
Aug 27 06:39:17 user nova-compute[73258]:         <nova:project uuid="f43f32eaadfd4f7eacc418385cc5e474">tempest-AttachVolumeNegativeTest-537954646</nova:project>
Aug 27 06:39:17 user nova-compute[73258]:       </nova:owner>
Aug 27 06:39:17 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:39:17 user nova-compute[73258]:       <nova:ports>
Aug 27 06:39:17 user nova-compute[73258]:         <nova:port uuid="be5db165-8b27-41aa-b600-d5cae17b3739">
Aug 27 06:39:17 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 06:39:17 user nova-compute[73258]:         </nova:port>
Aug 27 06:39:17 user nova-compute[73258]:       </nova:ports>
Aug 27 06:39:17 user nova-compute[73258]:     </nova:instance>
Aug 27 06:39:17 user nova-compute[73258]:   </metadata>
Aug 27 06:39:17 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:39:17 user nova-compute[73258]:     <system>
Aug 27 06:39:17 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:39:17 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:39:17 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:39:17 user nova-compute[73258]:       <entry name="serial">3ad98f0c-e26f-4913-bf49-755cd63ece60</entry>
Aug 27 06:39:17 user nova-compute[73258]:       <entry name="uuid">3ad98f0c-e26f-4913-bf49-755cd63ece60</entry>
Aug 27 06:39:17 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:39:17 user nova-compute[73258]:     </system>
Aug 27 06:39:17 user nova-compute[73258]:   </sysinfo>
Aug 27 06:39:17 user nova-compute[73258]:   <os>
Aug 27 06:39:17 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:39:17 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:39:17 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:39:17 user nova-compute[73258]:   </os>
Aug 27 06:39:17 user nova-compute[73258]:   <features>
Aug 27 06:39:17 user nova-compute[73258]:     <acpi/>
Aug 27 06:39:17 user nova-compute[73258]:     <apic/>
Aug 27 06:39:17 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:39:17 user nova-compute[73258]:   </features>
Aug 27 06:39:17 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:39:17 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:39:17 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:39:17 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:39:17 user nova-compute[73258]:   </clock>
Aug 27 06:39:17 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:39:17 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:39:17 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:39:17 user nova-compute[73258]:   </cpu>
Aug 27 06:39:17 user nova-compute[73258]:   <devices>
Aug 27 06:39:17 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:39:17 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:39:17 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/disk"/>
Aug 27 06:39:17 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:39:17 user nova-compute[73258]:     </disk>
Aug 27 06:39:17 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:39:17 user nova-compute[73258]:       <mac address="fa:16:3e:1f:f3:8c"/>
Aug 27 06:39:17 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:39:17 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:39:17 user nova-compute[73258]:       <target dev="tapbe5db165-8b"/>
Aug 27 06:39:17 user nova-compute[73258]:     </interface>
Aug 27 06:39:17 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:39:17 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/console.log" append="off"/>
Aug 27 06:39:17 user nova-compute[73258]:     </serial>
Aug 27 06:39:17 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:39:17 user nova-compute[73258]:     <video>
Aug 27 06:39:17 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:39:17 user nova-compute[73258]:     </video>
Aug 27 06:39:17 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:39:17 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:39:17 user nova-compute[73258]:     </rng>
Aug 27 06:39:17 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:39:17 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:39:17 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:39:17 user nova-compute[73258]:     </memballoon>
Aug 27 06:39:17 user nova-compute[73258]:   </devices>
Aug 27 06:39:17 user nova-compute[73258]: </domain>
Aug 27 06:39:17 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:39:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1198913328',display_name='tempest-AttachVolumeNegativeTest-server-1198913328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1198913328',id=13,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSv9f865BAjjL/VrtPAy26T1z8cZ8RXLF7lXF9lveH5S3xpAfUQM7e5rY9AKjWCh8N1w1VYX9/tVOJ7rAh3cN4xomVK7wGcgkVxgNExnP6lVsEfI6+GQiRzuJd/+YMnIQ==',key_name='tempest-keypair-1732221652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f43f32eaadfd4f7eacc418385cc5e474',ramdisk_id='',reservation_id='r-0fqxnv7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-537954646',owner_user_name='tempest-AttachVolumeNegativeTest-537954646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:39:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd74559df08d44e298ba6e2ccbaaefae',uuid=3ad98f0c-e26f-4913-bf49-755cd63ece60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be5db165-8b27-41aa-b600-d5cae17b3739", "address": "fa:16:3e:1f:f3:8c", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5db165-8b", "ovs_interfaceid": "be5db165-8b27-41aa-b600-d5cae17b3739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converting VIF {"id": "be5db165-8b27-41aa-b600-d5cae17b3739", "address": "fa:16:3e:1f:f3:8c", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5db165-8b", "ovs_interfaceid": "be5db165-8b27-41aa-b600-d5cae17b3739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:f3:8c,bridge_name='br-int',has_traffic_filtering=True,id=be5db165-8b27-41aa-b600-d5cae17b3739,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe5db165-8b') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG os_vif [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:f3:8c,bridge_name='br-int',has_traffic_filtering=True,id=be5db165-8b27-41aa-b600-d5cae17b3739,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe5db165-8b') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Acquiring lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:17 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Attaching volume 676135ce-16ab-4bcd-b2a4-9c72996567b3 to /dev/sdc
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe5db165-8b, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe5db165-8b, col_values=(('external_ids', {'iface-id': 'be5db165-8b27-41aa-b600-d5cae17b3739', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:f3:8c', 'vm-uuid': '3ad98f0c-e26f-4913-bf49-755cd63ece60'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG os_brick.utils [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e390151-9652-43ae-ab1e-63a55bcb970f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad13a2bc-808a-437a-bdd5-cc62863f884a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:17 user nova-compute[73258]: INFO os_vif [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:f3:8c,bridge_name='br-int',has_traffic_filtering=True,id=be5db165-8b27-41aa-b600-d5cae17b3739,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe5db165-8b')
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[67166067-f4ac-4a9a-a943-0166fb39eae7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[425cb99e-4d6a-4da5-9c18-4a19b88f55f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:39:17 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8175969b-8f52-4053-b203-e2a1a16193c6]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG os_brick.utils [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Updating existing volume attachment record: e6636e3a-69da-4f91-b5cc-840ad130cbba {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] No VIF found with MAC fa:16:3e:1f:f3:8c, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-91ec0a01-16a0-4a0b-b475-9e7c399bb4aa req-0f1fc334-6d4c-4a4e-a213-db008466b1a1 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-59275472-b18f-4e4b-922f-475dd553833c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-91ec0a01-16a0-4a0b-b475-9e7c399bb4aa req-0f1fc334-6d4c-4a4e-a213-db008466b1a1 service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-91ec0a01-16a0-4a0b-b475-9e7c399bb4aa req-0f1fc334-6d4c-4a4e-a213-db008466b1a1 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-91ec0a01-16a0-4a0b-b475-9e7c399bb4aa req-0f1fc334-6d4c-4a4e-a213-db008466b1a1 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-91ec0a01-16a0-4a0b-b475-9e7c399bb4aa req-0f1fc334-6d4c-4a4e-a213-db008466b1a1 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-59275472-b18f-4e4b-922f-475dd553833c {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:17 user nova-compute[73258]: WARNING nova.compute.manager [req-91ec0a01-16a0-4a0b-b475-9e7c399bb4aa req-0f1fc334-6d4c-4a4e-a213-db008466b1a1 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-59275472-b18f-4e4b-922f-475dd553833c for instance with vm_state building and task_state spawning.
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-91ec0a01-16a0-4a0b-b475-9e7c399bb4aa req-0f1fc334-6d4c-4a4e-a213-db008466b1a1 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-ff33d225-ef5e-4565-9278-4763c5b7ff6c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-91ec0a01-16a0-4a0b-b475-9e7c399bb4aa req-0f1fc334-6d4c-4a4e-a213-db008466b1a1 service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-91ec0a01-16a0-4a0b-b475-9e7c399bb4aa req-0f1fc334-6d4c-4a4e-a213-db008466b1a1 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-91ec0a01-16a0-4a0b-b475-9e7c399bb4aa req-0f1fc334-6d4c-4a4e-a213-db008466b1a1 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-91ec0a01-16a0-4a0b-b475-9e7c399bb4aa req-0f1fc334-6d4c-4a4e-a213-db008466b1a1 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-ff33d225-ef5e-4565-9278-4763c5b7ff6c {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:17 user nova-compute[73258]: WARNING nova.compute.manager [req-91ec0a01-16a0-4a0b-b475-9e7c399bb4aa req-0f1fc334-6d4c-4a4e-a213-db008466b1a1 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-ff33d225-ef5e-4565-9278-4763c5b7ff6c for instance with vm_state building and task_state spawning.
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-91ec0a01-16a0-4a0b-b475-9e7c399bb4aa req-0f1fc334-6d4c-4a4e-a213-db008466b1a1 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-ff33d225-ef5e-4565-9278-4763c5b7ff6c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-91ec0a01-16a0-4a0b-b475-9e7c399bb4aa req-0f1fc334-6d4c-4a4e-a213-db008466b1a1 service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-91ec0a01-16a0-4a0b-b475-9e7c399bb4aa req-0f1fc334-6d4c-4a4e-a213-db008466b1a1 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-91ec0a01-16a0-4a0b-b475-9e7c399bb4aa req-0f1fc334-6d4c-4a4e-a213-db008466b1a1 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-91ec0a01-16a0-4a0b-b475-9e7c399bb4aa req-0f1fc334-6d4c-4a4e-a213-db008466b1a1 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-ff33d225-ef5e-4565-9278-4763c5b7ff6c {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:17 user nova-compute[73258]: WARNING nova.compute.manager [req-91ec0a01-16a0-4a0b-b475-9e7c399bb4aa req-0f1fc334-6d4c-4a4e-a213-db008466b1a1 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-ff33d225-ef5e-4565-9278-4763c5b7ff6c for instance with vm_state building and task_state spawning.
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118342.9395127, bb57b63c-888f-40a0-88c0-97f63fd8297f => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:39:17 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] VM Stopped (Lifecycle Event)
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.compute.manager [None req-fff7791d-ae06-470d-bf8e-dbc4da1e1d3a None None] [instance: bb57b63c-888f-40a0-88c0-97f63fd8297f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:39:17 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118342.9806042, 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:39:17 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] VM Stopped (Lifecycle Event)
Aug 27 06:39:18 user nova-compute[73258]: DEBUG nova.compute.manager [None req-0cc4ee8e-18ec-4028-aad3-f426de84cd9a None None] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-e5820add-1974-4f6c-873e-ef179593b46a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-e5820add-1974-4f6c-873e-ef179593b46a {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:18 user nova-compute[73258]: WARNING nova.compute.manager [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-e5820add-1974-4f6c-873e-ef179593b46a for instance with vm_state building and task_state spawning.
Aug 27 06:39:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-e32a9d4d-57df-4765-b5be-12cea8621fce {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-e32a9d4d-57df-4765-b5be-12cea8621fce {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:18 user nova-compute[73258]: WARNING nova.compute.manager [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-e32a9d4d-57df-4765-b5be-12cea8621fce for instance with vm_state building and task_state spawning.
Aug 27 06:39:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-e32a9d4d-57df-4765-b5be-12cea8621fce {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-e32a9d4d-57df-4765-b5be-12cea8621fce {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:18 user nova-compute[73258]: WARNING nova.compute.manager [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-e32a9d4d-57df-4765-b5be-12cea8621fce for instance with vm_state building and task_state spawning.
Aug 27 06:39:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-783f5103-a178-42e0-a3b0-f523ca4c9439 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-783f5103-a178-42e0-a3b0-f523ca4c9439 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:18 user nova-compute[73258]: WARNING nova.compute.manager [req-e10d38ac-715a-44e0-880b-e2f4cbf7c064 req-ea46d4da-8515-423c-8996-cf3abd125374 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-783f5103-a178-42e0-a3b0-f523ca4c9439 for instance with vm_state building and task_state spawning.
Aug 27 06:39:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-e5dc16ec-b030-4c5f-89c1-af8b7d51a31e req-6f6d4c30-02d9-45ad-b8b7-50fd5fe4250c service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-e481124c-b62d-4fc9-9f02-ba38c027180e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e5dc16ec-b030-4c5f-89c1-af8b7d51a31e req-6f6d4c30-02d9-45ad-b8b7-50fd5fe4250c service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e5dc16ec-b030-4c5f-89c1-af8b7d51a31e req-6f6d4c30-02d9-45ad-b8b7-50fd5fe4250c service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e5dc16ec-b030-4c5f-89c1-af8b7d51a31e req-6f6d4c30-02d9-45ad-b8b7-50fd5fe4250c service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-e5dc16ec-b030-4c5f-89c1-af8b7d51a31e req-6f6d4c30-02d9-45ad-b8b7-50fd5fe4250c service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-e481124c-b62d-4fc9-9f02-ba38c027180e {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:18 user nova-compute[73258]: WARNING nova.compute.manager [req-e5dc16ec-b030-4c5f-89c1-af8b7d51a31e req-6f6d4c30-02d9-45ad-b8b7-50fd5fe4250c service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-e481124c-b62d-4fc9-9f02-ba38c027180e for instance with vm_state building and task_state spawning.
Aug 27 06:39:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-e5dc16ec-b030-4c5f-89c1-af8b7d51a31e req-6f6d4c30-02d9-45ad-b8b7-50fd5fe4250c service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-e481124c-b62d-4fc9-9f02-ba38c027180e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e5dc16ec-b030-4c5f-89c1-af8b7d51a31e req-6f6d4c30-02d9-45ad-b8b7-50fd5fe4250c service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e5dc16ec-b030-4c5f-89c1-af8b7d51a31e req-6f6d4c30-02d9-45ad-b8b7-50fd5fe4250c service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e5dc16ec-b030-4c5f-89c1-af8b7d51a31e req-6f6d4c30-02d9-45ad-b8b7-50fd5fe4250c service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-e5dc16ec-b030-4c5f-89c1-af8b7d51a31e req-6f6d4c30-02d9-45ad-b8b7-50fd5fe4250c service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-e481124c-b62d-4fc9-9f02-ba38c027180e {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:18 user nova-compute[73258]: WARNING nova.compute.manager [req-e5dc16ec-b030-4c5f-89c1-af8b7d51a31e req-6f6d4c30-02d9-45ad-b8b7-50fd5fe4250c service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-e481124c-b62d-4fc9-9f02-ba38c027180e for instance with vm_state building and task_state spawning.
Aug 27 06:39:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-e5dc16ec-b030-4c5f-89c1-af8b7d51a31e req-6f6d4c30-02d9-45ad-b8b7-50fd5fe4250c service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-0914d88d-1909-4bcb-a776-37af31e16b9e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e5dc16ec-b030-4c5f-89c1-af8b7d51a31e req-6f6d4c30-02d9-45ad-b8b7-50fd5fe4250c service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e5dc16ec-b030-4c5f-89c1-af8b7d51a31e req-6f6d4c30-02d9-45ad-b8b7-50fd5fe4250c service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e5dc16ec-b030-4c5f-89c1-af8b7d51a31e req-6f6d4c30-02d9-45ad-b8b7-50fd5fe4250c service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-e5dc16ec-b030-4c5f-89c1-af8b7d51a31e req-6f6d4c30-02d9-45ad-b8b7-50fd5fe4250c service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-0914d88d-1909-4bcb-a776-37af31e16b9e {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:18 user nova-compute[73258]: WARNING nova.compute.manager [req-e5dc16ec-b030-4c5f-89c1-af8b7d51a31e req-6f6d4c30-02d9-45ad-b8b7-50fd5fe4250c service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-0914d88d-1909-4bcb-a776-37af31e16b9e for instance with vm_state building and task_state spawning.
Aug 27 06:39:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG nova.network.neutron [req-f5fe8031-0eb7-4a21-b896-42cb513ea0ab req-dd3244b3-3623-4347-ab88-275d159d6810 service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Updated VIF entry in instance network info cache for port be5db165-8b27-41aa-b600-d5cae17b3739. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG nova.network.neutron [req-f5fe8031-0eb7-4a21-b896-42cb513ea0ab req-dd3244b3-3623-4347-ab88-275d159d6810 service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Updating instance_info_cache with network_info: [{"id": "be5db165-8b27-41aa-b600-d5cae17b3739", "address": "fa:16:3e:1f:f3:8c", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5db165-8b", "ovs_interfaceid": "be5db165-8b27-41aa-b600-d5cae17b3739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f5fe8031-0eb7-4a21-b896-42cb513ea0ab req-dd3244b3-3623-4347-ab88-275d159d6810 service nova] Releasing lock "refresh_cache-3ad98f0c-e26f-4913-bf49-755cd63ece60" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:39:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquiring lock "interface-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "interface-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:19 user nova-compute[73258]: DEBUG nova.objects.instance [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lazy-loading 'flavor' on Instance uuid 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-a03a8394-b6ca-44b5-a559-3b551f8f3061 req-1dbc1db0-b01a-4796-b270-26ddf3d073ad service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-783f5103-a178-42e0-a3b0-f523ca4c9439 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a03a8394-b6ca-44b5-a559-3b551f8f3061 req-1dbc1db0-b01a-4796-b270-26ddf3d073ad service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a03a8394-b6ca-44b5-a559-3b551f8f3061 req-1dbc1db0-b01a-4796-b270-26ddf3d073ad service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a03a8394-b6ca-44b5-a559-3b551f8f3061 req-1dbc1db0-b01a-4796-b270-26ddf3d073ad service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-a03a8394-b6ca-44b5-a559-3b551f8f3061 req-1dbc1db0-b01a-4796-b270-26ddf3d073ad service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-783f5103-a178-42e0-a3b0-f523ca4c9439 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:20 user nova-compute[73258]: WARNING nova.compute.manager [req-a03a8394-b6ca-44b5-a559-3b551f8f3061 req-1dbc1db0-b01a-4796-b270-26ddf3d073ad service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-783f5103-a178-42e0-a3b0-f523ca4c9439 for instance with vm_state building and task_state spawning.
Aug 27 06:39:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-a03a8394-b6ca-44b5-a559-3b551f8f3061 req-1dbc1db0-b01a-4796-b270-26ddf3d073ad service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Received event network-vif-plugged-be5db165-8b27-41aa-b600-d5cae17b3739 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a03a8394-b6ca-44b5-a559-3b551f8f3061 req-1dbc1db0-b01a-4796-b270-26ddf3d073ad service nova] Acquiring lock "3ad98f0c-e26f-4913-bf49-755cd63ece60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a03a8394-b6ca-44b5-a559-3b551f8f3061 req-1dbc1db0-b01a-4796-b270-26ddf3d073ad service nova] Lock "3ad98f0c-e26f-4913-bf49-755cd63ece60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a03a8394-b6ca-44b5-a559-3b551f8f3061 req-1dbc1db0-b01a-4796-b270-26ddf3d073ad service nova] Lock "3ad98f0c-e26f-4913-bf49-755cd63ece60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-a03a8394-b6ca-44b5-a559-3b551f8f3061 req-1dbc1db0-b01a-4796-b270-26ddf3d073ad service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] No waiting events found dispatching network-vif-plugged-be5db165-8b27-41aa-b600-d5cae17b3739 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:20 user nova-compute[73258]: WARNING nova.compute.manager [req-a03a8394-b6ca-44b5-a559-3b551f8f3061 req-1dbc1db0-b01a-4796-b270-26ddf3d073ad service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Received unexpected event network-vif-plugged-be5db165-8b27-41aa-b600-d5cae17b3739 for instance with vm_state building and task_state spawning.
Aug 27 06:39:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-a03a8394-b6ca-44b5-a559-3b551f8f3061 req-1dbc1db0-b01a-4796-b270-26ddf3d073ad service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Received event network-vif-plugged-be5db165-8b27-41aa-b600-d5cae17b3739 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a03a8394-b6ca-44b5-a559-3b551f8f3061 req-1dbc1db0-b01a-4796-b270-26ddf3d073ad service nova] Acquiring lock "3ad98f0c-e26f-4913-bf49-755cd63ece60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a03a8394-b6ca-44b5-a559-3b551f8f3061 req-1dbc1db0-b01a-4796-b270-26ddf3d073ad service nova] Lock "3ad98f0c-e26f-4913-bf49-755cd63ece60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a03a8394-b6ca-44b5-a559-3b551f8f3061 req-1dbc1db0-b01a-4796-b270-26ddf3d073ad service nova] Lock "3ad98f0c-e26f-4913-bf49-755cd63ece60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-a03a8394-b6ca-44b5-a559-3b551f8f3061 req-1dbc1db0-b01a-4796-b270-26ddf3d073ad service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] No waiting events found dispatching network-vif-plugged-be5db165-8b27-41aa-b600-d5cae17b3739 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:20 user nova-compute[73258]: WARNING nova.compute.manager [req-a03a8394-b6ca-44b5-a559-3b551f8f3061 req-1dbc1db0-b01a-4796-b270-26ddf3d073ad service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Received unexpected event network-vif-plugged-be5db165-8b27-41aa-b600-d5cae17b3739 for instance with vm_state building and task_state spawning.
Aug 27 06:39:20 user nova-compute[73258]: DEBUG nova.objects.instance [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lazy-loading 'pci_requests' on Instance uuid 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG nova.objects.base [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Object Instance<70af3b5e-3a68-41b3-9f92-2b3a36a9d21e> lazy-loaded attributes: flavor,pci_requests {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG nova.network.neutron [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG nova.policy [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53ae2b77bfcf461fbc01429ee1f052b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3fc6b23bb4467891da7bc8a1b4ae49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-90048b2c-6957-412a-9869-768448558e9f req-fa1cd91f-56b4-4533-a6e6-261228ddad41 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-0914d88d-1909-4bcb-a776-37af31e16b9e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-90048b2c-6957-412a-9869-768448558e9f req-fa1cd91f-56b4-4533-a6e6-261228ddad41 service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-90048b2c-6957-412a-9869-768448558e9f req-fa1cd91f-56b4-4533-a6e6-261228ddad41 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-90048b2c-6957-412a-9869-768448558e9f req-fa1cd91f-56b4-4533-a6e6-261228ddad41 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-90048b2c-6957-412a-9869-768448558e9f req-fa1cd91f-56b4-4533-a6e6-261228ddad41 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-0914d88d-1909-4bcb-a776-37af31e16b9e {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:20 user nova-compute[73258]: WARNING nova.compute.manager [req-90048b2c-6957-412a-9869-768448558e9f req-fa1cd91f-56b4-4533-a6e6-261228ddad41 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-0914d88d-1909-4bcb-a776-37af31e16b9e for instance with vm_state building and task_state spawning.
Aug 27 06:39:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-90048b2c-6957-412a-9869-768448558e9f req-fa1cd91f-56b4-4533-a6e6-261228ddad41 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received event network-changed-e84fffb7-b665-47d1-a38c-525d4ada5d39 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-90048b2c-6957-412a-9869-768448558e9f req-fa1cd91f-56b4-4533-a6e6-261228ddad41 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Refreshing instance network info cache due to event network-changed-e84fffb7-b665-47d1-a38c-525d4ada5d39. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-90048b2c-6957-412a-9869-768448558e9f req-fa1cd91f-56b4-4533-a6e6-261228ddad41 service nova] Acquiring lock "refresh_cache-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-90048b2c-6957-412a-9869-768448558e9f req-fa1cd91f-56b4-4533-a6e6-261228ddad41 service nova] Acquired lock "refresh_cache-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG nova.network.neutron [req-90048b2c-6957-412a-9869-768448558e9f req-fa1cd91f-56b4-4533-a6e6-261228ddad41 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Refreshing network info cache for port e84fffb7-b665-47d1-a38c-525d4ada5d39 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG nova.network.neutron [req-90048b2c-6957-412a-9869-768448558e9f req-fa1cd91f-56b4-4533-a6e6-261228ddad41 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Updated VIF entry in instance network info cache for port e84fffb7-b665-47d1-a38c-525d4ada5d39. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:39:20 user nova-compute[73258]: DEBUG nova.network.neutron [req-90048b2c-6957-412a-9869-768448558e9f req-fa1cd91f-56b4-4533-a6e6-261228ddad41 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Updating instance_info_cache with network_info: [{"id": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "address": "fa:16:3e:9e:b0:e1", "network": {"id": "9bc98272-6eb0-4ce7-ba14-721aa5b74a67", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-969683990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape84fffb7-b6", "ovs_interfaceid": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.network.neutron [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Successfully created port: 273cab8f-39af-492b-93a6-6a9450168431 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-90048b2c-6957-412a-9869-768448558e9f req-fa1cd91f-56b4-4533-a6e6-261228ddad41 service nova] Releasing lock "refresh_cache-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118361.4301834, 32d3fdfc-82ad-46ee-b673-4e73f43b85e7 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:39:21 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] VM Resumed (Lifecycle Event)
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:39:21 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Instance spawned successfully.
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:39:21 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118361.432161, 32d3fdfc-82ad-46ee-b673-4e73f43b85e7 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:39:21 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] VM Started (Lifecycle Event)
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:39:21 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:39:21 user nova-compute[73258]: INFO nova.compute.manager [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Took 16.86 seconds to spawn the instance on the hypervisor.
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:39:21 user nova-compute[73258]: INFO nova.compute.manager [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Took 58.67 seconds to build instance.
Aug 27 06:39:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28c2119-6df0-415b-9866-024ee6be18fa tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 58.776s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.network.neutron [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Successfully updated port: 273cab8f-39af-492b-93a6-6a9450168431 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquiring lock "refresh_cache-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquired lock "refresh_cache-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.network.neutron [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118361.9528794, 3ad98f0c-e26f-4913-bf49-755cd63ece60 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:39:21 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] VM Resumed (Lifecycle Event)
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:39:21 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Instance spawned successfully.
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:39:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:39:22 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:39:22 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118361.9593456, 3ad98f0c-e26f-4913-bf49-755cd63ece60 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:39:22 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] VM Started (Lifecycle Event)
Aug 27 06:39:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:22 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:39:22 user nova-compute[73258]: INFO nova.compute.manager [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Took 7.62 seconds to spawn the instance on the hypervisor.
Aug 27 06:39:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:39:22 user nova-compute[73258]: INFO nova.compute.manager [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Took 8.47 seconds to build instance.
Aug 27 06:39:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8fb97191-f30d-49d3-a31c-853f13afdd31 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "3ad98f0c-e26f-4913-bf49-755cd63ece60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.569s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG nova.compute.manager [req-7b054e6e-54d7-473f-b75d-d4fd503ad454 req-fdd2a714-1bb4-49ea-ab95-9e2f9129321f service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received event network-changed-273cab8f-39af-492b-93a6-6a9450168431 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG nova.compute.manager [req-7b054e6e-54d7-473f-b75d-d4fd503ad454 req-fdd2a714-1bb4-49ea-ab95-9e2f9129321f service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Refreshing instance network info cache due to event network-changed-273cab8f-39af-492b-93a6-6a9450168431. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7b054e6e-54d7-473f-b75d-d4fd503ad454 req-fdd2a714-1bb4-49ea-ab95-9e2f9129321f service nova] Acquiring lock "refresh_cache-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG nova.network.neutron [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Updating instance_info_cache with network_info: [{"id": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "address": "fa:16:3e:9e:b0:e1", "network": {"id": "9bc98272-6eb0-4ce7-ba14-721aa5b74a67", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-969683990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape84fffb7-b6", "ovs_interfaceid": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "273cab8f-39af-492b-93a6-6a9450168431", "address": "fa:16:3e:27:44:fc", "network": {"id": "dca016fd-fde7-438c-8130-5024000345b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-182407527", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap273cab8f-39", "ovs_interfaceid": "273cab8f-39af-492b-93a6-6a9450168431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Releasing lock "refresh_cache-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7b054e6e-54d7-473f-b75d-d4fd503ad454 req-fdd2a714-1bb4-49ea-ab95-9e2f9129321f service nova] Acquired lock "refresh_cache-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG nova.network.neutron [req-7b054e6e-54d7-473f-b75d-d4fd503ad454 req-fdd2a714-1bb4-49ea-ab95-9e2f9129321f service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Refreshing network info cache for port 273cab8f-39af-492b-93a6-6a9450168431 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:37:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272504122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272504122',id=8,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyavg0YndUGAOgB67L8HRF7F2iikxrnrdEVXLpabs98eaA0ZuhB1u8SuP+LgJpkPNPLmHjFchg3jVefSbPuOz2/jsOg0UsGBCCfjGt2BWTYtT1VtCqWWdtqNXaQw6MrAw==',key_name='tempest-keypair-967100910',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:37:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ae3fc6b23bb4467891da7bc8a1b4ae49',ramdisk_id='',reservation_id='r-bpbfl8r5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-45928959',owner_user_name='tempest-TaggedAttachmentsTest-45928959-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53ae2b77bfcf461fbc01429ee1f052b8',uuid=70af3b5e-3a68-41b3-9f92-2b3a36a9d21e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "273cab8f-39af-492b-93a6-6a9450168431", "address": "fa:16:3e:27:44:fc", "network": {"id": "dca016fd-fde7-438c-8130-5024000345b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-182407527", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap273cab8f-39", "ovs_interfaceid": "273cab8f-39af-492b-93a6-6a9450168431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Converting VIF {"id": "273cab8f-39af-492b-93a6-6a9450168431", "address": "fa:16:3e:27:44:fc", "network": {"id": "dca016fd-fde7-438c-8130-5024000345b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-182407527", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap273cab8f-39", "ovs_interfaceid": "273cab8f-39af-492b-93a6-6a9450168431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:44:fc,bridge_name='br-int',has_traffic_filtering=True,id=273cab8f-39af-492b-93a6-6a9450168431,network=Network(dca016fd-fde7-438c-8130-5024000345b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap273cab8f-39') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG os_vif [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:44:fc,bridge_name='br-int',has_traffic_filtering=True,id=273cab8f-39af-492b-93a6-6a9450168431,network=Network(dca016fd-fde7-438c-8130-5024000345b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap273cab8f-39') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap273cab8f-39, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap273cab8f-39, col_values=(('external_ids', {'iface-id': '273cab8f-39af-492b-93a6-6a9450168431', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:44:fc', 'vm-uuid': '70af3b5e-3a68-41b3-9f92-2b3a36a9d21e'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:22 user nova-compute[73258]: INFO os_vif [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:44:fc,bridge_name='br-int',has_traffic_filtering=True,id=273cab8f-39af-492b-93a6-6a9450168431,network=Network(dca016fd-fde7-438c-8130-5024000345b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap273cab8f-39')
Aug 27 06:39:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:37:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272504122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272504122',id=8,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyavg0YndUGAOgB67L8HRF7F2iikxrnrdEVXLpabs98eaA0ZuhB1u8SuP+LgJpkPNPLmHjFchg3jVefSbPuOz2/jsOg0UsGBCCfjGt2BWTYtT1VtCqWWdtqNXaQw6MrAw==',key_name='tempest-keypair-967100910',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:37:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ae3fc6b23bb4467891da7bc8a1b4ae49',ramdisk_id='',reservation_id='r-bpbfl8r5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-45928959',owner_user_name='tempest-TaggedAttachmentsTest-45928959-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53ae2b77bfcf461fbc01429ee1f052b8',uuid=70af3b5e-3a68-41b3-9f92-2b3a36a9d21e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "273cab8f-39af-492b-93a6-6a9450168431", "address": "fa:16:3e:27:44:fc", "network": {"id": "dca016fd-fde7-438c-8130-5024000345b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-182407527", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap273cab8f-39", "ovs_interfaceid": "273cab8f-39af-492b-93a6-6a9450168431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Converting VIF {"id": "273cab8f-39af-492b-93a6-6a9450168431", "address": "fa:16:3e:27:44:fc", "network": {"id": "dca016fd-fde7-438c-8130-5024000345b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-182407527", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap273cab8f-39", "ovs_interfaceid": "273cab8f-39af-492b-93a6-6a9450168431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:44:fc,bridge_name='br-int',has_traffic_filtering=True,id=273cab8f-39af-492b-93a6-6a9450168431,network=Network(dca016fd-fde7-438c-8130-5024000345b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap273cab8f-39') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] attach device xml: <interface type="ethernet">
Aug 27 06:39:22 user nova-compute[73258]:   <mac address="fa:16:3e:27:44:fc"/>
Aug 27 06:39:22 user nova-compute[73258]:   <model type="virtio"/>
Aug 27 06:39:22 user nova-compute[73258]:   <mtu size="1442"/>
Aug 27 06:39:22 user nova-compute[73258]:   <target dev="tap273cab8f-39"/>
Aug 27 06:39:22 user nova-compute[73258]: </interface>
Aug 27 06:39:22 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] No BDM found with device name hda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] No VIF found with MAC fa:16:3e:9e:b0:e1, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG nova.compute.manager [req-ac4a42dd-abf0-4c5b-9ef6-f0acc87843b6 req-3b55e661-6513-4ebb-affd-3a499bf72386 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received event network-vif-plugged-273cab8f-39af-492b-93a6-6a9450168431 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ac4a42dd-abf0-4c5b-9ef6-f0acc87843b6 req-3b55e661-6513-4ebb-affd-3a499bf72386 service nova] Acquiring lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ac4a42dd-abf0-4c5b-9ef6-f0acc87843b6 req-3b55e661-6513-4ebb-affd-3a499bf72386 service nova] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ac4a42dd-abf0-4c5b-9ef6-f0acc87843b6 req-3b55e661-6513-4ebb-affd-3a499bf72386 service nova] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG nova.compute.manager [req-ac4a42dd-abf0-4c5b-9ef6-f0acc87843b6 req-3b55e661-6513-4ebb-affd-3a499bf72386 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] No waiting events found dispatching network-vif-plugged-273cab8f-39af-492b-93a6-6a9450168431 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:23 user nova-compute[73258]: WARNING nova.compute.manager [req-ac4a42dd-abf0-4c5b-9ef6-f0acc87843b6 req-3b55e661-6513-4ebb-affd-3a499bf72386 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received unexpected event network-vif-plugged-273cab8f-39af-492b-93a6-6a9450168431 for instance with vm_state active and task_state None.
Aug 27 06:39:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:39:23 user nova-compute[73258]:   <nova:package version="0.0.0"/>
Aug 27 06:39:23 user nova-compute[73258]:   <nova:name>tempest-device-tagging-server-272504122</nova:name>
Aug 27 06:39:23 user nova-compute[73258]:   <nova:creationTime>2023-08-27 06:39:23</nova:creationTime>
Aug 27 06:39:23 user nova-compute[73258]:   <nova:flavor name="m1.tiny">
Aug 27 06:39:23 user nova-compute[73258]:     <nova:memory>512</nova:memory>
Aug 27 06:39:23 user nova-compute[73258]:     <nova:disk>1</nova:disk>
Aug 27 06:39:23 user nova-compute[73258]:     <nova:swap>0</nova:swap>
Aug 27 06:39:23 user nova-compute[73258]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:39:23 user nova-compute[73258]:     <nova:vcpus>1</nova:vcpus>
Aug 27 06:39:23 user nova-compute[73258]:   </nova:flavor>
Aug 27 06:39:23 user nova-compute[73258]:   <nova:owner>
Aug 27 06:39:23 user nova-compute[73258]:     <nova:user uuid="53ae2b77bfcf461fbc01429ee1f052b8">tempest-TaggedAttachmentsTest-45928959-project-member</nova:user>
Aug 27 06:39:23 user nova-compute[73258]:     <nova:project uuid="ae3fc6b23bb4467891da7bc8a1b4ae49">tempest-TaggedAttachmentsTest-45928959</nova:project>
Aug 27 06:39:23 user nova-compute[73258]:   </nova:owner>
Aug 27 06:39:23 user nova-compute[73258]:   <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:39:23 user nova-compute[73258]:   <nova:ports>
Aug 27 06:39:23 user nova-compute[73258]:     <nova:port uuid="e84fffb7-b665-47d1-a38c-525d4ada5d39">
Aug 27 06:39:23 user nova-compute[73258]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 06:39:23 user nova-compute[73258]:     </nova:port>
Aug 27 06:39:23 user nova-compute[73258]:     <nova:port uuid="273cab8f-39af-492b-93a6-6a9450168431">
Aug 27 06:39:23 user nova-compute[73258]:       <nova:ip type="fixed" address="10.10.10.198" ipVersion="4"/>
Aug 27 06:39:23 user nova-compute[73258]:     </nova:port>
Aug 27 06:39:23 user nova-compute[73258]:   </nova:ports>
Aug 27 06:39:23 user nova-compute[73258]: </nova:instance>
Aug 27 06:39:23 user nova-compute[73258]:  {{(pid=73258) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b5d7b8ec-9cce-4bb5-bf57-b335a994f245 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "interface-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.298s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG nova.network.neutron [req-7b054e6e-54d7-473f-b75d-d4fd503ad454 req-fdd2a714-1bb4-49ea-ab95-9e2f9129321f service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Updated VIF entry in instance network info cache for port 273cab8f-39af-492b-93a6-6a9450168431. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG nova.network.neutron [req-7b054e6e-54d7-473f-b75d-d4fd503ad454 req-fdd2a714-1bb4-49ea-ab95-9e2f9129321f service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Updating instance_info_cache with network_info: [{"id": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "address": "fa:16:3e:9e:b0:e1", "network": {"id": "9bc98272-6eb0-4ce7-ba14-721aa5b74a67", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-969683990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape84fffb7-b6", "ovs_interfaceid": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "273cab8f-39af-492b-93a6-6a9450168431", "address": "fa:16:3e:27:44:fc", "network": {"id": "dca016fd-fde7-438c-8130-5024000345b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-182407527", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap273cab8f-39", "ovs_interfaceid": "273cab8f-39af-492b-93a6-6a9450168431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7b054e6e-54d7-473f-b75d-d4fd503ad454 req-fdd2a714-1bb4-49ea-ab95-9e2f9129321f service nova] Releasing lock "refresh_cache-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquiring lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG nova.objects.instance [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lazy-loading 'flavor' on Instance uuid 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquiring lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:24 user nova-compute[73258]: INFO nova.compute.manager [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Attaching volume d9e66f21-a628-4c10-b733-1963fe016877 to /dev/vdb
Aug 27 06:39:24 user nova-compute[73258]: DEBUG os_brick.utils [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e176580-3842-44d2-9a2d-b3aecbfa3a1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[885483c2-62f2-43cd-8f5f-e565867a159f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a404078-1e91-4c20-b687-143bb999f0b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8719cd-941b-43c3-850f-081b978e7f6a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:39:24 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:39:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c0ea52-f84c-4985-9538-6838accb3728]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG os_brick.utils [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:24 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Updating existing volume attachment record: 2b245e40-9c04-44b1-93c6-0fff18da5f8b {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:39:25 user nova-compute[73258]: DEBUG nova.compute.manager [req-d22a96f3-ebdd-42e5-81b4-dd02cb85a866 req-3ed17fa4-a230-4ebf-89b4-9e02e674cc73 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received event network-vif-plugged-273cab8f-39af-492b-93a6-6a9450168431 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d22a96f3-ebdd-42e5-81b4-dd02cb85a866 req-3ed17fa4-a230-4ebf-89b4-9e02e674cc73 service nova] Acquiring lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d22a96f3-ebdd-42e5-81b4-dd02cb85a866 req-3ed17fa4-a230-4ebf-89b4-9e02e674cc73 service nova] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d22a96f3-ebdd-42e5-81b4-dd02cb85a866 req-3ed17fa4-a230-4ebf-89b4-9e02e674cc73 service nova] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:25 user nova-compute[73258]: DEBUG nova.compute.manager [req-d22a96f3-ebdd-42e5-81b4-dd02cb85a866 req-3ed17fa4-a230-4ebf-89b4-9e02e674cc73 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] No waiting events found dispatching network-vif-plugged-273cab8f-39af-492b-93a6-6a9450168431 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:25 user nova-compute[73258]: WARNING nova.compute.manager [req-d22a96f3-ebdd-42e5-81b4-dd02cb85a866 req-3ed17fa4-a230-4ebf-89b4-9e02e674cc73 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received unexpected event network-vif-plugged-273cab8f-39af-492b-93a6-6a9450168431 for instance with vm_state active and task_state None.
Aug 27 06:39:27 user nova-compute[73258]: DEBUG nova.compute.manager [req-6d9aa4db-f7d0-4b1c-8257-e4f596c64c7c req-6dbccee3-abfa-4ae4-b29e-cd326123cfa5 service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Received event network-changed-c40794f4-8107-411d-b2b9-541a4fc5072d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:27 user nova-compute[73258]: DEBUG nova.compute.manager [req-6d9aa4db-f7d0-4b1c-8257-e4f596c64c7c req-6dbccee3-abfa-4ae4-b29e-cd326123cfa5 service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Refreshing instance network info cache due to event network-changed-c40794f4-8107-411d-b2b9-541a4fc5072d. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:39:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6d9aa4db-f7d0-4b1c-8257-e4f596c64c7c req-6dbccee3-abfa-4ae4-b29e-cd326123cfa5 service nova] Acquiring lock "refresh_cache-b51f0635-3ec5-4623-9265-350033b778c6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:39:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6d9aa4db-f7d0-4b1c-8257-e4f596c64c7c req-6dbccee3-abfa-4ae4-b29e-cd326123cfa5 service nova] Acquired lock "refresh_cache-b51f0635-3ec5-4623-9265-350033b778c6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:39:27 user nova-compute[73258]: DEBUG nova.network.neutron [req-6d9aa4db-f7d0-4b1c-8257-e4f596c64c7c req-6dbccee3-abfa-4ae4-b29e-cd326123cfa5 service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Refreshing network info cache for port c40794f4-8107-411d-b2b9-541a4fc5072d {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:39:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:28 user nova-compute[73258]: DEBUG nova.network.neutron [req-6d9aa4db-f7d0-4b1c-8257-e4f596c64c7c req-6dbccee3-abfa-4ae4-b29e-cd326123cfa5 service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Updated VIF entry in instance network info cache for port c40794f4-8107-411d-b2b9-541a4fc5072d. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:39:28 user nova-compute[73258]: DEBUG nova.network.neutron [req-6d9aa4db-f7d0-4b1c-8257-e4f596c64c7c req-6dbccee3-abfa-4ae4-b29e-cd326123cfa5 service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Updating instance_info_cache with network_info: [{"id": "c40794f4-8107-411d-b2b9-541a4fc5072d", "address": "fa:16:3e:a6:3c:ca", "network": {"id": "e78617e0-56b0-4b80-bbd2-f370603e4cd3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508001975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a1937be8e045ab9d5e4f96128a60a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40794f4-81", "ovs_interfaceid": "c40794f4-8107-411d-b2b9-541a4fc5072d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:39:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6d9aa4db-f7d0-4b1c-8257-e4f596c64c7c req-6dbccee3-abfa-4ae4-b29e-cd326123cfa5 service nova] Releasing lock "refresh_cache-b51f0635-3ec5-4623-9265-350033b778c6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OksztxGb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:31 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:31 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:31 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e39066-05cd-435a-b01c-18377da844cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:39:31 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5d1c72-7124-48bb-8d35-791cad731a3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95] added
Aug 27 06:39:31 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6608e4d3-bb59-49b8-87e0-29672b565df2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6e9062-8524-462f-8c72-e0f1eb1b892b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OksztxGb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OksztxGb" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5eb8b5-4779-499f-83d0-f9fa545ce76a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OksztxGb'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a13613-59f6-4aa0-be9b-cdc2be8203d4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[693caf5e-773e-43ad-8a8b-471b0ea3658c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:31 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:31 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Acquiring lock "b51f0635-3ec5-4623-9265-350033b778c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Lock "b51f0635-3ec5-4623-9265-350033b778c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG nova.objects.instance [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Lazy-loading 'flavor' on Instance uuid b51f0635-3ec5-4623-9265-350033b778c6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --login" returned: 0 in 0.111s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce033a7-be13-420d-a849-8144252fb049]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95, portal: 172.16.0.220,3260]
Aug 27 06:39:31 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95, portal: 172.16.0.220,3260] successful.
Aug 27 06:39:31 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[22afd56c-70bb-4cd0-9c20-f788685756cb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Lock "b51f0635-3ec5-4623-9265-350033b778c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[402d7f01-c5e4-4f16-bf12-5df298371f4a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:31 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:31 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:31 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c63131-8b66-4be5-a3fd-f15a1327cdd9]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OksztxGb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Acquiring lock "b51f0635-3ec5-4623-9265-350033b778c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Lock "b51f0635-3ec5-4623-9265-350033b778c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:31 user nova-compute[73258]: INFO nova.compute.manager [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Attaching volume 37fb70de-891e-4761-a661-a1102ef49e43 to /dev/vdb
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.utils [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b965e3-1121-4cc1-823c-9b6b3113cfdc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e32e90-8c35-482b-ba8b-77d283444d64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b93776b-ca8a-4271-968b-608e2e3f6533]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce430bb4-d455-4cfb-a914-7446c574d818]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:39:32 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[13986bc9-4a16-499c-8171-2379dead08be]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.utils [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Updating existing volume attachment record: f95672a8-b1a5-4997-b05c-615f427b05fb {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPADCbkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:32 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '23664376334393135', 'path': '/dev/sdj'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664376334393135', 'path': '/dev/sdj'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.100s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:32 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:32 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG nova.objects.instance [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lazy-loading 'flavor' on Instance uuid 33b995be-307d-4491-a1b4-fb75ececea1d {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d594593-9245-48dc-9831-de5b4d92814c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:39:32 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:39:32 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:39:32 user nova-compute[73258]:   <source dev="/dev/sdj"/>
Aug 27 06:39:32 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:39:32 user nova-compute[73258]:   <serial>78078c75-4e7a-4c5f-a2e9-c87cdf38ee95</serial>
Aug 27 06:39:32 user nova-compute[73258]: </disk>
Aug 27 06:39:32 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73a926b-b101-48fa-93b7-91a785a6c15f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3] added
Aug 27 06:39:32 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5839a01-4240-4a2a-a4aa-2d91a944a4d2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9e8f43-afd7-4b9f-879f-81d4b53ddcbb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TPADCbkQ {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TPADCbkQ" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6fae40-fcf7-4eba-99b4-4de9f5de5f2f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TPADCbkQ'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[977a5f43-b1ee-4477-bd79-2e90781d10af]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dc73b0-b820-48a0-a17b-890319ac6f26]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:32 user nova-compute[73258]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 (non-flash)
Aug 27 06:39:32 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:32 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:32 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:32 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:32 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:32 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:32 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:32 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:32 user nova-compute[73258]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 (non-flash)
Aug 27 06:39:32 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:32 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:32 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:32 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:32 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:32 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:32 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:32 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5ad7b8-0f61-4a98-b929-e505057a3072]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3, portal: 172.16.0.220,3260]
Aug 27 06:39:33 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3, portal: 172.16.0.220,3260] successful.
Aug 27 06:39:33 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c352fbf5-4d8e-4120-bb9d-c840214b6c2f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a7f61d-3ab4-4e39-aee8-eedba9f6db8c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:33 user nova-compute[73258]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 (non-flash)
Aug 27 06:39:33 user nova-compute[73258]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 (non-flash)
Aug 27 06:39:33 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:33 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:33 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:33 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:33 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:33 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:33 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:33 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:33 user nova-compute[73258]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 (non-flash)
Aug 27 06:39:33 user nova-compute[73258]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 (non-flash)
Aug 27 06:39:33 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:33 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:33 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:33 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:33 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:33 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:33 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:33 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ae039d-46ca-4a0a-ae7a-c539599ec857]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPADCbkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] No VIF found with MAC fa:16:3e:f1:e9:0f, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:39:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-68793c2e-d5ff-467b-becb-ee76ad64530f tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "33b995be-307d-4491-a1b4-fb75ececea1d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.337s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] <== connect_volume: return (1496ms) {'type': 'block', 'scsi_wwn': '23462613334303830', 'path': '/dev/sdk'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462613334303830', 'path': '/dev/sdk'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:39:34 user nova-compute[73258]: DEBUG nova.objects.instance [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lazy-loading 'flavor' on Instance uuid e76827f8-dbbf-45fa-a84e-7f5dd0c62912 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:39:34 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:39:34 user nova-compute[73258]:   <source dev="/dev/sdk"/>
Aug 27 06:39:34 user nova-compute[73258]:   <target dev="sdc" bus="scsi"/>
Aug 27 06:39:34 user nova-compute[73258]:   <serial>676135ce-16ab-4bcd-b2a4-9c72996567b3</serial>
Aug 27 06:39:34 user nova-compute[73258]:   <address type="drive" controller="0" unit="2"/>
Aug 27 06:39:34 user nova-compute[73258]: </disk>
Aug 27 06:39:34 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:39:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "33b995be-307d-4491-a1b4-fb75ececea1d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "33b995be-307d-4491-a1b4-fb75ececea1d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:34 user nova-compute[73258]: INFO nova.compute.manager [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Detaching volume 78078c75-4e7a-4c5f-a2e9-c87cdf38ee95
Aug 27 06:39:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] No BDM found with device name sda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:39:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:39:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:39:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] No VIF found with MAC fa:16:3e:f8:77:a4, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:39:34 user nova-compute[73258]: INFO nova.virt.block_device [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Attempting to driver detach volume 78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 from mountpoint /dev/vdb
Aug 27 06:39:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Attempting to detach device vdb from instance 33b995be-307d-4491-a1b4-fb75ececea1d from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:39:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:39:34 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:39:34 user nova-compute[73258]:   <source dev="/dev/sdj"/>
Aug 27 06:39:34 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:39:34 user nova-compute[73258]:   <serial>78078c75-4e7a-4c5f-a2e9-c87cdf38ee95</serial>
Aug 27 06:39:34 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:39:34 user nova-compute[73258]: </disk>
Aug 27 06:39:34 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:39:34 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Successfully detached device vdb from instance 33b995be-307d-4491-a1b4-fb75ececea1d from the persistent domain config.
Aug 27 06:39:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 33b995be-307d-4491-a1b4-fb75ececea1d from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:39:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:39:34 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:39:34 user nova-compute[73258]:   <source dev="/dev/sdj"/>
Aug 27 06:39:34 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:39:34 user nova-compute[73258]:   <serial>78078c75-4e7a-4c5f-a2e9-c87cdf38ee95</serial>
Aug 27 06:39:34 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:39:34 user nova-compute[73258]: </disk>
Aug 27 06:39:34 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:39:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-eb2ddba2-a070-4dbb-9037-7ae2db57fedd tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.915s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693118375.305609, 33b995be-307d-4491-a1b4-fb75ececea1d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 33b995be-307d-4491-a1b4-fb75ececea1d {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:39:35 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Successfully detached device vdb from instance 33b995be-307d-4491-a1b4-fb75ececea1d from the live domain config.
Aug 27 06:39:35 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OksztxGb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:35 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59bf1c3-1264-4b61-8d5b-e4ab87fb44ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9514e9f-a3b6-45cf-aaa2-75ab8c42ca43]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:35 user nova-compute[73258]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 (non-flash)
Aug 27 06:39:35 user nova-compute[73258]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 (non-flash)
Aug 27 06:39:35 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:35 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:35 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:35 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:35 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:35 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:35 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:35 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:35 user nova-compute[73258]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 (non-flash)
Aug 27 06:39:35 user nova-compute[73258]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 (non-flash)
Aug 27 06:39:35 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:35 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:35 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:35 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:35 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:35 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:35 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:35 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4304fe170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95'): ({'sdj'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Removing single pathed devices sdj {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f01b227-a547-4336-99bb-69688e034b71]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[43579103-824d-4d6d-a449-c23ac6aed499]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Flushing IO for device /dev/sdj {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f905d5c-4586-4593-a05a-a036510cba5c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.040s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6c0b25-dddd-4f24-8c79-51406954b785]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] SCSI volumes sdj have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.056s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa903cb-70a9-4f92-bdf8-11440570f80c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[111cdf22-cd8c-4058-ab72-56f1704f402a]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95, portal: 172.16.0.220,3260]
Aug 27 06:39:35 user nova-compute[73258]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95, portal: 172.16.0.220,3260] successful.
Aug 27 06:39:35 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78078c75-4e7a-4c5f-a2e9-c87cdf38ee95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd7d6ce-196c-4a8a-b43e-f4d1d34c44c5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] <== disconnect_volume: return (388ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:35 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:39:36 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:39:36 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:39:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:39:36 user nova-compute[73258]: DEBUG nova.objects.instance [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lazy-loading 'flavor' on Instance uuid 33b995be-307d-4491-a1b4-fb75ececea1d {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4d1625e8-cb7f-4439-98f7-d681ea6b0d96 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "33b995be-307d-4491-a1b4-fb75ececea1d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.308s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:39:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:39:37 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:39:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Acquiring lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:37 user nova-compute[73258]: INFO nova.compute.manager [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Detaching volume 676135ce-16ab-4bcd-b2a4-9c72996567b3
Aug 27 06:39:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:37 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Updating instance_info_cache with network_info: [{"id": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "address": "fa:16:3e:82:0b:22", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f7670e-c9", "ovs_interfaceid": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:39:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:39:37 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:39:37 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:39:37 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:39:37 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:39:37 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:39:37 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:39:37 user nova-compute[73258]: INFO nova.virt.block_device [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Attempting to driver detach volume 676135ce-16ab-4bcd-b2a4-9c72996567b3 from mountpoint /dev/sdc
Aug 27 06:39:37 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:39:37 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:39:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Attempting to detach device sdc from instance e76827f8-dbbf-45fa-a84e-7f5dd0c62912 from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:39:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:39:37 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:39:37 user nova-compute[73258]:   <source dev="/dev/sdk"/>
Aug 27 06:39:37 user nova-compute[73258]:   <target dev="sdc" bus="scsi"/>
Aug 27 06:39:37 user nova-compute[73258]:   <serial>676135ce-16ab-4bcd-b2a4-9c72996567b3</serial>
Aug 27 06:39:37 user nova-compute[73258]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 27 06:39:37 user nova-compute[73258]: </disk>
Aug 27 06:39:37 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:39:37 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Successfully detached device sdc from instance e76827f8-dbbf-45fa-a84e-7f5dd0c62912 from the persistent domain config.
Aug 27 06:39:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance e76827f8-dbbf-45fa-a84e-7f5dd0c62912 from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:39:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:39:37 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:39:37 user nova-compute[73258]:   <source dev="/dev/sdk"/>
Aug 27 06:39:37 user nova-compute[73258]:   <target dev="sdc" bus="scsi"/>
Aug 27 06:39:37 user nova-compute[73258]:   <serial>676135ce-16ab-4bcd-b2a4-9c72996567b3</serial>
Aug 27 06:39:37 user nova-compute[73258]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 27 06:39:37 user nova-compute[73258]: </disk>
Aug 27 06:39:37 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693118378.1093237, e76827f8-dbbf-45fa-a84e-7f5dd0c62912 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance e76827f8-dbbf-45fa-a84e-7f5dd0c62912 {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:39:38 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Successfully detached device sdc from instance e76827f8-dbbf-45fa-a84e-7f5dd0c62912 from the live domain config.
Aug 27 06:39:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TPADCbkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:38 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81f25c5-9d1f-48ed-a2b4-6791e6ad082b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6314e91b-861c-418c-93d1-e91b6c8be741]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:38 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:38 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4305104c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3'): ({'sdk'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Removing single pathed devices sdk {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c6af58-8104-4a74-8ff6-5fc84a54ab6c]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a94cb1-2575-448c-8782-6363b4eb9bad]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Flushing IO for device /dev/sdk {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.012s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1ac2fc-3793-4ccc-b027-c9af059f150d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d6d5a0-713c-45b4-909b-792143e183c0]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] SCSI volumes sdk have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfbadd9-7e7a-4e21-b148-19fcb1177f6e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccc3ba3-135e-4966-8bcd-84529040d39d]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3, portal: 172.16.0.220,3260]
Aug 27 06:39:38 user nova-compute[73258]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3, portal: 172.16.0.220,3260] successful.
Aug 27 06:39:38 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676135ce-16ab-4bcd-b2a4-9c72996567b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1d2647-0ac9-48d8-a987-086f42e2a056]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] <== disconnect_volume: return (310ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAtVixgl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:38 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:38 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:38 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbceb353-b7f9-4692-96a8-392d2b492355]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:39:38 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[370c4f6a-31ee-48fa-9da5-eb03cb0746ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877] added
Aug 27 06:39:38 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df0c60e-fbf2-4596-828f-961e8a926e92]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d2b002-2634-4b44-82ca-e688d24ba77f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GAtVixgl {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GAtVixgl" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b58e71-44d1-49da-9eb3-a032fdb6b0ca]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GAtVixgl'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed0fcca-65ec-4ade-9309-2ec96e74aa6e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fcdd6f-bb27-4a0f-8b42-eb99c7e36d6a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:38 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:38 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:38 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc96b582-544d-4ec9-a24e-77470ed7c090]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877, portal: 172.16.0.220,3260]
Aug 27 06:39:39 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877, portal: 172.16.0.220,3260] successful.
Aug 27 06:39:39 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6bb0f1-9c53-4fd3-8261-16961de32584]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[063eac67-dd9e-4346-95f8-024ac13fc67f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:39 user nova-compute[73258]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 (non-flash)
Aug 27 06:39:39 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:39 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:39 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:39 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:39 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:39 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:39 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:39 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:39 user nova-compute[73258]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 (non-flash)
Aug 27 06:39:39 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:39 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:39 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:39 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:39 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:39 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:39 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:39 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[850ca2fe-ae34-4985-aa38-5f1d2e1764bc]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAtVixgl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG nova.objects.instance [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lazy-loading 'flavor' on Instance uuid e76827f8-dbbf-45fa-a84e-7f5dd0c62912 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-df030e46-69d5-4fde-9224-efb062d66527 tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.789s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:39 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26165626162363162', 'path': '/dev/sdj'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165626162363162', 'path': '/dev/sdj'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG nova.objects.instance [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lazy-loading 'flavor' on Instance uuid 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:39:40 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:39:40 user nova-compute[73258]:   <source dev="/dev/sdj"/>
Aug 27 06:39:40 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:39:40 user nova-compute[73258]:   <serial>d9e66f21-a628-4c10-b733-1963fe016877</serial>
Aug 27 06:39:40 user nova-compute[73258]: </disk>
Aug 27 06:39:40 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Acquiring lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Acquiring lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:40 user nova-compute[73258]: INFO nova.compute.manager [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Terminating instance
Aug 27 06:39:40 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG nova.compute.manager [req-19ee8aba-8570-47dc-829c-1a37192dbce5 req-77d5148a-a2f2-40dd-8dfc-637281733572 service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Received event network-vif-unplugged-9210c142-099e-4af9-b48b-fc0e3ddcdc23 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-19ee8aba-8570-47dc-829c-1a37192dbce5 req-77d5148a-a2f2-40dd-8dfc-637281733572 service nova] Acquiring lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-19ee8aba-8570-47dc-829c-1a37192dbce5 req-77d5148a-a2f2-40dd-8dfc-637281733572 service nova] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-19ee8aba-8570-47dc-829c-1a37192dbce5 req-77d5148a-a2f2-40dd-8dfc-637281733572 service nova] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG nova.compute.manager [req-19ee8aba-8570-47dc-829c-1a37192dbce5 req-77d5148a-a2f2-40dd-8dfc-637281733572 service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] No waiting events found dispatching network-vif-unplugged-9210c142-099e-4af9-b48b-fc0e3ddcdc23 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG nova.compute.manager [req-19ee8aba-8570-47dc-829c-1a37192dbce5 req-77d5148a-a2f2-40dd-8dfc-637281733572 service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Received event network-vif-unplugged-9210c142-099e-4af9-b48b-fc0e3ddcdc23 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] No BDM found with device name hda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] No VIF found with MAC fa:16:3e:9e:b0:e1, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-acba2d03-b9d6-4824-9b52-ffe4ea72e5cc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.049s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:41 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Instance destroyed successfully.
Aug 27 06:39:41 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lazy-loading 'resources' on Instance uuid e76827f8-dbbf-45fa-a84e-7f5dd0c62912 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-475161399',display_name='tempest-AttachSCSIVolumeTestJSON-server-475161399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-475161399',id=7,image_ref='e470b548-a1b2-430d-af20-72902f307f92',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUb/pprsCx9GbvnGdwrdo30pEVY7mVwvtzSQLGyVHP0E7BATTSsE/ymYUSHwvHnRWiHvlGjqBHnLILdP5XOjEbpT+u45zDv2yCUko+IyjLy+2Ycw7METAcM6N6kgRfKbg==',key_name='tempest-keypair-126198669',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:37:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ef630acc68949fd914df77f6cde70d7',ramdisk_id='',reservation_id='r-wiv6qm22',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e470b548-a1b2-430d-af20-72902f307f92',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-184780235',owner_user_name='tempest-AttachSCSIVolumeTestJSON-184780235-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:37:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeb20bad802548c4bdd6067a668d6f05',uuid=e76827f8-dbbf-45fa-a84e-7f5dd0c62912,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "address": "fa:16:3e:f8:77:a4", "network": {"id": "3819e7d4-2dc4-42e1-b2d6-8db84f0bb603", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-44170955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef630acc68949fd914df77f6cde70d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9210c142-09", "ovs_interfaceid": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Converting VIF {"id": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "address": "fa:16:3e:f8:77:a4", "network": {"id": "3819e7d4-2dc4-42e1-b2d6-8db84f0bb603", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-44170955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef630acc68949fd914df77f6cde70d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9210c142-09", "ovs_interfaceid": "9210c142-099e-4af9-b48b-fc0e3ddcdc23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:77:a4,bridge_name='br-int',has_traffic_filtering=True,id=9210c142-099e-4af9-b48b-fc0e3ddcdc23,network=Network(3819e7d4-2dc4-42e1-b2d6-8db84f0bb603),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9210c142-09') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG os_vif [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:77:a4,bridge_name='br-int',has_traffic_filtering=True,id=9210c142-099e-4af9-b48b-fc0e3ddcdc23,network=Network(3819e7d4-2dc4-42e1-b2d6-8db84f0bb603),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9210c142-09') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9210c142-09, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:41 user nova-compute[73258]: INFO os_vif [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:77:a4,bridge_name='br-int',has_traffic_filtering=True,id=9210c142-099e-4af9-b48b-fc0e3ddcdc23,network=Network(3819e7d4-2dc4-42e1-b2d6-8db84f0bb603),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9210c142-09')
Aug 27 06:39:41 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Deleting instance files /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912_del
Aug 27 06:39:41 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Deletion of /opt/stack/data/nova/instances/e76827f8-dbbf-45fa-a84e-7f5dd0c62912_del complete
Aug 27 06:39:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:41 user nova-compute[73258]: INFO nova.compute.manager [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 27 06:39:41 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquiring lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:42 user nova-compute[73258]: INFO nova.compute.manager [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Detaching volume d9e66f21-a628-4c10-b733-1963fe016877
Aug 27 06:39:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:42 user nova-compute[73258]: INFO nova.virt.block_device [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Attempting to driver detach volume d9e66f21-a628-4c10-b733-1963fe016877 from mountpoint /dev/vdb
Aug 27 06:39:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Attempting to detach device vdb from instance 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:39:42 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:39:42 user nova-compute[73258]:   <source dev="/dev/sdj"/>
Aug 27 06:39:42 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:39:42 user nova-compute[73258]:   <serial>d9e66f21-a628-4c10-b733-1963fe016877</serial>
Aug 27 06:39:42 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 06:39:42 user nova-compute[73258]: </disk>
Aug 27 06:39:42 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:39:42 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Successfully detached device vdb from instance 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e from the persistent domain config.
Aug 27 06:39:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:39:42 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:39:42 user nova-compute[73258]:   <source dev="/dev/sdj"/>
Aug 27 06:39:42 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:39:42 user nova-compute[73258]:   <serial>d9e66f21-a628-4c10-b733-1963fe016877</serial>
Aug 27 06:39:42 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 06:39:42 user nova-compute[73258]: </disk>
Aug 27 06:39:42 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG nova.compute.manager [req-7fda2853-bdaf-4988-9346-5759792a6a85 req-f25ff041-b975-45e3-8306-32c19f9ff9ca service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Received event network-vif-deleted-9210c142-099e-4af9-b48b-fc0e3ddcdc23 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:42 user nova-compute[73258]: INFO nova.compute.manager [req-7fda2853-bdaf-4988-9346-5759792a6a85 req-f25ff041-b975-45e3-8306-32c19f9ff9ca service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Neutron deleted interface 9210c142-099e-4af9-b48b-fc0e3ddcdc23; detaching it from the instance and deleting it from the info cache
Aug 27 06:39:42 user nova-compute[73258]: DEBUG nova.network.neutron [req-7fda2853-bdaf-4988-9346-5759792a6a85 req-f25ff041-b975-45e3-8306-32c19f9ff9ca service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:39:42 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Took 1.20 seconds to deallocate network for instance.
Aug 27 06:39:42 user nova-compute[73258]: DEBUG nova.compute.manager [req-7fda2853-bdaf-4988-9346-5759792a6a85 req-f25ff041-b975-45e3-8306-32c19f9ff9ca service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Detach interface failed, port_id=9210c142-099e-4af9-b48b-fc0e3ddcdc23, reason: Instance e76827f8-dbbf-45fa-a84e-7f5dd0c62912 could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG nova.compute.manager [req-8f079679-fd9d-4d2c-b26f-44ea29f623a1 req-4a868a69-f0fa-4067-a9ad-ed0e4cf2a745 service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Received event network-vif-plugged-9210c142-099e-4af9-b48b-fc0e3ddcdc23 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8f079679-fd9d-4d2c-b26f-44ea29f623a1 req-4a868a69-f0fa-4067-a9ad-ed0e4cf2a745 service nova] Acquiring lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8f079679-fd9d-4d2c-b26f-44ea29f623a1 req-4a868a69-f0fa-4067-a9ad-ed0e4cf2a745 service nova] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8f079679-fd9d-4d2c-b26f-44ea29f623a1 req-4a868a69-f0fa-4067-a9ad-ed0e4cf2a745 service nova] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG nova.compute.manager [req-8f079679-fd9d-4d2c-b26f-44ea29f623a1 req-4a868a69-f0fa-4067-a9ad-ed0e4cf2a745 service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] No waiting events found dispatching network-vif-plugged-9210c142-099e-4af9-b48b-fc0e3ddcdc23 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:42 user nova-compute[73258]: WARNING nova.compute.manager [req-8f079679-fd9d-4d2c-b26f-44ea29f623a1 req-4a868a69-f0fa-4067-a9ad-ed0e4cf2a745 service nova] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Received unexpected event network-vif-plugged-9210c142-099e-4af9-b48b-fc0e3ddcdc23 for instance with vm_state active and task_state deleting.
Aug 27 06:39:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:42 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Error from libvirt while getting description of instance-00000007: [Error Code 42] Domain not found: no domain with matching uuid 'e76827f8-dbbf-45fa-a84e-7f5dd0c62912' (instance-00000007): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e76827f8-dbbf-45fa-a84e-7f5dd0c62912' (instance-00000007)
Aug 27 06:39:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693118382.9325671, 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:39:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:39:43 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Successfully detached device vdb from instance 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e from the live domain config.
Aug 27 06:39:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAtVixgl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:43 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:43 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:39:43 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:39:43 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=6749MB free_disk=24.334453582763672GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a68621-1315-48eb-acb3-d9bfee0dd353]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bac172-1ce3-4589-8a3c-5ec1c9f00aa0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:43 user nova-compute[73258]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 (non-flash)
Aug 27 06:39:43 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:43 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:43 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:43 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:43 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:43 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:43 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:43 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:43 user nova-compute[73258]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 (non-flash)
Aug 27 06:39:43 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:43 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:43 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:43 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:43 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:43 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:43 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:43 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa44d3f7490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877'): ({'sdj'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Removing single pathed devices sdj {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[327a7866-c7bf-4155-ad82-2b37748c14e2]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33260b5-53dd-4124-bd97-ff78d2c2e7a5]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Flushing IO for device /dev/sdj {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11756f5-457d-48b5-89e2-e7060d359004]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.062s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bc3796-740b-49ce-b55c-f90e6324ea0c]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] SCSI volumes sdj have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7ce501-e283-4dc3-bcbe-f2c4c0317965]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[41abb6bd-5700-4df6-890b-805bfa25aec5]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877, portal: 172.16.0.220,3260]
Aug 27 06:39:43 user nova-compute[73258]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877, portal: 172.16.0.220,3260] successful.
Aug 27 06:39:43 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.909s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.351s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9e66f21-a628-4c10-b733-1963fe016877 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbc217c-a137-46d6-adf5-e047b8eb900f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] <== disconnect_volume: return (377ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:39:43 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Deleted allocations for instance e76827f8-dbbf-45fa-a84e-7f5dd0c62912
Aug 27 06:39:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a0f5a957-2987-43b3-87c2-9f107c4b4b1e tempest-AttachSCSIVolumeTestJSON-184780235 tempest-AttachSCSIVolumeTestJSON-184780235-project-member] Lock "e76827f8-dbbf-45fa-a84e-7f5dd0c62912" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.538s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 33b995be-307d-4491-a1b4-fb75ececea1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance b51f0635-3ec5-4623-9265-350033b778c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance b1b1b0cd-cd43-459f-aaaa-73ae805f9984 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance d7b11762-9244-481b-87dd-757782d68101 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 32d3fdfc-82ad-46ee-b673-4e73f43b85e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 3ad98f0c-e26f-4913-bf49-755cd63ece60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.616s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG nova.compute.manager [req-796a1f2c-ed00-4003-81bd-fa028c75a979 req-492cd39f-4990-48a1-9eaf-6128e91f23a4 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received event network-changed-d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG nova.compute.manager [req-796a1f2c-ed00-4003-81bd-fa028c75a979 req-492cd39f-4990-48a1-9eaf-6128e91f23a4 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Refreshing instance network info cache due to event network-changed-d1cdcd84-44c1-4385-8671-6481d8a17e57. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-796a1f2c-ed00-4003-81bd-fa028c75a979 req-492cd39f-4990-48a1-9eaf-6128e91f23a4 service nova] Acquiring lock "refresh_cache-b1b1b0cd-cd43-459f-aaaa-73ae805f9984" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-796a1f2c-ed00-4003-81bd-fa028c75a979 req-492cd39f-4990-48a1-9eaf-6128e91f23a4 service nova] Acquired lock "refresh_cache-b1b1b0cd-cd43-459f-aaaa-73ae805f9984" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:39:44 user nova-compute[73258]: DEBUG nova.network.neutron [req-796a1f2c-ed00-4003-81bd-fa028c75a979 req-492cd39f-4990-48a1-9eaf-6128e91f23a4 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Refreshing network info cache for port d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG nova.objects.instance [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lazy-loading 'flavor' on Instance uuid 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG nova.network.neutron [req-796a1f2c-ed00-4003-81bd-fa028c75a979 req-492cd39f-4990-48a1-9eaf-6128e91f23a4 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Updated VIF entry in instance network info cache for port d1cdcd84-44c1-4385-8671-6481d8a17e57. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG nova.network.neutron [req-796a1f2c-ed00-4003-81bd-fa028c75a979 req-492cd39f-4990-48a1-9eaf-6128e91f23a4 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Updating instance_info_cache with network_info: [{"id": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "address": "fa:16:3e:3b:e8:5d", "network": {"id": "99da6780-8423-4561-85a7-9cddac555ead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1622528656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff4b3482c19440abf8930632fdedf2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cdcd84-44", "ovs_interfaceid": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-796a1f2c-ed00-4003-81bd-fa028c75a979 req-492cd39f-4990-48a1-9eaf-6128e91f23a4 service nova] Releasing lock "refresh_cache-b1b1b0cd-cd43-459f-aaaa-73ae805f9984" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:39:45 user nova-compute[73258]: INFO nova.compute.manager [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Rebuilding instance
Aug 27 06:39:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d39e131b-5ded-42ac-ba9e-c506fff3d435 tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.134s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquiring lock "interface-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-273cab8f-39af-492b-93a6-6a9450168431" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "interface-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-273cab8f-39af-492b-93a6-6a9450168431" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG nova.objects.instance [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lazy-loading 'flavor' on Instance uuid 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:37:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272504122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272504122',id=8,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyavg0YndUGAOgB67L8HRF7F2iikxrnrdEVXLpabs98eaA0ZuhB1u8SuP+LgJpkPNPLmHjFchg3jVefSbPuOz2/jsOg0UsGBCCfjGt2BWTYtT1VtCqWWdtqNXaQw6MrAw==',key_name='tempest-keypair-967100910',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:37:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae3fc6b23bb4467891da7bc8a1b4ae49',ramdisk_id='',reservation_id='r-bpbfl8r5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-45928959',owner_user_name='tempest-TaggedAttachmentsTest-45928959-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53ae2b77bfcf461fbc01429ee1f052b8',uuid=70af3b5e-3a68-41b3-9f92-2b3a36a9d21e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "273cab8f-39af-492b-93a6-6a9450168431", "address": "fa:16:3e:27:44:fc", "network": {"id": "dca016fd-fde7-438c-8130-5024000345b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-182407527", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap273cab8f-39", "ovs_interfaceid": "273cab8f-39af-492b-93a6-6a9450168431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Converting VIF {"id": "273cab8f-39af-492b-93a6-6a9450168431", "address": "fa:16:3e:27:44:fc", "network": {"id": "dca016fd-fde7-438c-8130-5024000345b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-182407527", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap273cab8f-39", "ovs_interfaceid": "273cab8f-39af-492b-93a6-6a9450168431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:44:fc,bridge_name='br-int',has_traffic_filtering=True,id=273cab8f-39af-492b-93a6-6a9450168431,network=Network(dca016fd-fde7-438c-8130-5024000345b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap273cab8f-39') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:27:44:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap273cab8f-39"/></interface> {{(pid=73258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:27:44:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap273cab8f-39"/></interface> {{(pid=73258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Attempting to detach device tap273cab8f-39 from instance 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] detach device xml: <interface type="ethernet">
Aug 27 06:39:45 user nova-compute[73258]:   <mac address="fa:16:3e:27:44:fc"/>
Aug 27 06:39:45 user nova-compute[73258]:   <model type="virtio"/>
Aug 27 06:39:45 user nova-compute[73258]:   <mtu size="1442"/>
Aug 27 06:39:45 user nova-compute[73258]:   <target dev="tap273cab8f-39"/>
Aug 27 06:39:45 user nova-compute[73258]: </interface>
Aug 27 06:39:45 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:27:44:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap273cab8f-39"/></interface> {{(pid=73258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:27:44:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap273cab8f-39"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 27 06:39:45 user nova-compute[73258]:   <name>instance-00000008</name>
Aug 27 06:39:45 user nova-compute[73258]:   <uuid>70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</uuid>
Aug 27 06:39:45 user nova-compute[73258]:   <metadata>
Aug 27 06:39:45 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:39:45 user nova-compute[73258]:   <nova:package version="0.0.0"/>
Aug 27 06:39:45 user nova-compute[73258]:   <nova:name>tempest-device-tagging-server-272504122</nova:name>
Aug 27 06:39:45 user nova-compute[73258]:   <nova:creationTime>2023-08-27 06:39:23</nova:creationTime>
Aug 27 06:39:45 user nova-compute[73258]:   <nova:flavor name="m1.tiny">
Aug 27 06:39:45 user nova-compute[73258]:     <nova:memory>512</nova:memory>
Aug 27 06:39:45 user nova-compute[73258]:     <nova:disk>1</nova:disk>
Aug 27 06:39:45 user nova-compute[73258]:     <nova:swap>0</nova:swap>
Aug 27 06:39:45 user nova-compute[73258]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:39:45 user nova-compute[73258]:     <nova:vcpus>1</nova:vcpus>
Aug 27 06:39:45 user nova-compute[73258]:   </nova:flavor>
Aug 27 06:39:45 user nova-compute[73258]:   <nova:owner>
Aug 27 06:39:45 user nova-compute[73258]:     <nova:user uuid="53ae2b77bfcf461fbc01429ee1f052b8">tempest-TaggedAttachmentsTest-45928959-project-member</nova:user>
Aug 27 06:39:45 user nova-compute[73258]:     <nova:project uuid="ae3fc6b23bb4467891da7bc8a1b4ae49">tempest-TaggedAttachmentsTest-45928959</nova:project>
Aug 27 06:39:45 user nova-compute[73258]:   </nova:owner>
Aug 27 06:39:45 user nova-compute[73258]:   <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:39:45 user nova-compute[73258]:   <nova:ports>
Aug 27 06:39:45 user nova-compute[73258]:     <nova:port uuid="e84fffb7-b665-47d1-a38c-525d4ada5d39">
Aug 27 06:39:45 user nova-compute[73258]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 06:39:45 user nova-compute[73258]:     </nova:port>
Aug 27 06:39:45 user nova-compute[73258]:     <nova:port uuid="273cab8f-39af-492b-93a6-6a9450168431">
Aug 27 06:39:45 user nova-compute[73258]:       <nova:ip type="fixed" address="10.10.10.198" ipVersion="4"/>
Aug 27 06:39:45 user nova-compute[73258]:     </nova:port>
Aug 27 06:39:45 user nova-compute[73258]:   </nova:ports>
Aug 27 06:39:45 user nova-compute[73258]: </nova:instance>
Aug 27 06:39:45 user nova-compute[73258]:   </metadata>
Aug 27 06:39:45 user nova-compute[73258]:   <memory unit='KiB'>524288</memory>
Aug 27 06:39:45 user nova-compute[73258]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 27 06:39:45 user nova-compute[73258]:   <vcpu placement='static'>1</vcpu>
Aug 27 06:39:45 user nova-compute[73258]:   <resource>
Aug 27 06:39:45 user nova-compute[73258]:     <partition>/machine</partition>
Aug 27 06:39:45 user nova-compute[73258]:   </resource>
Aug 27 06:39:45 user nova-compute[73258]:   <sysinfo type='smbios'>
Aug 27 06:39:45 user nova-compute[73258]:     <system>
Aug 27 06:39:45 user nova-compute[73258]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 27 06:39:45 user nova-compute[73258]:       <entry name='product'>OpenStack Nova</entry>
Aug 27 06:39:45 user nova-compute[73258]:       <entry name='version'>0.0.0</entry>
Aug 27 06:39:45 user nova-compute[73258]:       <entry name='serial'>70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</entry>
Aug 27 06:39:45 user nova-compute[73258]:       <entry name='uuid'>70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</entry>
Aug 27 06:39:45 user nova-compute[73258]:       <entry name='family'>Virtual Machine</entry>
Aug 27 06:39:45 user nova-compute[73258]:     </system>
Aug 27 06:39:45 user nova-compute[73258]:   </sysinfo>
Aug 27 06:39:45 user nova-compute[73258]:   <os>
Aug 27 06:39:45 user nova-compute[73258]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 27 06:39:45 user nova-compute[73258]:     <boot dev='hd'/>
Aug 27 06:39:45 user nova-compute[73258]:     <smbios mode='sysinfo'/>
Aug 27 06:39:45 user nova-compute[73258]:   </os>
Aug 27 06:39:45 user nova-compute[73258]:   <features>
Aug 27 06:39:45 user nova-compute[73258]:     <acpi/>
Aug 27 06:39:45 user nova-compute[73258]:     <apic/>
Aug 27 06:39:45 user nova-compute[73258]:     <vmcoreinfo state='on'/>
Aug 27 06:39:45 user nova-compute[73258]:   </features>
Aug 27 06:39:45 user nova-compute[73258]:   <cpu mode='custom' match='exact' check='full'>
Aug 27 06:39:45 user nova-compute[73258]:     <model fallback='forbid'>Nehalem</model>
Aug 27 06:39:45 user nova-compute[73258]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 27 06:39:45 user nova-compute[73258]:     <feature policy='require' name='vme'/>
Aug 27 06:39:45 user nova-compute[73258]:     <feature policy='require' name='x2apic'/>
Aug 27 06:39:45 user nova-compute[73258]:     <feature policy='require' name='hypervisor'/>
Aug 27 06:39:45 user nova-compute[73258]:   </cpu>
Aug 27 06:39:45 user nova-compute[73258]:   <clock offset='utc'>
Aug 27 06:39:45 user nova-compute[73258]:     <timer name='pit' tickpolicy='delay'/>
Aug 27 06:39:45 user nova-compute[73258]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 27 06:39:45 user nova-compute[73258]:     <timer name='hpet' present='no'/>
Aug 27 06:39:45 user nova-compute[73258]:   </clock>
Aug 27 06:39:45 user nova-compute[73258]:   <on_poweroff>destroy</on_poweroff>
Aug 27 06:39:45 user nova-compute[73258]:   <on_reboot>restart</on_reboot>
Aug 27 06:39:45 user nova-compute[73258]:   <on_crash>destroy</on_crash>
Aug 27 06:39:45 user nova-compute[73258]:   <devices>
Aug 27 06:39:45 user nova-compute[73258]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 06:39:45 user nova-compute[73258]:     <disk type='file' device='disk'>
Aug 27 06:39:45 user nova-compute[73258]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 27 06:39:45 user nova-compute[73258]:       <source file='/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk' index='2'/>
Aug 27 06:39:45 user nova-compute[73258]:       <backingStore type='file' index='3'>
Aug 27 06:39:45 user nova-compute[73258]:         <format type='raw'/>
Aug 27 06:39:45 user nova-compute[73258]:         <source file='/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33'/>
Aug 27 06:39:45 user nova-compute[73258]:         <backingStore/>
Aug 27 06:39:45 user nova-compute[73258]:       </backingStore>
Aug 27 06:39:45 user nova-compute[73258]:       <target dev='vda' bus='virtio'/>
Aug 27 06:39:45 user nova-compute[73258]:       <alias name='virtio-disk0'/>
Aug 27 06:39:45 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 27 06:39:45 user nova-compute[73258]:     </disk>
Aug 27 06:39:45 user nova-compute[73258]:     <disk type='file' device='cdrom'>
Aug 27 06:39:45 user nova-compute[73258]:       <driver name='qemu' type='raw' cache='none'/>
Aug 27 06:39:45 user nova-compute[73258]:       <source file='/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk.config' index='1'/>
Aug 27 06:39:45 user nova-compute[73258]:       <backingStore/>
Aug 27 06:39:45 user nova-compute[73258]:       <target dev='hda' bus='ide'/>
Aug 27 06:39:45 user nova-compute[73258]:       <readonly/>
Aug 27 06:39:45 user nova-compute[73258]:       <alias name='ide0-0-0'/>
Aug 27 06:39:45 user nova-compute[73258]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 27 06:39:45 user nova-compute[73258]:     </disk>
Aug 27 06:39:45 user nova-compute[73258]:     <controller type='usb' index='0' model='none'>
Aug 27 06:39:45 user nova-compute[73258]:       <alias name='usb'/>
Aug 27 06:39:45 user nova-compute[73258]:     </controller>
Aug 27 06:39:45 user nova-compute[73258]:     <controller type='pci' index='0' model='pci-root'>
Aug 27 06:39:45 user nova-compute[73258]:       <alias name='pci.0'/>
Aug 27 06:39:45 user nova-compute[73258]:     </controller>
Aug 27 06:39:45 user nova-compute[73258]:     <controller type='ide' index='0'>
Aug 27 06:39:45 user nova-compute[73258]:       <alias name='ide'/>
Aug 27 06:39:45 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 27 06:39:45 user nova-compute[73258]:     </controller>
Aug 27 06:39:45 user nova-compute[73258]:     <interface type='ethernet'>
Aug 27 06:39:45 user nova-compute[73258]:       <mac address='fa:16:3e:9e:b0:e1'/>
Aug 27 06:39:45 user nova-compute[73258]:       <target dev='tape84fffb7-b6'/>
Aug 27 06:39:45 user nova-compute[73258]:       <model type='virtio'/>
Aug 27 06:39:45 user nova-compute[73258]:       <mtu size='1442'/>
Aug 27 06:39:45 user nova-compute[73258]:       <alias name='net0'/>
Aug 27 06:39:45 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 27 06:39:45 user nova-compute[73258]:     </interface>
Aug 27 06:39:45 user nova-compute[73258]:     <interface type='ethernet'>
Aug 27 06:39:45 user nova-compute[73258]:       <mac address='fa:16:3e:27:44:fc'/>
Aug 27 06:39:45 user nova-compute[73258]:       <target dev='tap273cab8f-39'/>
Aug 27 06:39:45 user nova-compute[73258]:       <model type='virtio'/>
Aug 27 06:39:45 user nova-compute[73258]:       <mtu size='1442'/>
Aug 27 06:39:45 user nova-compute[73258]:       <alias name='net1'/>
Aug 27 06:39:45 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 27 06:39:45 user nova-compute[73258]:     </interface>
Aug 27 06:39:45 user nova-compute[73258]:     <serial type='pty'>
Aug 27 06:39:45 user nova-compute[73258]:       <source path='/dev/pts/7'/>
Aug 27 06:39:45 user nova-compute[73258]:       <log file='/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/console.log' append='off'/>
Aug 27 06:39:45 user nova-compute[73258]:       <target type='isa-serial' port='0'>
Aug 27 06:39:45 user nova-compute[73258]:         <model name='isa-serial'/>
Aug 27 06:39:45 user nova-compute[73258]:       </target>
Aug 27 06:39:45 user nova-compute[73258]:       <alias name='serial0'/>
Aug 27 06:39:45 user nova-compute[73258]:     </serial>
Aug 27 06:39:45 user nova-compute[73258]:     <console type='pty' tty='/dev/pts/7'>
Aug 27 06:39:45 user nova-compute[73258]:       <source path='/dev/pts/7'/>
Aug 27 06:39:45 user nova-compute[73258]:       <log file='/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/console.log' append='off'/>
Aug 27 06:39:45 user nova-compute[73258]:       <target type='serial' port='0'/>
Aug 27 06:39:45 user nova-compute[73258]:       <alias name='serial0'/>
Aug 27 06:39:45 user nova-compute[73258]:     </console>
Aug 27 06:39:45 user nova-compute[73258]:     <input type='mouse' bus='ps2'>
Aug 27 06:39:45 user nova-compute[73258]:       <alias name='input0'/>
Aug 27 06:39:45 user nova-compute[73258]:     </input>
Aug 27 06:39:45 user nova-compute[73258]:     <input type='keyboard' bus='ps2'>
Aug 27 06:39:45 user nova-compute[73258]:       <alias name='input1'/>
Aug 27 06:39:45 user nova-compute[73258]:     </input>
Aug 27 06:39:45 user nova-compute[73258]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 27 06:39:45 user nova-compute[73258]:       <listen type='address' address='0.0.0.0'/>
Aug 27 06:39:45 user nova-compute[73258]:     </graphics>
Aug 27 06:39:45 user nova-compute[73258]:     <audio id='1' type='none'/>
Aug 27 06:39:45 user nova-compute[73258]:     <video>
Aug 27 06:39:45 user nova-compute[73258]:       <model type='virtio' heads='1' primary='yes'/>
Aug 27 06:39:45 user nova-compute[73258]:       <alias name='video0'/>
Aug 27 06:39:45 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 27 06:39:45 user nova-compute[73258]:     </video>
Aug 27 06:39:45 user nova-compute[73258]:     <memballoon model='virtio'>
Aug 27 06:39:45 user nova-compute[73258]:       <stats period='10'/>
Aug 27 06:39:45 user nova-compute[73258]:       <alias name='balloon0'/>
Aug 27 06:39:45 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 27 06:39:45 user nova-compute[73258]:     </memballoon>
Aug 27 06:39:45 user nova-compute[73258]:     <rng model='virtio'>
Aug 27 06:39:45 user nova-compute[73258]:       <backend model='random'>/dev/urandom</backend>
Aug 27 06:39:45 user nova-compute[73258]:       <alias name='rng0'/>
Aug 27 06:39:45 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 27 06:39:45 user nova-compute[73258]:     </rng>
Aug 27 06:39:45 user nova-compute[73258]:   </devices>
Aug 27 06:39:45 user nova-compute[73258]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 27 06:39:45 user nova-compute[73258]:     <label>libvirt-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</label>
Aug 27 06:39:45 user nova-compute[73258]:     <imagelabel>libvirt-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</imagelabel>
Aug 27 06:39:45 user nova-compute[73258]:   </seclabel>
Aug 27 06:39:45 user nova-compute[73258]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 27 06:39:45 user nova-compute[73258]:     <label>+64055:+108</label>
Aug 27 06:39:45 user nova-compute[73258]:     <imagelabel>+64055:+108</imagelabel>
Aug 27 06:39:45 user nova-compute[73258]:   </seclabel>
Aug 27 06:39:45 user nova-compute[73258]: </domain>
Aug 27 06:39:45 user nova-compute[73258]:  {{(pid=73258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 27 06:39:45 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Successfully detached device tap273cab8f-39 from instance 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e from the persistent domain config.
Aug 27 06:39:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] (1/8): Attempting to detach device tap273cab8f-39 with device alias net1 from instance 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] detach device xml: <interface type="ethernet">
Aug 27 06:39:45 user nova-compute[73258]:   <mac address="fa:16:3e:27:44:fc"/>
Aug 27 06:39:45 user nova-compute[73258]:   <model type="virtio"/>
Aug 27 06:39:45 user nova-compute[73258]:   <mtu size="1442"/>
Aug 27 06:39:45 user nova-compute[73258]:   <target dev="tap273cab8f-39"/>
Aug 27 06:39:45 user nova-compute[73258]: </interface>
Aug 27 06:39:45 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG nova.compute.manager [req-fd433e63-7b35-40cd-b7b5-5afccab45516 req-ea5fd6f0-8105-46d8-9eb1-c5b96c227ddd service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received event network-vif-unplugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fd433e63-7b35-40cd-b7b5-5afccab45516 req-ea5fd6f0-8105-46d8-9eb1-c5b96c227ddd service nova] Acquiring lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fd433e63-7b35-40cd-b7b5-5afccab45516 req-ea5fd6f0-8105-46d8-9eb1-c5b96c227ddd service nova] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fd433e63-7b35-40cd-b7b5-5afccab45516 req-ea5fd6f0-8105-46d8-9eb1-c5b96c227ddd service nova] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:45 user nova-compute[73258]: DEBUG nova.compute.manager [req-fd433e63-7b35-40cd-b7b5-5afccab45516 req-ea5fd6f0-8105-46d8-9eb1-c5b96c227ddd service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] No waiting events found dispatching network-vif-unplugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:45 user nova-compute[73258]: WARNING nova.compute.manager [req-fd433e63-7b35-40cd-b7b5-5afccab45516 req-ea5fd6f0-8105-46d8-9eb1-c5b96c227ddd service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received unexpected event network-vif-unplugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 for instance with vm_state active and task_state rebuilding.
Aug 27 06:39:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693118386.2412138, 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Start waiting for the detach event from libvirt for device tap273cab8f-39 with device alias net1 for instance 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:27:44:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap273cab8f-39"/></interface> {{(pid=73258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:27:44:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap273cab8f-39"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 27 06:39:46 user nova-compute[73258]:   <name>instance-00000008</name>
Aug 27 06:39:46 user nova-compute[73258]:   <uuid>70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</uuid>
Aug 27 06:39:46 user nova-compute[73258]:   <metadata>
Aug 27 06:39:46 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:39:46 user nova-compute[73258]:   <nova:package version="0.0.0"/>
Aug 27 06:39:46 user nova-compute[73258]:   <nova:name>tempest-device-tagging-server-272504122</nova:name>
Aug 27 06:39:46 user nova-compute[73258]:   <nova:creationTime>2023-08-27 06:39:23</nova:creationTime>
Aug 27 06:39:46 user nova-compute[73258]:   <nova:flavor name="m1.tiny">
Aug 27 06:39:46 user nova-compute[73258]:     <nova:memory>512</nova:memory>
Aug 27 06:39:46 user nova-compute[73258]:     <nova:disk>1</nova:disk>
Aug 27 06:39:46 user nova-compute[73258]:     <nova:swap>0</nova:swap>
Aug 27 06:39:46 user nova-compute[73258]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:39:46 user nova-compute[73258]:     <nova:vcpus>1</nova:vcpus>
Aug 27 06:39:46 user nova-compute[73258]:   </nova:flavor>
Aug 27 06:39:46 user nova-compute[73258]:   <nova:owner>
Aug 27 06:39:46 user nova-compute[73258]:     <nova:user uuid="53ae2b77bfcf461fbc01429ee1f052b8">tempest-TaggedAttachmentsTest-45928959-project-member</nova:user>
Aug 27 06:39:46 user nova-compute[73258]:     <nova:project uuid="ae3fc6b23bb4467891da7bc8a1b4ae49">tempest-TaggedAttachmentsTest-45928959</nova:project>
Aug 27 06:39:46 user nova-compute[73258]:   </nova:owner>
Aug 27 06:39:46 user nova-compute[73258]:   <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:39:46 user nova-compute[73258]:   <nova:ports>
Aug 27 06:39:46 user nova-compute[73258]:     <nova:port uuid="e84fffb7-b665-47d1-a38c-525d4ada5d39">
Aug 27 06:39:46 user nova-compute[73258]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 06:39:46 user nova-compute[73258]:     </nova:port>
Aug 27 06:39:46 user nova-compute[73258]:     <nova:port uuid="273cab8f-39af-492b-93a6-6a9450168431">
Aug 27 06:39:46 user nova-compute[73258]:       <nova:ip type="fixed" address="10.10.10.198" ipVersion="4"/>
Aug 27 06:39:46 user nova-compute[73258]:     </nova:port>
Aug 27 06:39:46 user nova-compute[73258]:   </nova:ports>
Aug 27 06:39:46 user nova-compute[73258]: </nova:instance>
Aug 27 06:39:46 user nova-compute[73258]:   </metadata>
Aug 27 06:39:46 user nova-compute[73258]:   <memory unit='KiB'>524288</memory>
Aug 27 06:39:46 user nova-compute[73258]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 27 06:39:46 user nova-compute[73258]:   <vcpu placement='static'>1</vcpu>
Aug 27 06:39:46 user nova-compute[73258]:   <resource>
Aug 27 06:39:46 user nova-compute[73258]:     <partition>/machine</partition>
Aug 27 06:39:46 user nova-compute[73258]:   </resource>
Aug 27 06:39:46 user nova-compute[73258]:   <sysinfo type='smbios'>
Aug 27 06:39:46 user nova-compute[73258]:     <system>
Aug 27 06:39:46 user nova-compute[73258]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 27 06:39:46 user nova-compute[73258]:       <entry name='product'>OpenStack Nova</entry>
Aug 27 06:39:46 user nova-compute[73258]:       <entry name='version'>0.0.0</entry>
Aug 27 06:39:46 user nova-compute[73258]:       <entry name='serial'>70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</entry>
Aug 27 06:39:46 user nova-compute[73258]:       <entry name='uuid'>70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</entry>
Aug 27 06:39:46 user nova-compute[73258]:       <entry name='family'>Virtual Machine</entry>
Aug 27 06:39:46 user nova-compute[73258]:     </system>
Aug 27 06:39:46 user nova-compute[73258]:   </sysinfo>
Aug 27 06:39:46 user nova-compute[73258]:   <os>
Aug 27 06:39:46 user nova-compute[73258]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 27 06:39:46 user nova-compute[73258]:     <boot dev='hd'/>
Aug 27 06:39:46 user nova-compute[73258]:     <smbios mode='sysinfo'/>
Aug 27 06:39:46 user nova-compute[73258]:   </os>
Aug 27 06:39:46 user nova-compute[73258]:   <features>
Aug 27 06:39:46 user nova-compute[73258]:     <acpi/>
Aug 27 06:39:46 user nova-compute[73258]:     <apic/>
Aug 27 06:39:46 user nova-compute[73258]:     <vmcoreinfo state='on'/>
Aug 27 06:39:46 user nova-compute[73258]:   </features>
Aug 27 06:39:46 user nova-compute[73258]:   <cpu mode='custom' match='exact' check='full'>
Aug 27 06:39:46 user nova-compute[73258]:     <model fallback='forbid'>Nehalem</model>
Aug 27 06:39:46 user nova-compute[73258]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 27 06:39:46 user nova-compute[73258]:     <feature policy='require' name='vme'/>
Aug 27 06:39:46 user nova-compute[73258]:     <feature policy='require' name='x2apic'/>
Aug 27 06:39:46 user nova-compute[73258]:     <feature policy='require' name='hypervisor'/>
Aug 27 06:39:46 user nova-compute[73258]:   </cpu>
Aug 27 06:39:46 user nova-compute[73258]:   <clock offset='utc'>
Aug 27 06:39:46 user nova-compute[73258]:     <timer name='pit' tickpolicy='delay'/>
Aug 27 06:39:46 user nova-compute[73258]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 27 06:39:46 user nova-compute[73258]:     <timer name='hpet' present='no'/>
Aug 27 06:39:46 user nova-compute[73258]:   </clock>
Aug 27 06:39:46 user nova-compute[73258]:   <on_poweroff>destroy</on_poweroff>
Aug 27 06:39:46 user nova-compute[73258]:   <on_reboot>restart</on_reboot>
Aug 27 06:39:46 user nova-compute[73258]:   <on_crash>destroy</on_crash>
Aug 27 06:39:46 user nova-compute[73258]:   <devices>
Aug 27 06:39:46 user nova-compute[73258]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 06:39:46 user nova-compute[73258]:     <disk type='file' device='disk'>
Aug 27 06:39:46 user nova-compute[73258]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 27 06:39:46 user nova-compute[73258]:       <source file='/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk' index='2'/>
Aug 27 06:39:46 user nova-compute[73258]:       <backingStore type='file' index='3'>
Aug 27 06:39:46 user nova-compute[73258]:         <format type='raw'/>
Aug 27 06:39:46 user nova-compute[73258]:         <source file='/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33'/>
Aug 27 06:39:46 user nova-compute[73258]:         <backingStore/>
Aug 27 06:39:46 user nova-compute[73258]:       </backingStore>
Aug 27 06:39:46 user nova-compute[73258]:       <target dev='vda' bus='virtio'/>
Aug 27 06:39:46 user nova-compute[73258]:       <alias name='virtio-disk0'/>
Aug 27 06:39:46 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 27 06:39:46 user nova-compute[73258]:     </disk>
Aug 27 06:39:46 user nova-compute[73258]:     <disk type='file' device='cdrom'>
Aug 27 06:39:46 user nova-compute[73258]:       <driver name='qemu' type='raw' cache='none'/>
Aug 27 06:39:46 user nova-compute[73258]:       <source file='/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk.config' index='1'/>
Aug 27 06:39:46 user nova-compute[73258]:       <backingStore/>
Aug 27 06:39:46 user nova-compute[73258]:       <target dev='hda' bus='ide'/>
Aug 27 06:39:46 user nova-compute[73258]:       <readonly/>
Aug 27 06:39:46 user nova-compute[73258]:       <alias name='ide0-0-0'/>
Aug 27 06:39:46 user nova-compute[73258]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 27 06:39:46 user nova-compute[73258]:     </disk>
Aug 27 06:39:46 user nova-compute[73258]:     <controller type='usb' index='0' model='none'>
Aug 27 06:39:46 user nova-compute[73258]:       <alias name='usb'/>
Aug 27 06:39:46 user nova-compute[73258]:     </controller>
Aug 27 06:39:46 user nova-compute[73258]:     <controller type='pci' index='0' model='pci-root'>
Aug 27 06:39:46 user nova-compute[73258]:       <alias name='pci.0'/>
Aug 27 06:39:46 user nova-compute[73258]:     </controller>
Aug 27 06:39:46 user nova-compute[73258]:     <controller type='ide' index='0'>
Aug 27 06:39:46 user nova-compute[73258]:       <alias name='ide'/>
Aug 27 06:39:46 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 27 06:39:46 user nova-compute[73258]:     </controller>
Aug 27 06:39:46 user nova-compute[73258]:     <interface type='ethernet'>
Aug 27 06:39:46 user nova-compute[73258]:       <mac address='fa:16:3e:9e:b0:e1'/>
Aug 27 06:39:46 user nova-compute[73258]:       <target dev='tape84fffb7-b6'/>
Aug 27 06:39:46 user nova-compute[73258]:       <model type='virtio'/>
Aug 27 06:39:46 user nova-compute[73258]:       <mtu size='1442'/>
Aug 27 06:39:46 user nova-compute[73258]:       <alias name='net0'/>
Aug 27 06:39:46 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 27 06:39:46 user nova-compute[73258]:     </interface>
Aug 27 06:39:46 user nova-compute[73258]:     <serial type='pty'>
Aug 27 06:39:46 user nova-compute[73258]:       <source path='/dev/pts/7'/>
Aug 27 06:39:46 user nova-compute[73258]:       <log file='/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/console.log' append='off'/>
Aug 27 06:39:46 user nova-compute[73258]:       <target type='isa-serial' port='0'>
Aug 27 06:39:46 user nova-compute[73258]:         <model name='isa-serial'/>
Aug 27 06:39:46 user nova-compute[73258]:       </target>
Aug 27 06:39:46 user nova-compute[73258]:       <alias name='serial0'/>
Aug 27 06:39:46 user nova-compute[73258]:     </serial>
Aug 27 06:39:46 user nova-compute[73258]:     <console type='pty' tty='/dev/pts/7'>
Aug 27 06:39:46 user nova-compute[73258]:       <source path='/dev/pts/7'/>
Aug 27 06:39:46 user nova-compute[73258]:       <log file='/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/console.log' append='off'/>
Aug 27 06:39:46 user nova-compute[73258]:       <target type='serial' port='0'/>
Aug 27 06:39:46 user nova-compute[73258]:       <alias name='serial0'/>
Aug 27 06:39:46 user nova-compute[73258]:     </console>
Aug 27 06:39:46 user nova-compute[73258]:     <input type='mouse' bus='ps2'>
Aug 27 06:39:46 user nova-compute[73258]:       <alias name='input0'/>
Aug 27 06:39:46 user nova-compute[73258]:     </input>
Aug 27 06:39:46 user nova-compute[73258]:     <input type='keyboard' bus='ps2'>
Aug 27 06:39:46 user nova-compute[73258]:       <alias name='input1'/>
Aug 27 06:39:46 user nova-compute[73258]:     </input>
Aug 27 06:39:46 user nova-compute[73258]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 27 06:39:46 user nova-compute[73258]:       <listen type='address' address='0.0.0.0'/>
Aug 27 06:39:46 user nova-compute[73258]:     </graphics>
Aug 27 06:39:46 user nova-compute[73258]:     <audio id='1' type='none'/>
Aug 27 06:39:46 user nova-compute[73258]:     <video>
Aug 27 06:39:46 user nova-compute[73258]:       <model type='virtio' heads='1' primary='yes'/>
Aug 27 06:39:46 user nova-compute[73258]:       <alias name='video0'/>
Aug 27 06:39:46 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 27 06:39:46 user nova-compute[73258]:     </video>
Aug 27 06:39:46 user nova-compute[73258]:     <memballoon model='virtio'>
Aug 27 06:39:46 user nova-compute[73258]:       <stats period='10'/>
Aug 27 06:39:46 user nova-compute[73258]:       <alias name='balloon0'/>
Aug 27 06:39:46 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 27 06:39:46 user nova-compute[73258]:     </memballoon>
Aug 27 06:39:46 user nova-compute[73258]:     <rng model='virtio'>
Aug 27 06:39:46 user nova-compute[73258]:       <backend model='random'>/dev/urandom</backend>
Aug 27 06:39:46 user nova-compute[73258]:       <alias name='rng0'/>
Aug 27 06:39:46 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 27 06:39:46 user nova-compute[73258]:     </rng>
Aug 27 06:39:46 user nova-compute[73258]:   </devices>
Aug 27 06:39:46 user nova-compute[73258]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 27 06:39:46 user nova-compute[73258]:     <label>libvirt-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</label>
Aug 27 06:39:46 user nova-compute[73258]:     <imagelabel>libvirt-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</imagelabel>
Aug 27 06:39:46 user nova-compute[73258]:   </seclabel>
Aug 27 06:39:46 user nova-compute[73258]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 27 06:39:46 user nova-compute[73258]:     <label>+64055:+108</label>
Aug 27 06:39:46 user nova-compute[73258]:     <imagelabel>+64055:+108</imagelabel>
Aug 27 06:39:46 user nova-compute[73258]:   </seclabel>
Aug 27 06:39:46 user nova-compute[73258]: </domain>
Aug 27 06:39:46 user nova-compute[73258]:  {{(pid=73258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 27 06:39:46 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Successfully detached device tap273cab8f-39 from instance 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e from the live domain config.
Aug 27 06:39:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:37:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272504122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272504122',id=8,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyavg0YndUGAOgB67L8HRF7F2iikxrnrdEVXLpabs98eaA0ZuhB1u8SuP+LgJpkPNPLmHjFchg3jVefSbPuOz2/jsOg0UsGBCCfjGt2BWTYtT1VtCqWWdtqNXaQw6MrAw==',key_name='tempest-keypair-967100910',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:37:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae3fc6b23bb4467891da7bc8a1b4ae49',ramdisk_id='',reservation_id='r-bpbfl8r5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-45928959',owner_user_name='tempest-TaggedAttachmentsTest-45928959-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53ae2b77bfcf461fbc01429ee1f052b8',uuid=70af3b5e-3a68-41b3-9f92-2b3a36a9d21e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "273cab8f-39af-492b-93a6-6a9450168431", "address": "fa:16:3e:27:44:fc", "network": {"id": "dca016fd-fde7-438c-8130-5024000345b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-182407527", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap273cab8f-39", "ovs_interfaceid": "273cab8f-39af-492b-93a6-6a9450168431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Converting VIF {"id": "273cab8f-39af-492b-93a6-6a9450168431", "address": "fa:16:3e:27:44:fc", "network": {"id": "dca016fd-fde7-438c-8130-5024000345b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-182407527", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap273cab8f-39", "ovs_interfaceid": "273cab8f-39af-492b-93a6-6a9450168431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:44:fc,bridge_name='br-int',has_traffic_filtering=True,id=273cab8f-39af-492b-93a6-6a9450168431,network=Network(dca016fd-fde7-438c-8130-5024000345b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap273cab8f-39') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_vif [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:44:fc,bridge_name='br-int',has_traffic_filtering=True,id=273cab8f-39af-492b-93a6-6a9450168431,network=Network(dca016fd-fde7-438c-8130-5024000345b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap273cab8f-39') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap273cab8f-39, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:46 user nova-compute[73258]: INFO os_vif [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:44:fc,bridge_name='br-int',has_traffic_filtering=True,id=273cab8f-39af-492b-93a6-6a9450168431,network=Network(dca016fd-fde7-438c-8130-5024000345b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap273cab8f-39')
Aug 27 06:39:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:39:46 user nova-compute[73258]:   <nova:package version="0.0.0"/>
Aug 27 06:39:46 user nova-compute[73258]:   <nova:name>tempest-device-tagging-server-272504122</nova:name>
Aug 27 06:39:46 user nova-compute[73258]:   <nova:creationTime>2023-08-27 06:39:46</nova:creationTime>
Aug 27 06:39:46 user nova-compute[73258]:   <nova:flavor name="m1.tiny">
Aug 27 06:39:46 user nova-compute[73258]:     <nova:memory>512</nova:memory>
Aug 27 06:39:46 user nova-compute[73258]:     <nova:disk>1</nova:disk>
Aug 27 06:39:46 user nova-compute[73258]:     <nova:swap>0</nova:swap>
Aug 27 06:39:46 user nova-compute[73258]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:39:46 user nova-compute[73258]:     <nova:vcpus>1</nova:vcpus>
Aug 27 06:39:46 user nova-compute[73258]:   </nova:flavor>
Aug 27 06:39:46 user nova-compute[73258]:   <nova:owner>
Aug 27 06:39:46 user nova-compute[73258]:     <nova:user uuid="53ae2b77bfcf461fbc01429ee1f052b8">tempest-TaggedAttachmentsTest-45928959-project-member</nova:user>
Aug 27 06:39:46 user nova-compute[73258]:     <nova:project uuid="ae3fc6b23bb4467891da7bc8a1b4ae49">tempest-TaggedAttachmentsTest-45928959</nova:project>
Aug 27 06:39:46 user nova-compute[73258]:   </nova:owner>
Aug 27 06:39:46 user nova-compute[73258]:   <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:39:46 user nova-compute[73258]:   <nova:ports>
Aug 27 06:39:46 user nova-compute[73258]:     <nova:port uuid="e84fffb7-b665-47d1-a38c-525d4ada5d39">
Aug 27 06:39:46 user nova-compute[73258]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 06:39:46 user nova-compute[73258]:     </nova:port>
Aug 27 06:39:46 user nova-compute[73258]:   </nova:ports>
Aug 27 06:39:46 user nova-compute[73258]: </nova:instance>
Aug 27 06:39:46 user nova-compute[73258]:  {{(pid=73258) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 27 06:39:46 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Instance destroyed successfully.
Aug 27 06:39:46 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Instance destroyed successfully.
Aug 27 06:39:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2113859215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-365915423',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXC+TqgbsZa3q6c5XtC1rMSZD6ezy7FUZNfIQqoaxgbog95i8n8Q42gJYkXEfdMM0sUAvXFMvuFpDd9ZOnMo/2eGVlV1fH/AwaBhBltragdNT3zavkJFQGky/A1N5DJmA==',key_name='tempest-keypair-1590337091',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:38:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ff4b3482c19440abf8930632fdedf2a',ramdisk_id='',reservation_id='r-i6gcfele',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-611468989',owner_user_name='tempest-ServerActionsV293TestJSON-611468989-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:39:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba84ad5267474566aaad7bfbef1eb327',uuid=b1b1b0cd-cd43-459f-aaaa-73ae805f9984,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "address": "fa:16:3e:3b:e8:5d", "network": {"id": "99da6780-8423-4561-85a7-9cddac555ead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1622528656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff4b3482c19440abf8930632fdedf2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cdcd84-44", "ovs_interfaceid": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Converting VIF {"id": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "address": "fa:16:3e:3b:e8:5d", "network": {"id": "99da6780-8423-4561-85a7-9cddac555ead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1622528656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff4b3482c19440abf8930632fdedf2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cdcd84-44", "ovs_interfaceid": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e8:5d,bridge_name='br-int',has_traffic_filtering=True,id=d1cdcd84-44c1-4385-8671-6481d8a17e57,network=Network(99da6780-8423-4561-85a7-9cddac555ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cdcd84-44') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_vif [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e8:5d,bridge_name='br-int',has_traffic_filtering=True,id=d1cdcd84-44c1-4385-8671-6481d8a17e57,network=Network(99da6780-8423-4561-85a7-9cddac555ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cdcd84-44') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1cdcd84-44, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:46 user nova-compute[73258]: INFO os_vif [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e8:5d,bridge_name='br-int',has_traffic_filtering=True,id=d1cdcd84-44c1-4385-8671-6481d8a17e57,network=Network(99da6780-8423-4561-85a7-9cddac555ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cdcd84-44')
Aug 27 06:39:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLanNYcx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:46 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faaecef-0eb6-4949-8a03-6eff2e3ac6fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[20655d05-86c2-4511-8f18-a2da6df216e9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:46 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:46 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:46 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:46 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:46 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:46 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:46 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:46 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:46 user nova-compute[73258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:39:46 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:46 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:46 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:46 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:46 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:46 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:46 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4305c0310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG nova.compute.manager [req-d39f0573-22e8-4c90-99e6-d25679b3c52f req-4d4b1191-8cfd-4f62-974c-9ee4f397d8bd service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received event network-vif-unplugged-273cab8f-39af-492b-93a6-6a9450168431 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d39f0573-22e8-4c90-99e6-d25679b3c52f req-4d4b1191-8cfd-4f62-974c-9ee4f397d8bd service nova] Acquiring lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d39f0573-22e8-4c90-99e6-d25679b3c52f req-4d4b1191-8cfd-4f62-974c-9ee4f397d8bd service nova] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d39f0573-22e8-4c90-99e6-d25679b3c52f req-4d4b1191-8cfd-4f62-974c-9ee4f397d8bd service nova] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG nova.compute.manager [req-d39f0573-22e8-4c90-99e6-d25679b3c52f req-4d4b1191-8cfd-4f62-974c-9ee4f397d8bd service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] No waiting events found dispatching network-vif-unplugged-273cab8f-39af-492b-93a6-6a9450168431 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:46 user nova-compute[73258]: WARNING nova.compute.manager [req-d39f0573-22e8-4c90-99e6-d25679b3c52f req-4d4b1191-8cfd-4f62-974c-9ee4f397d8bd service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received unexpected event network-vif-unplugged-273cab8f-39af-492b-93a6-6a9450168431 for instance with vm_state active and task_state None.
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.040s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7f8b44-7bd9-4c35-811e-b28db4885c42]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.040s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[643d73dd-017a-4b8a-88bb-532501478430]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4e4ecc-860c-4af6-980e-5d4dcc56a88c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea73feb3-1fb3-4ca1-893a-6ec39b16b5b7]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5a0bfa77', '/dev/disk/by-id/scsi-1SCST_BIO5a0bfa77-f7dedc92a0ee4735', '/dev/disk/by-id/scsi-26637646564633932') {{(pid=84389) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 06:39:46 user nova-compute[73258]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_5a0bfa77
Aug 27 06:39:46 user nova-compute[73258]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO5a0bfa77-f7dedc92a0ee4735
Aug 27 06:39:46 user nova-compute[73258]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26637646564633932
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3165ada-20fc-4c7a-9444-2a1c7f895130]: (4, None) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0f3532-9050-4440-a108-b0ec5270a9d4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6269eb00-4a3a-488d-acbf-c53691da9f53]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f, portal: 172.16.0.220,3260]
Aug 27 06:39:46 user nova-compute[73258]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f, portal: 172.16.0.220,3260] successful.
Aug 27 06:39:46 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb32146e-654d-4201-aefe-88c16f91a71d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] <== disconnect_volume: return (431ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:39:46 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Deleting instance files /opt/stack/data/nova/instances/b1b1b0cd-cd43-459f-aaaa-73ae805f9984_del
Aug 27 06:39:46 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Deletion of /opt/stack/data/nova/instances/b1b1b0cd-cd43-459f-aaaa-73ae805f9984_del complete
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.compute.manager [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received event network-vif-deleted-273cab8f-39af-492b-93a6-6a9450168431 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:47 user nova-compute[73258]: INFO nova.compute.manager [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Neutron deleted interface 273cab8f-39af-492b-93a6-6a9450168431; detaching it from the instance and deleting it from the info cache
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.network.neutron [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Updating instance_info_cache with network_info: [{"id": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "address": "fa:16:3e:9e:b0:e1", "network": {"id": "9bc98272-6eb0-4ce7-ba14-721aa5b74a67", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-969683990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape84fffb7-b6", "ovs_interfaceid": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:39:47 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance b1b1b0cd-cd43-459f-aaaa-73ae805f9984 could not be found.
Aug 27 06:39:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquiring lock "refresh_cache-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquired lock "refresh_cache-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.network.neutron [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLanNYcx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:47 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 06:39:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.objects.instance [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] Lazy-loading 'system_metadata' on Instance uuid 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[779f54d7-8fe8-444f-aaa1-7ae13d0fc026]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[827db34e-3677-4879-b555-6bda7891dcba]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:47 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:47 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:47 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:47 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:47 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:47 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:47 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:47 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:47 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:47 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:47 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:47 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:47 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:47 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa44d3f6710>, {}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Disconnecting from: [] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.058s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] <== disconnect_volume: return (59ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.objects.instance [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] Lazy-loading 'flavor' on Instance uuid 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.objects.base [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] Object Instance<70af3b5e-3a68-41b3-9f92-2b3a36a9d21e> lazy-loaded attributes: system_metadata,flavor {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:37:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272504122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272504122',id=8,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyavg0YndUGAOgB67L8HRF7F2iikxrnrdEVXLpabs98eaA0ZuhB1u8SuP+LgJpkPNPLmHjFchg3jVefSbPuOz2/jsOg0UsGBCCfjGt2BWTYtT1VtCqWWdtqNXaQw6MrAw==',key_name='tempest-keypair-967100910',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:37:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae3fc6b23bb4467891da7bc8a1b4ae49',ramdisk_id='',reservation_id='r-bpbfl8r5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-45928959',owner_user_name='tempest-TaggedAttachmentsTest-45928959-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53ae2b77bfcf461fbc01429ee1f052b8',uuid=70af3b5e-3a68-41b3-9f92-2b3a36a9d21e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "273cab8f-39af-492b-93a6-6a9450168431", "address": "fa:16:3e:27:44:fc", "network": {"id": "dca016fd-fde7-438c-8130-5024000345b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-182407527", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap273cab8f-39", "ovs_interfaceid": "273cab8f-39af-492b-93a6-6a9450168431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.network.os_vif_util [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] Converting VIF {"id": "273cab8f-39af-492b-93a6-6a9450168431", "address": "fa:16:3e:27:44:fc", "network": {"id": "dca016fd-fde7-438c-8130-5024000345b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-182407527", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap273cab8f-39", "ovs_interfaceid": "273cab8f-39af-492b-93a6-6a9450168431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.network.os_vif_util [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:44:fc,bridge_name='br-int',has_traffic_filtering=True,id=273cab8f-39af-492b-93a6-6a9450168431,network=Network(dca016fd-fde7-438c-8130-5024000345b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap273cab8f-39') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:27:44:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap273cab8f-39"/></interface> {{(pid=73258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:27:44:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap273cab8f-39"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 27 06:39:47 user nova-compute[73258]:   <name>instance-00000008</name>
Aug 27 06:39:47 user nova-compute[73258]:   <uuid>70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</uuid>
Aug 27 06:39:47 user nova-compute[73258]:   <metadata>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:39:47 user nova-compute[73258]:   <nova:package version="0.0.0"/>
Aug 27 06:39:47 user nova-compute[73258]:   <nova:name>tempest-device-tagging-server-272504122</nova:name>
Aug 27 06:39:47 user nova-compute[73258]:   <nova:creationTime>2023-08-27 06:39:46</nova:creationTime>
Aug 27 06:39:47 user nova-compute[73258]:   <nova:flavor name="m1.tiny">
Aug 27 06:39:47 user nova-compute[73258]:     <nova:memory>512</nova:memory>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:disk>1</nova:disk>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:swap>0</nova:swap>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:vcpus>1</nova:vcpus>
Aug 27 06:39:47 user nova-compute[73258]:   </nova:flavor>
Aug 27 06:39:47 user nova-compute[73258]:   <nova:owner>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:user uuid="53ae2b77bfcf461fbc01429ee1f052b8">tempest-TaggedAttachmentsTest-45928959-project-member</nova:user>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:project uuid="ae3fc6b23bb4467891da7bc8a1b4ae49">tempest-TaggedAttachmentsTest-45928959</nova:project>
Aug 27 06:39:47 user nova-compute[73258]:   </nova:owner>
Aug 27 06:39:47 user nova-compute[73258]:   <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:39:47 user nova-compute[73258]:   <nova:ports>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:port uuid="e84fffb7-b665-47d1-a38c-525d4ada5d39">
Aug 27 06:39:47 user nova-compute[73258]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 06:39:47 user nova-compute[73258]:     </nova:port>
Aug 27 06:39:47 user nova-compute[73258]:   </nova:ports>
Aug 27 06:39:47 user nova-compute[73258]: </nova:instance>
Aug 27 06:39:47 user nova-compute[73258]:   </metadata>
Aug 27 06:39:47 user nova-compute[73258]:   <memory unit='KiB'>524288</memory>
Aug 27 06:39:47 user nova-compute[73258]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 27 06:39:47 user nova-compute[73258]:   <vcpu placement='static'>1</vcpu>
Aug 27 06:39:47 user nova-compute[73258]:   <resource>
Aug 27 06:39:47 user nova-compute[73258]:     <partition>/machine</partition>
Aug 27 06:39:47 user nova-compute[73258]:   </resource>
Aug 27 06:39:47 user nova-compute[73258]:   <sysinfo type='smbios'>
Aug 27 06:39:47 user nova-compute[73258]:     <system>
Aug 27 06:39:47 user nova-compute[73258]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 27 06:39:47 user nova-compute[73258]:       <entry name='product'>OpenStack Nova</entry>
Aug 27 06:39:47 user nova-compute[73258]:       <entry name='version'>0.0.0</entry>
Aug 27 06:39:47 user nova-compute[73258]:       <entry name='serial'>70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</entry>
Aug 27 06:39:47 user nova-compute[73258]:       <entry name='uuid'>70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</entry>
Aug 27 06:39:47 user nova-compute[73258]:       <entry name='family'>Virtual Machine</entry>
Aug 27 06:39:47 user nova-compute[73258]:     </system>
Aug 27 06:39:47 user nova-compute[73258]:   </sysinfo>
Aug 27 06:39:47 user nova-compute[73258]:   <os>
Aug 27 06:39:47 user nova-compute[73258]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 27 06:39:47 user nova-compute[73258]:     <boot dev='hd'/>
Aug 27 06:39:47 user nova-compute[73258]:     <smbios mode='sysinfo'/>
Aug 27 06:39:47 user nova-compute[73258]:   </os>
Aug 27 06:39:47 user nova-compute[73258]:   <features>
Aug 27 06:39:47 user nova-compute[73258]:     <acpi/>
Aug 27 06:39:47 user nova-compute[73258]:     <apic/>
Aug 27 06:39:47 user nova-compute[73258]:     <vmcoreinfo state='on'/>
Aug 27 06:39:47 user nova-compute[73258]:   </features>
Aug 27 06:39:47 user nova-compute[73258]:   <cpu mode='custom' match='exact' check='full'>
Aug 27 06:39:47 user nova-compute[73258]:     <model fallback='forbid'>Nehalem</model>
Aug 27 06:39:47 user nova-compute[73258]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 27 06:39:47 user nova-compute[73258]:     <feature policy='require' name='vme'/>
Aug 27 06:39:47 user nova-compute[73258]:     <feature policy='require' name='x2apic'/>
Aug 27 06:39:47 user nova-compute[73258]:     <feature policy='require' name='hypervisor'/>
Aug 27 06:39:47 user nova-compute[73258]:   </cpu>
Aug 27 06:39:47 user nova-compute[73258]:   <clock offset='utc'>
Aug 27 06:39:47 user nova-compute[73258]:     <timer name='pit' tickpolicy='delay'/>
Aug 27 06:39:47 user nova-compute[73258]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 27 06:39:47 user nova-compute[73258]:     <timer name='hpet' present='no'/>
Aug 27 06:39:47 user nova-compute[73258]:   </clock>
Aug 27 06:39:47 user nova-compute[73258]:   <on_poweroff>destroy</on_poweroff>
Aug 27 06:39:47 user nova-compute[73258]:   <on_reboot>restart</on_reboot>
Aug 27 06:39:47 user nova-compute[73258]:   <on_crash>destroy</on_crash>
Aug 27 06:39:47 user nova-compute[73258]:   <devices>
Aug 27 06:39:47 user nova-compute[73258]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 06:39:47 user nova-compute[73258]:     <disk type='file' device='disk'>
Aug 27 06:39:47 user nova-compute[73258]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 27 06:39:47 user nova-compute[73258]:       <source file='/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk' index='2'/>
Aug 27 06:39:47 user nova-compute[73258]:       <backingStore type='file' index='3'>
Aug 27 06:39:47 user nova-compute[73258]:         <format type='raw'/>
Aug 27 06:39:47 user nova-compute[73258]:         <source file='/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33'/>
Aug 27 06:39:47 user nova-compute[73258]:         <backingStore/>
Aug 27 06:39:47 user nova-compute[73258]:       </backingStore>
Aug 27 06:39:47 user nova-compute[73258]:       <target dev='vda' bus='virtio'/>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='virtio-disk0'/>
Aug 27 06:39:47 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </disk>
Aug 27 06:39:47 user nova-compute[73258]:     <disk type='file' device='cdrom'>
Aug 27 06:39:47 user nova-compute[73258]:       <driver name='qemu' type='raw' cache='none'/>
Aug 27 06:39:47 user nova-compute[73258]:       <source file='/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk.config' index='1'/>
Aug 27 06:39:47 user nova-compute[73258]:       <backingStore/>
Aug 27 06:39:47 user nova-compute[73258]:       <target dev='hda' bus='ide'/>
Aug 27 06:39:47 user nova-compute[73258]:       <readonly/>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='ide0-0-0'/>
Aug 27 06:39:47 user nova-compute[73258]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </disk>
Aug 27 06:39:47 user nova-compute[73258]:     <controller type='usb' index='0' model='none'>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='usb'/>
Aug 27 06:39:47 user nova-compute[73258]:     </controller>
Aug 27 06:39:47 user nova-compute[73258]:     <controller type='pci' index='0' model='pci-root'>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='pci.0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </controller>
Aug 27 06:39:47 user nova-compute[73258]:     <controller type='ide' index='0'>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='ide'/>
Aug 27 06:39:47 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 27 06:39:47 user nova-compute[73258]:     </controller>
Aug 27 06:39:47 user nova-compute[73258]:     <interface type='ethernet'>
Aug 27 06:39:47 user nova-compute[73258]:       <mac address='fa:16:3e:9e:b0:e1'/>
Aug 27 06:39:47 user nova-compute[73258]:       <target dev='tape84fffb7-b6'/>
Aug 27 06:39:47 user nova-compute[73258]:       <model type='virtio'/>
Aug 27 06:39:47 user nova-compute[73258]:       <mtu size='1442'/>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='net0'/>
Aug 27 06:39:47 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </interface>
Aug 27 06:39:47 user nova-compute[73258]:     <serial type='pty'>
Aug 27 06:39:47 user nova-compute[73258]:       <source path='/dev/pts/7'/>
Aug 27 06:39:47 user nova-compute[73258]:       <log file='/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/console.log' append='off'/>
Aug 27 06:39:47 user nova-compute[73258]:       <target type='isa-serial' port='0'>
Aug 27 06:39:47 user nova-compute[73258]:         <model name='isa-serial'/>
Aug 27 06:39:47 user nova-compute[73258]:       </target>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='serial0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </serial>
Aug 27 06:39:47 user nova-compute[73258]:     <console type='pty' tty='/dev/pts/7'>
Aug 27 06:39:47 user nova-compute[73258]:       <source path='/dev/pts/7'/>
Aug 27 06:39:47 user nova-compute[73258]:       <log file='/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/console.log' append='off'/>
Aug 27 06:39:47 user nova-compute[73258]:       <target type='serial' port='0'/>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='serial0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </console>
Aug 27 06:39:47 user nova-compute[73258]:     <input type='mouse' bus='ps2'>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='input0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </input>
Aug 27 06:39:47 user nova-compute[73258]:     <input type='keyboard' bus='ps2'>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='input1'/>
Aug 27 06:39:47 user nova-compute[73258]:     </input>
Aug 27 06:39:47 user nova-compute[73258]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 27 06:39:47 user nova-compute[73258]:       <listen type='address' address='0.0.0.0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </graphics>
Aug 27 06:39:47 user nova-compute[73258]:     <audio id='1' type='none'/>
Aug 27 06:39:47 user nova-compute[73258]:     <video>
Aug 27 06:39:47 user nova-compute[73258]:       <model type='virtio' heads='1' primary='yes'/>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='video0'/>
Aug 27 06:39:47 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </video>
Aug 27 06:39:47 user nova-compute[73258]:     <memballoon model='virtio'>
Aug 27 06:39:47 user nova-compute[73258]:       <stats period='10'/>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='balloon0'/>
Aug 27 06:39:47 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </memballoon>
Aug 27 06:39:47 user nova-compute[73258]:     <rng model='virtio'>
Aug 27 06:39:47 user nova-compute[73258]:       <backend model='random'>/dev/urandom</backend>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='rng0'/>
Aug 27 06:39:47 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </rng>
Aug 27 06:39:47 user nova-compute[73258]:   </devices>
Aug 27 06:39:47 user nova-compute[73258]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 27 06:39:47 user nova-compute[73258]:     <label>libvirt-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</label>
Aug 27 06:39:47 user nova-compute[73258]:     <imagelabel>libvirt-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</imagelabel>
Aug 27 06:39:47 user nova-compute[73258]:   </seclabel>
Aug 27 06:39:47 user nova-compute[73258]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 27 06:39:47 user nova-compute[73258]:     <label>+64055:+108</label>
Aug 27 06:39:47 user nova-compute[73258]:     <imagelabel>+64055:+108</imagelabel>
Aug 27 06:39:47 user nova-compute[73258]:   </seclabel>
Aug 27 06:39:47 user nova-compute[73258]: </domain>
Aug 27 06:39:47 user nova-compute[73258]:  {{(pid=73258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:27:44:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap273cab8f-39"/></interface> {{(pid=73258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:27:44:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap273cab8f-39"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 27 06:39:47 user nova-compute[73258]:   <name>instance-00000008</name>
Aug 27 06:39:47 user nova-compute[73258]:   <uuid>70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</uuid>
Aug 27 06:39:47 user nova-compute[73258]:   <metadata>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:39:47 user nova-compute[73258]:   <nova:package version="0.0.0"/>
Aug 27 06:39:47 user nova-compute[73258]:   <nova:name>tempest-device-tagging-server-272504122</nova:name>
Aug 27 06:39:47 user nova-compute[73258]:   <nova:creationTime>2023-08-27 06:39:46</nova:creationTime>
Aug 27 06:39:47 user nova-compute[73258]:   <nova:flavor name="m1.tiny">
Aug 27 06:39:47 user nova-compute[73258]:     <nova:memory>512</nova:memory>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:disk>1</nova:disk>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:swap>0</nova:swap>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:vcpus>1</nova:vcpus>
Aug 27 06:39:47 user nova-compute[73258]:   </nova:flavor>
Aug 27 06:39:47 user nova-compute[73258]:   <nova:owner>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:user uuid="53ae2b77bfcf461fbc01429ee1f052b8">tempest-TaggedAttachmentsTest-45928959-project-member</nova:user>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:project uuid="ae3fc6b23bb4467891da7bc8a1b4ae49">tempest-TaggedAttachmentsTest-45928959</nova:project>
Aug 27 06:39:47 user nova-compute[73258]:   </nova:owner>
Aug 27 06:39:47 user nova-compute[73258]:   <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:39:47 user nova-compute[73258]:   <nova:ports>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:port uuid="e84fffb7-b665-47d1-a38c-525d4ada5d39">
Aug 27 06:39:47 user nova-compute[73258]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 06:39:47 user nova-compute[73258]:     </nova:port>
Aug 27 06:39:47 user nova-compute[73258]:   </nova:ports>
Aug 27 06:39:47 user nova-compute[73258]: </nova:instance>
Aug 27 06:39:47 user nova-compute[73258]:   </metadata>
Aug 27 06:39:47 user nova-compute[73258]:   <memory unit='KiB'>524288</memory>
Aug 27 06:39:47 user nova-compute[73258]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 27 06:39:47 user nova-compute[73258]:   <vcpu placement='static'>1</vcpu>
Aug 27 06:39:47 user nova-compute[73258]:   <resource>
Aug 27 06:39:47 user nova-compute[73258]:     <partition>/machine</partition>
Aug 27 06:39:47 user nova-compute[73258]:   </resource>
Aug 27 06:39:47 user nova-compute[73258]:   <sysinfo type='smbios'>
Aug 27 06:39:47 user nova-compute[73258]:     <system>
Aug 27 06:39:47 user nova-compute[73258]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 27 06:39:47 user nova-compute[73258]:       <entry name='product'>OpenStack Nova</entry>
Aug 27 06:39:47 user nova-compute[73258]:       <entry name='version'>0.0.0</entry>
Aug 27 06:39:47 user nova-compute[73258]:       <entry name='serial'>70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</entry>
Aug 27 06:39:47 user nova-compute[73258]:       <entry name='uuid'>70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</entry>
Aug 27 06:39:47 user nova-compute[73258]:       <entry name='family'>Virtual Machine</entry>
Aug 27 06:39:47 user nova-compute[73258]:     </system>
Aug 27 06:39:47 user nova-compute[73258]:   </sysinfo>
Aug 27 06:39:47 user nova-compute[73258]:   <os>
Aug 27 06:39:47 user nova-compute[73258]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 27 06:39:47 user nova-compute[73258]:     <boot dev='hd'/>
Aug 27 06:39:47 user nova-compute[73258]:     <smbios mode='sysinfo'/>
Aug 27 06:39:47 user nova-compute[73258]:   </os>
Aug 27 06:39:47 user nova-compute[73258]:   <features>
Aug 27 06:39:47 user nova-compute[73258]:     <acpi/>
Aug 27 06:39:47 user nova-compute[73258]:     <apic/>
Aug 27 06:39:47 user nova-compute[73258]:     <vmcoreinfo state='on'/>
Aug 27 06:39:47 user nova-compute[73258]:   </features>
Aug 27 06:39:47 user nova-compute[73258]:   <cpu mode='custom' match='exact' check='full'>
Aug 27 06:39:47 user nova-compute[73258]:     <model fallback='forbid'>Nehalem</model>
Aug 27 06:39:47 user nova-compute[73258]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 27 06:39:47 user nova-compute[73258]:     <feature policy='require' name='vme'/>
Aug 27 06:39:47 user nova-compute[73258]:     <feature policy='require' name='x2apic'/>
Aug 27 06:39:47 user nova-compute[73258]:     <feature policy='require' name='hypervisor'/>
Aug 27 06:39:47 user nova-compute[73258]:   </cpu>
Aug 27 06:39:47 user nova-compute[73258]:   <clock offset='utc'>
Aug 27 06:39:47 user nova-compute[73258]:     <timer name='pit' tickpolicy='delay'/>
Aug 27 06:39:47 user nova-compute[73258]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 27 06:39:47 user nova-compute[73258]:     <timer name='hpet' present='no'/>
Aug 27 06:39:47 user nova-compute[73258]:   </clock>
Aug 27 06:39:47 user nova-compute[73258]:   <on_poweroff>destroy</on_poweroff>
Aug 27 06:39:47 user nova-compute[73258]:   <on_reboot>restart</on_reboot>
Aug 27 06:39:47 user nova-compute[73258]:   <on_crash>destroy</on_crash>
Aug 27 06:39:47 user nova-compute[73258]:   <devices>
Aug 27 06:39:47 user nova-compute[73258]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 06:39:47 user nova-compute[73258]:     <disk type='file' device='disk'>
Aug 27 06:39:47 user nova-compute[73258]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 27 06:39:47 user nova-compute[73258]:       <source file='/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk' index='2'/>
Aug 27 06:39:47 user nova-compute[73258]:       <backingStore type='file' index='3'>
Aug 27 06:39:47 user nova-compute[73258]:         <format type='raw'/>
Aug 27 06:39:47 user nova-compute[73258]:         <source file='/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33'/>
Aug 27 06:39:47 user nova-compute[73258]:         <backingStore/>
Aug 27 06:39:47 user nova-compute[73258]:       </backingStore>
Aug 27 06:39:47 user nova-compute[73258]:       <target dev='vda' bus='virtio'/>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='virtio-disk0'/>
Aug 27 06:39:47 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </disk>
Aug 27 06:39:47 user nova-compute[73258]:     <disk type='file' device='cdrom'>
Aug 27 06:39:47 user nova-compute[73258]:       <driver name='qemu' type='raw' cache='none'/>
Aug 27 06:39:47 user nova-compute[73258]:       <source file='/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/disk.config' index='1'/>
Aug 27 06:39:47 user nova-compute[73258]:       <backingStore/>
Aug 27 06:39:47 user nova-compute[73258]:       <target dev='hda' bus='ide'/>
Aug 27 06:39:47 user nova-compute[73258]:       <readonly/>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='ide0-0-0'/>
Aug 27 06:39:47 user nova-compute[73258]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </disk>
Aug 27 06:39:47 user nova-compute[73258]:     <controller type='usb' index='0' model='none'>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='usb'/>
Aug 27 06:39:47 user nova-compute[73258]:     </controller>
Aug 27 06:39:47 user nova-compute[73258]:     <controller type='pci' index='0' model='pci-root'>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='pci.0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </controller>
Aug 27 06:39:47 user nova-compute[73258]:     <controller type='ide' index='0'>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='ide'/>
Aug 27 06:39:47 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 27 06:39:47 user nova-compute[73258]:     </controller>
Aug 27 06:39:47 user nova-compute[73258]:     <interface type='ethernet'>
Aug 27 06:39:47 user nova-compute[73258]:       <mac address='fa:16:3e:9e:b0:e1'/>
Aug 27 06:39:47 user nova-compute[73258]:       <target dev='tape84fffb7-b6'/>
Aug 27 06:39:47 user nova-compute[73258]:       <model type='virtio'/>
Aug 27 06:39:47 user nova-compute[73258]:       <mtu size='1442'/>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='net0'/>
Aug 27 06:39:47 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </interface>
Aug 27 06:39:47 user nova-compute[73258]:     <serial type='pty'>
Aug 27 06:39:47 user nova-compute[73258]:       <source path='/dev/pts/7'/>
Aug 27 06:39:47 user nova-compute[73258]:       <log file='/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/console.log' append='off'/>
Aug 27 06:39:47 user nova-compute[73258]:       <target type='isa-serial' port='0'>
Aug 27 06:39:47 user nova-compute[73258]:         <model name='isa-serial'/>
Aug 27 06:39:47 user nova-compute[73258]:       </target>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='serial0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </serial>
Aug 27 06:39:47 user nova-compute[73258]:     <console type='pty' tty='/dev/pts/7'>
Aug 27 06:39:47 user nova-compute[73258]:       <source path='/dev/pts/7'/>
Aug 27 06:39:47 user nova-compute[73258]:       <log file='/opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e/console.log' append='off'/>
Aug 27 06:39:47 user nova-compute[73258]:       <target type='serial' port='0'/>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='serial0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </console>
Aug 27 06:39:47 user nova-compute[73258]:     <input type='mouse' bus='ps2'>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='input0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </input>
Aug 27 06:39:47 user nova-compute[73258]:     <input type='keyboard' bus='ps2'>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='input1'/>
Aug 27 06:39:47 user nova-compute[73258]:     </input>
Aug 27 06:39:47 user nova-compute[73258]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 27 06:39:47 user nova-compute[73258]:       <listen type='address' address='0.0.0.0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </graphics>
Aug 27 06:39:47 user nova-compute[73258]:     <audio id='1' type='none'/>
Aug 27 06:39:47 user nova-compute[73258]:     <video>
Aug 27 06:39:47 user nova-compute[73258]:       <model type='virtio' heads='1' primary='yes'/>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='video0'/>
Aug 27 06:39:47 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </video>
Aug 27 06:39:47 user nova-compute[73258]:     <memballoon model='virtio'>
Aug 27 06:39:47 user nova-compute[73258]:       <stats period='10'/>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='balloon0'/>
Aug 27 06:39:47 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </memballoon>
Aug 27 06:39:47 user nova-compute[73258]:     <rng model='virtio'>
Aug 27 06:39:47 user nova-compute[73258]:       <backend model='random'>/dev/urandom</backend>
Aug 27 06:39:47 user nova-compute[73258]:       <alias name='rng0'/>
Aug 27 06:39:47 user nova-compute[73258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 27 06:39:47 user nova-compute[73258]:     </rng>
Aug 27 06:39:47 user nova-compute[73258]:   </devices>
Aug 27 06:39:47 user nova-compute[73258]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 27 06:39:47 user nova-compute[73258]:     <label>libvirt-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</label>
Aug 27 06:39:47 user nova-compute[73258]:     <imagelabel>libvirt-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e</imagelabel>
Aug 27 06:39:47 user nova-compute[73258]:   </seclabel>
Aug 27 06:39:47 user nova-compute[73258]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 27 06:39:47 user nova-compute[73258]:     <label>+64055:+108</label>
Aug 27 06:39:47 user nova-compute[73258]:     <imagelabel>+64055:+108</imagelabel>
Aug 27 06:39:47 user nova-compute[73258]:   </seclabel>
Aug 27 06:39:47 user nova-compute[73258]: </domain>
Aug 27 06:39:47 user nova-compute[73258]:  {{(pid=73258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 27 06:39:47 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Detaching interface fa:16:3e:27:44:fc failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap273cab8f-39' not found.
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:37:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272504122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272504122',id=8,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyavg0YndUGAOgB67L8HRF7F2iikxrnrdEVXLpabs98eaA0ZuhB1u8SuP+LgJpkPNPLmHjFchg3jVefSbPuOz2/jsOg0UsGBCCfjGt2BWTYtT1VtCqWWdtqNXaQw6MrAw==',key_name='tempest-keypair-967100910',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:37:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae3fc6b23bb4467891da7bc8a1b4ae49',ramdisk_id='',reservation_id='r-bpbfl8r5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-45928959',owner_user_name='tempest-TaggedAttachmentsTest-45928959-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53ae2b77bfcf461fbc01429ee1f052b8',uuid=70af3b5e-3a68-41b3-9f92-2b3a36a9d21e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "273cab8f-39af-492b-93a6-6a9450168431", "address": "fa:16:3e:27:44:fc", "network": {"id": "dca016fd-fde7-438c-8130-5024000345b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-182407527", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap273cab8f-39", "ovs_interfaceid": "273cab8f-39af-492b-93a6-6a9450168431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.network.os_vif_util [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] Converting VIF {"id": "273cab8f-39af-492b-93a6-6a9450168431", "address": "fa:16:3e:27:44:fc", "network": {"id": "dca016fd-fde7-438c-8130-5024000345b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-182407527", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap273cab8f-39", "ovs_interfaceid": "273cab8f-39af-492b-93a6-6a9450168431", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.network.os_vif_util [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:44:fc,bridge_name='br-int',has_traffic_filtering=True,id=273cab8f-39af-492b-93a6-6a9450168431,network=Network(dca016fd-fde7-438c-8130-5024000345b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap273cab8f-39') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG os_vif [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:44:fc,bridge_name='br-int',has_traffic_filtering=True,id=273cab8f-39af-492b-93a6-6a9450168431,network=Network(dca016fd-fde7-438c-8130-5024000345b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap273cab8f-39') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap273cab8f-39, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:39:47 user nova-compute[73258]: INFO os_vif [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:44:fc,bridge_name='br-int',has_traffic_filtering=True,id=273cab8f-39af-492b-93a6-6a9450168431,network=Network(dca016fd-fde7-438c-8130-5024000345b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap273cab8f-39')
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [req-8cc8a908-e560-44e6-9f82-772e6349e32d req-a59814e6-ca84-409b-98c8-3813b8facedd service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:39:47 user nova-compute[73258]:   <nova:package version="0.0.0"/>
Aug 27 06:39:47 user nova-compute[73258]:   <nova:name>tempest-device-tagging-server-272504122</nova:name>
Aug 27 06:39:47 user nova-compute[73258]:   <nova:creationTime>2023-08-27 06:39:47</nova:creationTime>
Aug 27 06:39:47 user nova-compute[73258]:   <nova:flavor name="m1.tiny">
Aug 27 06:39:47 user nova-compute[73258]:     <nova:memory>512</nova:memory>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:disk>1</nova:disk>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:swap>0</nova:swap>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:vcpus>1</nova:vcpus>
Aug 27 06:39:47 user nova-compute[73258]:   </nova:flavor>
Aug 27 06:39:47 user nova-compute[73258]:   <nova:owner>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:user uuid="53ae2b77bfcf461fbc01429ee1f052b8">tempest-TaggedAttachmentsTest-45928959-project-member</nova:user>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:project uuid="ae3fc6b23bb4467891da7bc8a1b4ae49">tempest-TaggedAttachmentsTest-45928959</nova:project>
Aug 27 06:39:47 user nova-compute[73258]:   </nova:owner>
Aug 27 06:39:47 user nova-compute[73258]:   <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:39:47 user nova-compute[73258]:   <nova:ports>
Aug 27 06:39:47 user nova-compute[73258]:     <nova:port uuid="e84fffb7-b665-47d1-a38c-525d4ada5d39">
Aug 27 06:39:47 user nova-compute[73258]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 06:39:47 user nova-compute[73258]:     </nova:port>
Aug 27 06:39:47 user nova-compute[73258]:   </nova:ports>
Aug 27 06:39:47 user nova-compute[73258]: </nova:instance>
Aug 27 06:39:47 user nova-compute[73258]:  {{(pid=73258) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG nova.network.neutron [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Updating instance_info_cache with network_info: [{"id": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "address": "fa:16:3e:9e:b0:e1", "network": {"id": "9bc98272-6eb0-4ce7-ba14-721aa5b74a67", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-969683990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape84fffb7-b6", "ovs_interfaceid": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Releasing lock "refresh_cache-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:39:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ba3e2a5f-e1d5-4afd-888b-b2ba0b4977dc tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "interface-70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-273cab8f-39af-492b-93a6-6a9450168431" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.169s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:48 user nova-compute[73258]: DEBUG nova.compute.manager [req-f1b1ad72-2474-44e9-81be-16aba637a889 req-a22ba8fa-f0b1-4510-a7d4-dd9579b5f32c service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received event network-vif-plugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f1b1ad72-2474-44e9-81be-16aba637a889 req-a22ba8fa-f0b1-4510-a7d4-dd9579b5f32c service nova] Acquiring lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f1b1ad72-2474-44e9-81be-16aba637a889 req-a22ba8fa-f0b1-4510-a7d4-dd9579b5f32c service nova] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f1b1ad72-2474-44e9-81be-16aba637a889 req-a22ba8fa-f0b1-4510-a7d4-dd9579b5f32c service nova] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:48 user nova-compute[73258]: DEBUG nova.compute.manager [req-f1b1ad72-2474-44e9-81be-16aba637a889 req-a22ba8fa-f0b1-4510-a7d4-dd9579b5f32c service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] No waiting events found dispatching network-vif-plugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:48 user nova-compute[73258]: WARNING nova.compute.manager [req-f1b1ad72-2474-44e9-81be-16aba637a889 req-a22ba8fa-f0b1-4510-a7d4-dd9579b5f32c service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received unexpected event network-vif-plugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 for instance with vm_state active and task_state rebuilding.
Aug 27 06:39:48 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Preparing to wait for external event volume-reimaged-09b45154-77cc-47a2-8ced-c072a9acc75f {{(pid=73258) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 27 06:39:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Acquiring lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:48 user nova-compute[73258]: DEBUG nova.compute.manager [req-4524c41e-0521-47e1-bdc2-c4f7276a369a req-9a4cde30-5921-4bb4-aa96-eda1ae1b42b5 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received event network-vif-plugged-273cab8f-39af-492b-93a6-6a9450168431 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:39:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4524c41e-0521-47e1-bdc2-c4f7276a369a req-9a4cde30-5921-4bb4-aa96-eda1ae1b42b5 service nova] Acquiring lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4524c41e-0521-47e1-bdc2-c4f7276a369a req-9a4cde30-5921-4bb4-aa96-eda1ae1b42b5 service nova] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4524c41e-0521-47e1-bdc2-c4f7276a369a req-9a4cde30-5921-4bb4-aa96-eda1ae1b42b5 service nova] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:48 user nova-compute[73258]: DEBUG nova.compute.manager [req-4524c41e-0521-47e1-bdc2-c4f7276a369a req-9a4cde30-5921-4bb4-aa96-eda1ae1b42b5 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] No waiting events found dispatching network-vif-plugged-273cab8f-39af-492b-93a6-6a9450168431 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:39:48 user nova-compute[73258]: WARNING nova.compute.manager [req-4524c41e-0521-47e1-bdc2-c4f7276a369a req-9a4cde30-5921-4bb4-aa96-eda1ae1b42b5 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received unexpected event network-vif-plugged-273cab8f-39af-492b-93a6-6a9450168431 for instance with vm_state active and task_state None.
Aug 27 06:39:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBbiASXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:49 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:49 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:49 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40afdfa-9fb1-48d2-895b-8f37f6aba498]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:39:49 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a80bec0-0a8b-413b-a3e3-7b2578ab7c43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43] added
Aug 27 06:39:49 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78f75ed-8569-4228-8669-9ceaf1439832]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[45aad77a-2833-4bfc-a5c6-3128e024ecfc]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBbiASXu {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBbiASXu" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb07ce9-3599-4646-a533-2547fad7f8b8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xBbiASXu'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5f312b-8aff-4cb9-b20f-227fbc3b81b8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9687f6e-895f-4163-9290-9fb5787a4ad2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:49 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:49 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[64630095-b808-46f6-b8db-4226fa9dd533]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43, portal: 172.16.0.220,3260]
Aug 27 06:39:49 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43, portal: 172.16.0.220,3260] successful.
Aug 27 06:39:49 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2755a49e-a163-4fa5-943f-211e736b0079]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f4bd8d-b8c0-4bdc-aa33-c84e7731f1b0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:49 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:49 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:49 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[485608b8-c16f-4511-8248-825541126a9c]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:49 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:39:50 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:39:50 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBbiASXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:39:50 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:50 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23936396338326164', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936396338326164', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:39:50 user nova-compute[73258]: DEBUG nova.objects.instance [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Lazy-loading 'flavor' on Instance uuid b51f0635-3ec5-4623-9265-350033b778c6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] attach device xml: <disk type="block" device="disk">
Aug 27 06:39:50 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:39:50 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:39:50 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:39:50 user nova-compute[73258]:   <serial>37fb70de-891e-4761-a661-a1102ef49e43</serial>
Aug 27 06:39:50 user nova-compute[73258]: </disk>
Aug 27 06:39:50 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:39:51 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:39:51 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:39:51 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] No VIF found with MAC fa:16:3e:a6:3c:ca, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:39:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d2dbd2a-f643-47db-8fb5-ae0c0dff60d5 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Lock "b51f0635-3ec5-4623-9265-350033b778c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.492s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-77292f5a-4c1b-4dd2-a7ae-85276fc852ac tempest-VolumesAssistedSnapshotsTest-1743447358 tempest-VolumesAssistedSnapshotsTest-1743447358-project] [instance: b51f0635-3ec5-4623-9265-350033b778c6] volume_snapshot_create: create_info: {'snapshot_id': '99c90c79-2d49-4dad-8c5d-3318e8a5c0cf', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73258) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 27 06:39:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-77292f5a-4c1b-4dd2-a7ae-85276fc852ac tempest-VolumesAssistedSnapshotsTest-1743447358 tempest-VolumesAssistedSnapshotsTest-1743447358-project] [instance: b51f0635-3ec5-4623-9265-350033b778c6] snap xml: <domainsnapshot>
Aug 27 06:39:52 user nova-compute[73258]:   <disks>
Aug 27 06:39:52 user nova-compute[73258]:     <disk name="/dev/sdb" snapshot="external" type="file">
Aug 27 06:39:52 user nova-compute[73258]:       <source file="/dev/new_file"/>
Aug 27 06:39:52 user nova-compute[73258]:     </disk>
Aug 27 06:39:52 user nova-compute[73258]:     <disk name="vda" snapshot="no"/>
Aug 27 06:39:52 user nova-compute[73258]:   </disks>
Aug 27 06:39:52 user nova-compute[73258]: </domainsnapshot>
Aug 27 06:39:52 user nova-compute[73258]:  {{(pid=73258) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 27 06:39:52 user nova-compute[73258]: DEBUG nova.objects.instance [None req-77292f5a-4c1b-4dd2-a7ae-85276fc852ac tempest-VolumesAssistedSnapshotsTest-1743447358 tempest-VolumesAssistedSnapshotsTest-1743447358-project] Lazy-loading 'system_metadata' on Instance uuid b51f0635-3ec5-4623-9265-350033b778c6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:52 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-77292f5a-4c1b-4dd2-a7ae-85276fc852ac tempest-VolumesAssistedSnapshotsTest-1743447358 tempest-VolumesAssistedSnapshotsTest-1743447358-project] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 06:39:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-68f04a93-65b4-4a1c-bb08-d205c9f36a0c tempest-VolumesAssistedSnapshotsTest-1743447358 tempest-VolumesAssistedSnapshotsTest-1743447358-project] [instance: b51f0635-3ec5-4623-9265-350033b778c6] volume_snapshot_delete: delete_info: {'volume_id': '37fb70de-891e-4761-a661-a1102ef49e43'} {{(pid=73258) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [None req-68f04a93-65b4-4a1c-bb08-d205c9f36a0c tempest-VolumesAssistedSnapshotsTest-1743447358 tempest-VolumesAssistedSnapshotsTest-1743447358-project] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6] Traceback (most recent call last):
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]     if delete_info['type'] != 'qcow2':
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6] KeyError: 'type'
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6] 
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [None req-77292f5a-4c1b-4dd2-a7ae-85276fc852ac tempest-VolumesAssistedSnapshotsTest-1743447358 tempest-VolumesAssistedSnapshotsTest-1743447358-project] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6] Traceback (most recent call last):
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]     rv = execute(f, *args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]     six.reraise(c, e, tb)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]     raise value
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]     rv = meth(*args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6] 
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [None req-77292f5a-4c1b-4dd2-a7ae-85276fc852ac tempest-VolumesAssistedSnapshotsTest-1743447358 tempest-VolumesAssistedSnapshotsTest-1743447358-project] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6] Traceback (most recent call last):
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]     self._volume_snapshot_create(context, instance, guest,
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]     rv = execute(f, *args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]     six.reraise(c, e, tb)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]     raise value
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]     rv = meth(*args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [instance: b51f0635-3ec5-4623-9265-350033b778c6] 
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [None req-68f04a93-65b4-4a1c-bb08-d205c9f36a0c tempest-VolumesAssistedSnapshotsTest-1743447358 tempest-VolumesAssistedSnapshotsTest-1743447358-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver 
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver 
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-e0602d3e-ed6e-44f4-9caa-95f79b5f766a)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver 
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver 
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver 
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server [None req-68f04a93-65b4-4a1c-bb08-d205c9f36a0c tempest-VolumesAssistedSnapshotsTest-1743447358 tempest-VolumesAssistedSnapshotsTest-1743447358-project] Exception during message handling: KeyError: 'type'
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server 
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver [None req-77292f5a-4c1b-4dd2-a7ae-85276fc852ac tempest-VolumesAssistedSnapshotsTest-1743447358 tempest-VolumesAssistedSnapshotsTest-1743447358-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 99c90c79-2d49-4dad-8c5d-3318e8a5c0cf could not be found.
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     raise value
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver 
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver 
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 99c90c79-2d49-4dad-8c5d-3318e8a5c0cf could not be found. (HTTP 404) (Request-ID: req-2ba6a809-3010-49d2-911c-1a8f2fea7a1f)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver 
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver 
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 99c90c79-2d49-4dad-8c5d-3318e8a5c0cf could not be found.
Aug 27 06:39:52 user nova-compute[73258]: ERROR nova.virt.libvirt.driver 
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server [None req-77292f5a-4c1b-4dd2-a7ae-85276fc852ac tempest-VolumesAssistedSnapshotsTest-1743447358 tempest-VolumesAssistedSnapshotsTest-1743447358-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     raise value
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 06:39:52 user nova-compute[73258]: ERROR oslo_messaging.rpc.server 
Aug 27 06:39:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Acquiring lock "b51f0635-3ec5-4623-9265-350033b778c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:39:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Lock "b51f0635-3ec5-4623-9265-350033b778c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:39:52 user nova-compute[73258]: INFO nova.compute.manager [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Detaching volume 37fb70de-891e-4761-a661-a1102ef49e43
Aug 27 06:39:52 user nova-compute[73258]: INFO nova.virt.block_device [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Attempting to driver detach volume 37fb70de-891e-4761-a661-a1102ef49e43 from mountpoint /dev/vdb
Aug 27 06:39:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Attempting to detach device vdb from instance b51f0635-3ec5-4623-9265-350033b778c6 from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:39:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] detach device xml: <disk type="block" device="disk">
Aug 27 06:39:52 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:39:52 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:39:52 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:39:52 user nova-compute[73258]:   <serial>37fb70de-891e-4761-a661-a1102ef49e43</serial>
Aug 27 06:39:52 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:39:52 user nova-compute[73258]: </disk>
Aug 27 06:39:52 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:39:52 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Successfully detached device vdb from instance b51f0635-3ec5-4623-9265-350033b778c6 from the persistent domain config.
Aug 27 06:39:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b51f0635-3ec5-4623-9265-350033b778c6 from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:39:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] detach device xml: <disk type="block" device="disk">
Aug 27 06:39:52 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:39:52 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:39:52 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:39:52 user nova-compute[73258]:   <serial>37fb70de-891e-4761-a661-a1102ef49e43</serial>
Aug 27 06:39:52 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:39:52 user nova-compute[73258]: </disk>
Aug 27 06:39:52 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693118393.2478912, b51f0635-3ec5-4623-9265-350033b778c6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b51f0635-3ec5-4623-9265-350033b778c6 {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:39:53 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Successfully detached device vdb from instance b51f0635-3ec5-4623-9265-350033b778c6 from the live domain config.
Aug 27 06:39:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] [instance: b51f0635-3ec5-4623-9265-350033b778c6] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBbiASXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:39:53 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:39:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62d6a48-bb68-4ea4-9c74-f0af0f7d2628]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dbf2e2-521b-4c8a-85ad-68725ece9738]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:53 user nova-compute[73258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 (non-flash)
Aug 27 06:39:53 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:53 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:53 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:53 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:53 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:53 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:53 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:39:53 user nova-compute[73258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 (non-flash)
Aug 27 06:39:53 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:39:53 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:39:53 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:39:53 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:39:53 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:39:53 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:39:53 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4107b55a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea7f133-d5f8-4f00-9be0-7c8ea3ec79cf]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0377a706-337e-4784-a5aa-5d8a22e58903]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b536124c-9e8a-4968-a618-729d6e62c063]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94a07c1-47fd-4fb4-bfd4-2a66991e0d27]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[76799023-e752-4fdd-96e2-55a86ebde328]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca665c7c-7bc7-4818-9a91-586ea0f78f8a]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43, portal: 172.16.0.220,3260]
Aug 27 06:39:53 user nova-compute[73258]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43, portal: 172.16.0.220,3260] successful.
Aug 27 06:39:53 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37fb70de-891e-4761-a661-a1102ef49e43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdc8a23-99e9-4680-943d-d122a42a87f0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] <== disconnect_volume: return (308ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:39:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:39:54 user nova-compute[73258]: DEBUG nova.objects.instance [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Lazy-loading 'flavor' on Instance uuid b51f0635-3ec5-4623-9265-350033b778c6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:39:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d515b3e4-fc11-4f31-b4bd-69cf3b71a6f1 tempest-VolumesAssistedSnapshotsTest-1106970536 tempest-VolumesAssistedSnapshotsTest-1106970536-project-admin] Lock "b51f0635-3ec5-4623-9265-350033b778c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.673s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:39:56 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118381.2390273, e76827f8-dbbf-45fa-a84e-7f5dd0c62912 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:39:56 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] VM Stopped (Lifecycle Event)
Aug 27 06:39:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-0bb58acb-d9d4-4ca0-897b-ad55dd9f54ae None None] [instance: e76827f8-dbbf-45fa-a84e-7f5dd0c62912] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:39:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:39:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:01 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118386.379767, b1b1b0cd-cd43-459f-aaaa-73ae805f9984 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:40:01 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] VM Stopped (Lifecycle Event)
Aug 27 06:40:01 user nova-compute[73258]: DEBUG nova.compute.manager [None req-45d5a439-39bf-4d9c-91f4-b077815bbcb0 None None] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:40:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-a608d0bb-53cf-463d-ae83-0fd5902a12bf req-650bf4fc-8c32-4538-8e14-0b013ff34747 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received event volume-reimaged-09b45154-77cc-47a2-8ced-c072a9acc75f {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a608d0bb-53cf-463d-ae83-0fd5902a12bf req-650bf4fc-8c32-4538-8e14-0b013ff34747 service nova] Acquiring lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a608d0bb-53cf-463d-ae83-0fd5902a12bf req-650bf4fc-8c32-4538-8e14-0b013ff34747 service nova] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a608d0bb-53cf-463d-ae83-0fd5902a12bf req-650bf4fc-8c32-4538-8e14-0b013ff34747 service nova] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-a608d0bb-53cf-463d-ae83-0fd5902a12bf req-650bf4fc-8c32-4538-8e14-0b013ff34747 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Processing event volume-reimaged-09b45154-77cc-47a2-8ced-c072a9acc75f {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Instance event wait completed in 22 seconds for volume-reimaged {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:40:10 user nova-compute[73258]: INFO nova.virt.block_device [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Booting with volume 09b45154-77cc-47a2-8ced-c072a9acc75f at /dev/vda
Aug 27 06:40:10 user nova-compute[73258]: DEBUG os_brick.utils [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6749f27e-b269-40e7-98d0-bc330c6ebd90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b34838-afa5-4759-b83c-348ce70bf871]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c2e3d4-58b1-405d-a2b6-704747b5e1c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7e1418-0311-4116-9e9c-b1dfb643ec77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:40:10 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:40:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0e2538-c121-44b4-a876-dad9c118df55]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG os_brick.utils [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:40:10 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Updating existing volume attachment record: 7faee13d-a76a-45d2-9905-da4e3b6eea0a {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:40:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "1672aa9f-be6f-4357-877f-a48f62119df4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:40:14 user nova-compute[73258]: INFO nova.compute.claims [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Claim successful on node user
Aug 27 06:40:14 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG nova.network.neutron [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:40:14 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:40:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG nova.policy [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '685859ec81944e3398853037c24673a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6efa67b959a473da5a06f9e0aa8795f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:40:14 user nova-compute[73258]: INFO nova.compute.claims [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Claim successful on node user
Aug 27 06:40:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:40:14 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Creating image(s)
Aug 27 06:40:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "/opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "/opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "/opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.173s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk 1073741824" returned: 0 in 0.056s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG nova.network.neutron [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Successfully created port: 217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.599s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG nova.compute.manager [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG nova.compute.manager [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG nova.network.neutron [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.199s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:15 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:40:15 user nova-compute[73258]: DEBUG nova.compute.manager [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG nova.policy [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '685859ec81944e3398853037c24673a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6efa67b959a473da5a06f9e0aa8795f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG nova.compute.manager [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:40:15 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Creating image(s)
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "/opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "/opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "/opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Cannot resize image /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Ensure instance console log exists: /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.172s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk 1073741824" returned: 0 in 0.070s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.network.neutron [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Successfully created port: f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.network.neutron [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Successfully updated port: 217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquired lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.network.neutron [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.compute.manager [req-ed68f1b3-ef60-42d9-854d-95f0df36274c req-8c815e60-725a-44ae-8290-7c33bd14dec8 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received event network-changed-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.compute.manager [req-ed68f1b3-ef60-42d9-854d-95f0df36274c req-8c815e60-725a-44ae-8290-7c33bd14dec8 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Refreshing instance network info cache due to event network-changed-217b1702-a403-4f3a-bdae-7793382e5f38. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ed68f1b3-ef60-42d9-854d-95f0df36274c req-8c815e60-725a-44ae-8290-7c33bd14dec8 service nova] Acquiring lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.201s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.network.neutron [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Cannot resize image /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Ensure instance console log exists: /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.network.neutron [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Updating instance_info_cache with network_info: [{"id": "217b1702-a403-4f3a-bdae-7793382e5f38", "address": "fa:16:3e:5d:4e:76", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217b1702-a4", "ovs_interfaceid": "217b1702-a403-4f3a-bdae-7793382e5f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Releasing lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.compute.manager [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Instance network_info: |[{"id": "217b1702-a403-4f3a-bdae-7793382e5f38", "address": "fa:16:3e:5d:4e:76", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217b1702-a4", "ovs_interfaceid": "217b1702-a403-4f3a-bdae-7793382e5f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ed68f1b3-ef60-42d9-854d-95f0df36274c req-8c815e60-725a-44ae-8290-7c33bd14dec8 service nova] Acquired lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.network.neutron [req-ed68f1b3-ef60-42d9-854d-95f0df36274c req-8c815e60-725a-44ae-8290-7c33bd14dec8 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Refreshing network info cache for port 217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Start _get_guest_xml network_info=[{"id": "217b1702-a403-4f3a-bdae-7793382e5f38", "address": "fa:16:3e:5d:4e:76", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217b1702-a4", "ovs_interfaceid": "217b1702-a403-4f3a-bdae-7793382e5f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:40:16 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:40:16 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:40:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-986376124',display_name='tempest-ServerRescueNegativeTestJSON-server-986376124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-986376124',id=14,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6efa67b959a473da5a06f9e0aa8795f',ramdisk_id='',reservation_id='r-gemtid0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1025141277',owner_user_name='tempest-ServerRescueNegativeTestJSON-1025141277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:40:15Z,user_data=None,user_id='685859ec81944e3398853037c24673a4',uuid=1672aa9f-be6f-4357-877f-a48f62119df4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "217b1702-a403-4f3a-bdae-7793382e5f38", "address": "fa:16:3e:5d:4e:76", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217b1702-a4", "ovs_interfaceid": "217b1702-a403-4f3a-bdae-7793382e5f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converting VIF {"id": "217b1702-a403-4f3a-bdae-7793382e5f38", "address": "fa:16:3e:5d:4e:76", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217b1702-a4", "ovs_interfaceid": "217b1702-a403-4f3a-bdae-7793382e5f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4e:76,bridge_name='br-int',has_traffic_filtering=True,id=217b1702-a403-4f3a-bdae-7793382e5f38,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217b1702-a4') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.objects.instance [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'pci_devices' on Instance uuid 1672aa9f-be6f-4357-877f-a48f62119df4 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:40:16 user nova-compute[73258]:   <uuid>1672aa9f-be6f-4357-877f-a48f62119df4</uuid>
Aug 27 06:40:16 user nova-compute[73258]:   <name>instance-0000000e</name>
Aug 27 06:40:16 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:40:16 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:40:16 user nova-compute[73258]:   <metadata>
Aug 27 06:40:16 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:40:16 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:40:16 user nova-compute[73258]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-986376124</nova:name>
Aug 27 06:40:16 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:40:16</nova:creationTime>
Aug 27 06:40:16 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:40:16 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:40:16 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:40:16 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:40:16 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:40:16 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:40:16 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:40:16 user nova-compute[73258]:       <nova:owner>
Aug 27 06:40:16 user nova-compute[73258]:         <nova:user uuid="685859ec81944e3398853037c24673a4">tempest-ServerRescueNegativeTestJSON-1025141277-project-member</nova:user>
Aug 27 06:40:16 user nova-compute[73258]:         <nova:project uuid="f6efa67b959a473da5a06f9e0aa8795f">tempest-ServerRescueNegativeTestJSON-1025141277</nova:project>
Aug 27 06:40:16 user nova-compute[73258]:       </nova:owner>
Aug 27 06:40:16 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:40:16 user nova-compute[73258]:       <nova:ports>
Aug 27 06:40:16 user nova-compute[73258]:         <nova:port uuid="217b1702-a403-4f3a-bdae-7793382e5f38">
Aug 27 06:40:16 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 06:40:16 user nova-compute[73258]:         </nova:port>
Aug 27 06:40:16 user nova-compute[73258]:       </nova:ports>
Aug 27 06:40:16 user nova-compute[73258]:     </nova:instance>
Aug 27 06:40:16 user nova-compute[73258]:   </metadata>
Aug 27 06:40:16 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:40:16 user nova-compute[73258]:     <system>
Aug 27 06:40:16 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:40:16 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:40:16 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:40:16 user nova-compute[73258]:       <entry name="serial">1672aa9f-be6f-4357-877f-a48f62119df4</entry>
Aug 27 06:40:16 user nova-compute[73258]:       <entry name="uuid">1672aa9f-be6f-4357-877f-a48f62119df4</entry>
Aug 27 06:40:16 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:40:16 user nova-compute[73258]:     </system>
Aug 27 06:40:16 user nova-compute[73258]:   </sysinfo>
Aug 27 06:40:16 user nova-compute[73258]:   <os>
Aug 27 06:40:16 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:40:16 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:40:16 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:40:16 user nova-compute[73258]:   </os>
Aug 27 06:40:16 user nova-compute[73258]:   <features>
Aug 27 06:40:16 user nova-compute[73258]:     <acpi/>
Aug 27 06:40:16 user nova-compute[73258]:     <apic/>
Aug 27 06:40:16 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:40:16 user nova-compute[73258]:   </features>
Aug 27 06:40:16 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:40:16 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:40:16 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:40:16 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:40:16 user nova-compute[73258]:   </clock>
Aug 27 06:40:16 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:40:16 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:40:16 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:40:16 user nova-compute[73258]:   </cpu>
Aug 27 06:40:16 user nova-compute[73258]:   <devices>
Aug 27 06:40:16 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:40:16 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:40:16 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk"/>
Aug 27 06:40:16 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:40:16 user nova-compute[73258]:     </disk>
Aug 27 06:40:16 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:40:16 user nova-compute[73258]:       <mac address="fa:16:3e:5d:4e:76"/>
Aug 27 06:40:16 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:40:16 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:40:16 user nova-compute[73258]:       <target dev="tap217b1702-a4"/>
Aug 27 06:40:16 user nova-compute[73258]:     </interface>
Aug 27 06:40:16 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:40:16 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/console.log" append="off"/>
Aug 27 06:40:16 user nova-compute[73258]:     </serial>
Aug 27 06:40:16 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:40:16 user nova-compute[73258]:     <video>
Aug 27 06:40:16 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:40:16 user nova-compute[73258]:     </video>
Aug 27 06:40:16 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:40:16 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:40:16 user nova-compute[73258]:     </rng>
Aug 27 06:40:16 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:40:16 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:40:16 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:40:16 user nova-compute[73258]:     </memballoon>
Aug 27 06:40:16 user nova-compute[73258]:   </devices>
Aug 27 06:40:16 user nova-compute[73258]: </domain>
Aug 27 06:40:16 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:40:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-986376124',display_name='tempest-ServerRescueNegativeTestJSON-server-986376124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-986376124',id=14,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6efa67b959a473da5a06f9e0aa8795f',ramdisk_id='',reservation_id='r-gemtid0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1025141277',owner_user_name='tempest-ServerRescueNegativeTestJSON-1025141277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:40:15Z,user_data=None,user_id='685859ec81944e3398853037c24673a4',uuid=1672aa9f-be6f-4357-877f-a48f62119df4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "217b1702-a403-4f3a-bdae-7793382e5f38", "address": "fa:16:3e:5d:4e:76", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217b1702-a4", "ovs_interfaceid": "217b1702-a403-4f3a-bdae-7793382e5f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converting VIF {"id": "217b1702-a403-4f3a-bdae-7793382e5f38", "address": "fa:16:3e:5d:4e:76", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217b1702-a4", "ovs_interfaceid": "217b1702-a403-4f3a-bdae-7793382e5f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4e:76,bridge_name='br-int',has_traffic_filtering=True,id=217b1702-a403-4f3a-bdae-7793382e5f38,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217b1702-a4') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG os_vif [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4e:76,bridge_name='br-int',has_traffic_filtering=True,id=217b1702-a403-4f3a-bdae-7793382e5f38,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217b1702-a4') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap217b1702-a4, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap217b1702-a4, col_values=(('external_ids', {'iface-id': '217b1702-a403-4f3a-bdae-7793382e5f38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:4e:76', 'vm-uuid': '1672aa9f-be6f-4357-877f-a48f62119df4'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:16 user nova-compute[73258]: INFO os_vif [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4e:76,bridge_name='br-int',has_traffic_filtering=True,id=217b1702-a403-4f3a-bdae-7793382e5f38,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217b1702-a4')
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] No VIF found with MAC fa:16:3e:5d:4e:76, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.network.neutron [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Successfully updated port: f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "refresh_cache-9acc81d9-12bc-46d6-8af9-2fc3106de2b2" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquired lock "refresh_cache-9acc81d9-12bc-46d6-8af9-2fc3106de2b2" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.network.neutron [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.compute.manager [req-587ac74b-3978-4625-a61f-a3323d3c659d req-6f40b0cd-d1c2-45d8-a6eb-5fa68e2d90bb service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received event network-changed-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.compute.manager [req-587ac74b-3978-4625-a61f-a3323d3c659d req-6f40b0cd-d1c2-45d8-a6eb-5fa68e2d90bb service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Refreshing instance network info cache due to event network-changed-f177246f-1def-438b-8ac0-08f4e9cfed50. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-587ac74b-3978-4625-a61f-a3323d3c659d req-6f40b0cd-d1c2-45d8-a6eb-5fa68e2d90bb service nova] Acquiring lock "refresh_cache-9acc81d9-12bc-46d6-8af9-2fc3106de2b2" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.network.neutron [req-ed68f1b3-ef60-42d9-854d-95f0df36274c req-8c815e60-725a-44ae-8290-7c33bd14dec8 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Updated VIF entry in instance network info cache for port 217b1702-a403-4f3a-bdae-7793382e5f38. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.network.neutron [req-ed68f1b3-ef60-42d9-854d-95f0df36274c req-8c815e60-725a-44ae-8290-7c33bd14dec8 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Updating instance_info_cache with network_info: [{"id": "217b1702-a403-4f3a-bdae-7793382e5f38", "address": "fa:16:3e:5d:4e:76", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217b1702-a4", "ovs_interfaceid": "217b1702-a403-4f3a-bdae-7793382e5f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ed68f1b3-ef60-42d9-854d-95f0df36274c req-8c815e60-725a-44ae-8290-7c33bd14dec8 service nova] Releasing lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:40:16 user nova-compute[73258]: DEBUG nova.network.neutron [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.network.neutron [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Updating instance_info_cache with network_info: [{"id": "f177246f-1def-438b-8ac0-08f4e9cfed50", "address": "fa:16:3e:76:c0:d7", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf177246f-1d", "ovs_interfaceid": "f177246f-1def-438b-8ac0-08f4e9cfed50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Releasing lock "refresh_cache-9acc81d9-12bc-46d6-8af9-2fc3106de2b2" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.compute.manager [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Instance network_info: |[{"id": "f177246f-1def-438b-8ac0-08f4e9cfed50", "address": "fa:16:3e:76:c0:d7", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf177246f-1d", "ovs_interfaceid": "f177246f-1def-438b-8ac0-08f4e9cfed50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-587ac74b-3978-4625-a61f-a3323d3c659d req-6f40b0cd-d1c2-45d8-a6eb-5fa68e2d90bb service nova] Acquired lock "refresh_cache-9acc81d9-12bc-46d6-8af9-2fc3106de2b2" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.network.neutron [req-587ac74b-3978-4625-a61f-a3323d3c659d req-6f40b0cd-d1c2-45d8-a6eb-5fa68e2d90bb service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Refreshing network info cache for port f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Start _get_guest_xml network_info=[{"id": "f177246f-1def-438b-8ac0-08f4e9cfed50", "address": "fa:16:3e:76:c0:d7", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf177246f-1d", "ovs_interfaceid": "f177246f-1def-438b-8ac0-08f4e9cfed50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:40:17 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:40:17 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:40:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-934566362',display_name='tempest-ServerRescueNegativeTestJSON-server-934566362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-934566362',id=15,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6efa67b959a473da5a06f9e0aa8795f',ramdisk_id='',reservation_id='r-iad7yyth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1025141277',owner_user_name='tempest-ServerRescueNegativeTestJSON-1025141277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:40:15Z,user_data=None,user_id='685859ec81944e3398853037c24673a4',uuid=9acc81d9-12bc-46d6-8af9-2fc3106de2b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f177246f-1def-438b-8ac0-08f4e9cfed50", "address": "fa:16:3e:76:c0:d7", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf177246f-1d", "ovs_interfaceid": "f177246f-1def-438b-8ac0-08f4e9cfed50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converting VIF {"id": "f177246f-1def-438b-8ac0-08f4e9cfed50", "address": "fa:16:3e:76:c0:d7", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf177246f-1d", "ovs_interfaceid": "f177246f-1def-438b-8ac0-08f4e9cfed50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=f177246f-1def-438b-8ac0-08f4e9cfed50,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf177246f-1d') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.objects.instance [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'pci_devices' on Instance uuid 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:40:17 user nova-compute[73258]:   <uuid>9acc81d9-12bc-46d6-8af9-2fc3106de2b2</uuid>
Aug 27 06:40:17 user nova-compute[73258]:   <name>instance-0000000f</name>
Aug 27 06:40:17 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:40:17 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:40:17 user nova-compute[73258]:   <metadata>
Aug 27 06:40:17 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:40:17 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:40:17 user nova-compute[73258]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-934566362</nova:name>
Aug 27 06:40:17 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:40:17</nova:creationTime>
Aug 27 06:40:17 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:40:17 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:40:17 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:40:17 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:40:17 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:40:17 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:40:17 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:40:17 user nova-compute[73258]:       <nova:owner>
Aug 27 06:40:17 user nova-compute[73258]:         <nova:user uuid="685859ec81944e3398853037c24673a4">tempest-ServerRescueNegativeTestJSON-1025141277-project-member</nova:user>
Aug 27 06:40:17 user nova-compute[73258]:         <nova:project uuid="f6efa67b959a473da5a06f9e0aa8795f">tempest-ServerRescueNegativeTestJSON-1025141277</nova:project>
Aug 27 06:40:17 user nova-compute[73258]:       </nova:owner>
Aug 27 06:40:17 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:40:17 user nova-compute[73258]:       <nova:ports>
Aug 27 06:40:17 user nova-compute[73258]:         <nova:port uuid="f177246f-1def-438b-8ac0-08f4e9cfed50">
Aug 27 06:40:17 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 06:40:17 user nova-compute[73258]:         </nova:port>
Aug 27 06:40:17 user nova-compute[73258]:       </nova:ports>
Aug 27 06:40:17 user nova-compute[73258]:     </nova:instance>
Aug 27 06:40:17 user nova-compute[73258]:   </metadata>
Aug 27 06:40:17 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:40:17 user nova-compute[73258]:     <system>
Aug 27 06:40:17 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:40:17 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:40:17 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:40:17 user nova-compute[73258]:       <entry name="serial">9acc81d9-12bc-46d6-8af9-2fc3106de2b2</entry>
Aug 27 06:40:17 user nova-compute[73258]:       <entry name="uuid">9acc81d9-12bc-46d6-8af9-2fc3106de2b2</entry>
Aug 27 06:40:17 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:40:17 user nova-compute[73258]:     </system>
Aug 27 06:40:17 user nova-compute[73258]:   </sysinfo>
Aug 27 06:40:17 user nova-compute[73258]:   <os>
Aug 27 06:40:17 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:40:17 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:40:17 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:40:17 user nova-compute[73258]:   </os>
Aug 27 06:40:17 user nova-compute[73258]:   <features>
Aug 27 06:40:17 user nova-compute[73258]:     <acpi/>
Aug 27 06:40:17 user nova-compute[73258]:     <apic/>
Aug 27 06:40:17 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:40:17 user nova-compute[73258]:   </features>
Aug 27 06:40:17 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:40:17 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:40:17 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:40:17 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:40:17 user nova-compute[73258]:   </clock>
Aug 27 06:40:17 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:40:17 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:40:17 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:40:17 user nova-compute[73258]:   </cpu>
Aug 27 06:40:17 user nova-compute[73258]:   <devices>
Aug 27 06:40:17 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:40:17 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:40:17 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk"/>
Aug 27 06:40:17 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:40:17 user nova-compute[73258]:     </disk>
Aug 27 06:40:17 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:40:17 user nova-compute[73258]:       <mac address="fa:16:3e:76:c0:d7"/>
Aug 27 06:40:17 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:40:17 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:40:17 user nova-compute[73258]:       <target dev="tapf177246f-1d"/>
Aug 27 06:40:17 user nova-compute[73258]:     </interface>
Aug 27 06:40:17 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:40:17 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/console.log" append="off"/>
Aug 27 06:40:17 user nova-compute[73258]:     </serial>
Aug 27 06:40:17 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:40:17 user nova-compute[73258]:     <video>
Aug 27 06:40:17 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:40:17 user nova-compute[73258]:     </video>
Aug 27 06:40:17 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:40:17 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:40:17 user nova-compute[73258]:     </rng>
Aug 27 06:40:17 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:40:17 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:40:17 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:40:17 user nova-compute[73258]:     </memballoon>
Aug 27 06:40:17 user nova-compute[73258]:   </devices>
Aug 27 06:40:17 user nova-compute[73258]: </domain>
Aug 27 06:40:17 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:40:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-934566362',display_name='tempest-ServerRescueNegativeTestJSON-server-934566362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-934566362',id=15,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6efa67b959a473da5a06f9e0aa8795f',ramdisk_id='',reservation_id='r-iad7yyth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1025141277',owner_user_name='tempest-ServerRescueNegativeTestJSON-1025141277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:40:15Z,user_data=None,user_id='685859ec81944e3398853037c24673a4',uuid=9acc81d9-12bc-46d6-8af9-2fc3106de2b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f177246f-1def-438b-8ac0-08f4e9cfed50", "address": "fa:16:3e:76:c0:d7", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf177246f-1d", "ovs_interfaceid": "f177246f-1def-438b-8ac0-08f4e9cfed50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converting VIF {"id": "f177246f-1def-438b-8ac0-08f4e9cfed50", "address": "fa:16:3e:76:c0:d7", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf177246f-1d", "ovs_interfaceid": "f177246f-1def-438b-8ac0-08f4e9cfed50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=f177246f-1def-438b-8ac0-08f4e9cfed50,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf177246f-1d') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG os_vif [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=f177246f-1def-438b-8ac0-08f4e9cfed50,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf177246f-1d') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf177246f-1d, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf177246f-1d, col_values=(('external_ids', {'iface-id': 'f177246f-1def-438b-8ac0-08f4e9cfed50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:c0:d7', 'vm-uuid': '9acc81d9-12bc-46d6-8af9-2fc3106de2b2'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:17 user nova-compute[73258]: INFO os_vif [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=f177246f-1def-438b-8ac0-08f4e9cfed50,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf177246f-1d')
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] No VIF found with MAC fa:16:3e:76:c0:d7, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.network.neutron [req-587ac74b-3978-4625-a61f-a3323d3c659d req-6f40b0cd-d1c2-45d8-a6eb-5fa68e2d90bb service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Updated VIF entry in instance network info cache for port f177246f-1def-438b-8ac0-08f4e9cfed50. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG nova.network.neutron [req-587ac74b-3978-4625-a61f-a3323d3c659d req-6f40b0cd-d1c2-45d8-a6eb-5fa68e2d90bb service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Updating instance_info_cache with network_info: [{"id": "f177246f-1def-438b-8ac0-08f4e9cfed50", "address": "fa:16:3e:76:c0:d7", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf177246f-1d", "ovs_interfaceid": "f177246f-1def-438b-8ac0-08f4e9cfed50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-587ac74b-3978-4625-a61f-a3323d3c659d req-6f40b0cd-d1c2-45d8-a6eb-5fa68e2d90bb service nova] Releasing lock "refresh_cache-9acc81d9-12bc-46d6-8af9-2fc3106de2b2" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-4c9281b7-b7f3-4ccd-87df-7e3da3b91a95 req-dc848f04-28db-4a54-9915-744bfb16544f service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4c9281b7-b7f3-4ccd-87df-7e3da3b91a95 req-dc848f04-28db-4a54-9915-744bfb16544f service nova] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4c9281b7-b7f3-4ccd-87df-7e3da3b91a95 req-dc848f04-28db-4a54-9915-744bfb16544f service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4c9281b7-b7f3-4ccd-87df-7e3da3b91a95 req-dc848f04-28db-4a54-9915-744bfb16544f service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-4c9281b7-b7f3-4ccd-87df-7e3da3b91a95 req-dc848f04-28db-4a54-9915-744bfb16544f service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] No waiting events found dispatching network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:40:18 user nova-compute[73258]: WARNING nova.compute.manager [req-4c9281b7-b7f3-4ccd-87df-7e3da3b91a95 req-dc848f04-28db-4a54-9915-744bfb16544f service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received unexpected event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 for instance with vm_state building and task_state spawning.
Aug 27 06:40:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-4c9281b7-b7f3-4ccd-87df-7e3da3b91a95 req-dc848f04-28db-4a54-9915-744bfb16544f service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4c9281b7-b7f3-4ccd-87df-7e3da3b91a95 req-dc848f04-28db-4a54-9915-744bfb16544f service nova] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4c9281b7-b7f3-4ccd-87df-7e3da3b91a95 req-dc848f04-28db-4a54-9915-744bfb16544f service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4c9281b7-b7f3-4ccd-87df-7e3da3b91a95 req-dc848f04-28db-4a54-9915-744bfb16544f service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-4c9281b7-b7f3-4ccd-87df-7e3da3b91a95 req-dc848f04-28db-4a54-9915-744bfb16544f service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] No waiting events found dispatching network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:40:18 user nova-compute[73258]: WARNING nova.compute.manager [req-4c9281b7-b7f3-4ccd-87df-7e3da3b91a95 req-dc848f04-28db-4a54-9915-744bfb16544f service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received unexpected event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 for instance with vm_state building and task_state spawning.
Aug 27 06:40:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-710dacb3-6d3a-4944-b9d5-9b98d934f250 req-bd6818bd-e3f8-4c03-a248-dd5e25e680c7 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received event network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-710dacb3-6d3a-4944-b9d5-9b98d934f250 req-bd6818bd-e3f8-4c03-a248-dd5e25e680c7 service nova] Acquiring lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-710dacb3-6d3a-4944-b9d5-9b98d934f250 req-bd6818bd-e3f8-4c03-a248-dd5e25e680c7 service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-710dacb3-6d3a-4944-b9d5-9b98d934f250 req-bd6818bd-e3f8-4c03-a248-dd5e25e680c7 service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-710dacb3-6d3a-4944-b9d5-9b98d934f250 req-bd6818bd-e3f8-4c03-a248-dd5e25e680c7 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] No waiting events found dispatching network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:40:20 user nova-compute[73258]: WARNING nova.compute.manager [req-710dacb3-6d3a-4944-b9d5-9b98d934f250 req-bd6818bd-e3f8-4c03-a248-dd5e25e680c7 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received unexpected event network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 for instance with vm_state building and task_state spawning.
Aug 27 06:40:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-710dacb3-6d3a-4944-b9d5-9b98d934f250 req-bd6818bd-e3f8-4c03-a248-dd5e25e680c7 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received event network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-710dacb3-6d3a-4944-b9d5-9b98d934f250 req-bd6818bd-e3f8-4c03-a248-dd5e25e680c7 service nova] Acquiring lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-710dacb3-6d3a-4944-b9d5-9b98d934f250 req-bd6818bd-e3f8-4c03-a248-dd5e25e680c7 service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-710dacb3-6d3a-4944-b9d5-9b98d934f250 req-bd6818bd-e3f8-4c03-a248-dd5e25e680c7 service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-710dacb3-6d3a-4944-b9d5-9b98d934f250 req-bd6818bd-e3f8-4c03-a248-dd5e25e680c7 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] No waiting events found dispatching network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:40:20 user nova-compute[73258]: WARNING nova.compute.manager [req-710dacb3-6d3a-4944-b9d5-9b98d934f250 req-bd6818bd-e3f8-4c03-a248-dd5e25e680c7 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received unexpected event network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 for instance with vm_state building and task_state spawning.
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118421.248694, 1672aa9f-be6f-4357-877f-a48f62119df4 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:40:21 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] VM Resumed (Lifecycle Event)
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:40:21 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Instance spawned successfully.
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:40:21 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118421.249437, 1672aa9f-be6f-4357-877f-a48f62119df4 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:40:21 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] VM Started (Lifecycle Event)
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:40:21 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:40:21 user nova-compute[73258]: INFO nova.compute.manager [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Took 6.72 seconds to spawn the instance on the hypervisor.
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:40:21 user nova-compute[73258]: INFO nova.compute.manager [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Took 7.50 seconds to build instance.
Aug 27 06:40:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d66d8fee-f4b2-4754-9008-bf4f71230f4f tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "1672aa9f-be6f-4357-877f-a48f62119df4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.601s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118421.6294007, 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:40:21 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] VM Resumed (Lifecycle Event)
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:40:21 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Instance spawned successfully.
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:21 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118421.632311, 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:40:21 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] VM Started (Lifecycle Event)
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:40:21 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:40:21 user nova-compute[73258]: INFO nova.compute.manager [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Took 6.24 seconds to spawn the instance on the hypervisor.
Aug 27 06:40:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:40:21 user nova-compute[73258]: INFO nova.compute.manager [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Took 7.21 seconds to build instance.
Aug 27 06:40:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-231e362d-b9d9-4efd-a1ae-4198e06c9b21 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.316s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:40:23 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Creating image(s)
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Did not create local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Ensure instance console log exists: /opt/stack/data/nova/instances/b1b1b0cd-cd43-459f-aaaa-73ae805f9984/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Start _get_guest_xml network_info=[{"id": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "address": "fa:16:3e:3b:e8:5d", "network": {"id": "99da6780-8423-4561-85a7-9cddac555ead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1622528656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff4b3482c19440abf8930632fdedf2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cdcd84-44", "ovs_interfaceid": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLanNYcx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b1b1b0cd-cd43-459f-aaaa-73ae805f9984', 'attached_at': '', 'detached_at': '', 'volume_id': '09b45154-77cc-47a2-8ced-c072a9acc75f', 'serial': '09b45154-77cc-47a2-8ced-c072a9acc75f'}, 'attachment_id': '7faee13d-a76a-45d2-9905-da4e3b6eea0a', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:40:23 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 06:40:23 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lazy-loading 'vcpu_model' on Instance uuid b1b1b0cd-cd43-459f-aaaa-73ae805f9984 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLanNYcx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:40:23 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 06:40:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:40:23 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 06:40:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:40:23 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7469fe69-100f-4ac8-9168-01258ae47090]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:40:23 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c856bc4f-feb9-464f-9258-d63b2adcda62]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f] added
Aug 27 06:40:23 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d063c63-ffe1-463d-90b4-56e32c10f5aa]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[062ea279-e74e-478c-a8de-1dd29c577faf]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLanNYcx {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLanNYcx" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[85860e21-7d35-4900-b65c-327cb263f547]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hLanNYcx'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a669dc-550f-43fd-92a8-8e98a8729a11]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19c6792-9818-4bfc-b140-2402da950052]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:40:23 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:40:23 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:40:23 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:40:23 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:40:23 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:40:23 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:40:23 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:40:23 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:40:23 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:40:23 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:40:23 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:40:23 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:40:23 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:40:23 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d437aa-1d31-4c80-a1c3-9a0944100653]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f, portal: 172.16.0.220,3260]
Aug 27 06:40:23 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f, portal: 172.16.0.220,3260] successful.
Aug 27 06:40:23 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0167f5f9-eaff-43fc-8094-8d656120778d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:40:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eef073-abdc-4c78-97fe-96497db6b630]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:40:24 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:40:24 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:40:24 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:40:24 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:40:24 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:40:24 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:40:24 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:40:24 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:40:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:40:24 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:40:24 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:40:24 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:40:24 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:40:24 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:40:24 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:40:24 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:40:24 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:40:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:40:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:40:24 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:40:24 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:40:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01a9bdd-f4c9-47c5-bfe8-74ab65f20142]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:24 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: None {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLanNYcx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26637646564633932', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637646564633932', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T06:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2113859215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-365915423',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXC+TqgbsZa3q6c5XtC1rMSZD6ezy7FUZNfIQqoaxgbog95i8n8Q42gJYkXEfdMM0sUAvXFMvuFpDd9ZOnMo/2eGVlV1fH/AwaBhBltragdNT3zavkJFQGky/A1N5DJmA==',key_name='tempest-keypair-1590337091',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:38:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ff4b3482c19440abf8930632fdedf2a',ramdisk_id='',reservation_id='r-i6gcfele',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-611468989',owner_user_name='tempest-ServerActionsV293TestJSON-611468989-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:40:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba84ad5267474566aaad7bfbef1eb327',uuid=b1b1b0cd-cd43-459f-aaaa-73ae805f9984,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "address": "fa:16:3e:3b:e8:5d", "network": {"id": "99da6780-8423-4561-85a7-9cddac555ead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1622528656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff4b3482c19440abf8930632fdedf2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cdcd84-44", "ovs_interfaceid": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Converting VIF {"id": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "address": "fa:16:3e:3b:e8:5d", "network": {"id": "99da6780-8423-4561-85a7-9cddac555ead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1622528656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff4b3482c19440abf8930632fdedf2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cdcd84-44", "ovs_interfaceid": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e8:5d,bridge_name='br-int',has_traffic_filtering=True,id=d1cdcd84-44c1-4385-8671-6481d8a17e57,network=Network(99da6780-8423-4561-85a7-9cddac555ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cdcd84-44') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:40:25 user nova-compute[73258]:   <uuid>b1b1b0cd-cd43-459f-aaaa-73ae805f9984</uuid>
Aug 27 06:40:25 user nova-compute[73258]:   <name>instance-0000000a</name>
Aug 27 06:40:25 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:40:25 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:40:25 user nova-compute[73258]:   <metadata>
Aug 27 06:40:25 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:40:25 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:40:25 user nova-compute[73258]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2113859215</nova:name>
Aug 27 06:40:25 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:40:23</nova:creationTime>
Aug 27 06:40:25 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:40:25 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:40:25 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:40:25 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:40:25 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:40:25 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:40:25 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:40:25 user nova-compute[73258]:       <nova:owner>
Aug 27 06:40:25 user nova-compute[73258]:         <nova:user uuid="ba84ad5267474566aaad7bfbef1eb327">tempest-ServerActionsV293TestJSON-611468989-project-member</nova:user>
Aug 27 06:40:25 user nova-compute[73258]:         <nova:project uuid="2ff4b3482c19440abf8930632fdedf2a">tempest-ServerActionsV293TestJSON-611468989</nova:project>
Aug 27 06:40:25 user nova-compute[73258]:       </nova:owner>
Aug 27 06:40:25 user nova-compute[73258]:       <nova:ports>
Aug 27 06:40:25 user nova-compute[73258]:         <nova:port uuid="d1cdcd84-44c1-4385-8671-6481d8a17e57">
Aug 27 06:40:25 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 06:40:25 user nova-compute[73258]:         </nova:port>
Aug 27 06:40:25 user nova-compute[73258]:       </nova:ports>
Aug 27 06:40:25 user nova-compute[73258]:     </nova:instance>
Aug 27 06:40:25 user nova-compute[73258]:   </metadata>
Aug 27 06:40:25 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:40:25 user nova-compute[73258]:     <system>
Aug 27 06:40:25 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:40:25 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:40:25 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:40:25 user nova-compute[73258]:       <entry name="serial">b1b1b0cd-cd43-459f-aaaa-73ae805f9984</entry>
Aug 27 06:40:25 user nova-compute[73258]:       <entry name="uuid">b1b1b0cd-cd43-459f-aaaa-73ae805f9984</entry>
Aug 27 06:40:25 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:40:25 user nova-compute[73258]:     </system>
Aug 27 06:40:25 user nova-compute[73258]:   </sysinfo>
Aug 27 06:40:25 user nova-compute[73258]:   <os>
Aug 27 06:40:25 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:40:25 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:40:25 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:40:25 user nova-compute[73258]:   </os>
Aug 27 06:40:25 user nova-compute[73258]:   <features>
Aug 27 06:40:25 user nova-compute[73258]:     <acpi/>
Aug 27 06:40:25 user nova-compute[73258]:     <apic/>
Aug 27 06:40:25 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:40:25 user nova-compute[73258]:   </features>
Aug 27 06:40:25 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:40:25 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:40:25 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:40:25 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:40:25 user nova-compute[73258]:   </clock>
Aug 27 06:40:25 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:40:25 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:40:25 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:40:25 user nova-compute[73258]:   </cpu>
Aug 27 06:40:25 user nova-compute[73258]:   <devices>
Aug 27 06:40:25 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:40:25 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:40:25 user nova-compute[73258]:       <source dev="/dev/sdb"/>
Aug 27 06:40:25 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:40:25 user nova-compute[73258]:       <serial>09b45154-77cc-47a2-8ced-c072a9acc75f</serial>
Aug 27 06:40:25 user nova-compute[73258]:     </disk>
Aug 27 06:40:25 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:40:25 user nova-compute[73258]:       <mac address="fa:16:3e:3b:e8:5d"/>
Aug 27 06:40:25 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:40:25 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:40:25 user nova-compute[73258]:       <target dev="tapd1cdcd84-44"/>
Aug 27 06:40:25 user nova-compute[73258]:     </interface>
Aug 27 06:40:25 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:40:25 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/b1b1b0cd-cd43-459f-aaaa-73ae805f9984/console.log" append="off"/>
Aug 27 06:40:25 user nova-compute[73258]:     </serial>
Aug 27 06:40:25 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:40:25 user nova-compute[73258]:     <video>
Aug 27 06:40:25 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:40:25 user nova-compute[73258]:     </video>
Aug 27 06:40:25 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:40:25 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:40:25 user nova-compute[73258]:     </rng>
Aug 27 06:40:25 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:40:25 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:40:25 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:40:25 user nova-compute[73258]:     </memballoon>
Aug 27 06:40:25 user nova-compute[73258]:   </devices>
Aug 27 06:40:25 user nova-compute[73258]: </domain>
Aug 27 06:40:25 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T06:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2113859215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-365915423',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXC+TqgbsZa3q6c5XtC1rMSZD6ezy7FUZNfIQqoaxgbog95i8n8Q42gJYkXEfdMM0sUAvXFMvuFpDd9ZOnMo/2eGVlV1fH/AwaBhBltragdNT3zavkJFQGky/A1N5DJmA==',key_name='tempest-keypair-1590337091',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:38:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ff4b3482c19440abf8930632fdedf2a',ramdisk_id='',reservation_id='r-i6gcfele',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-611468989',owner_user_name='tempest-ServerActionsV293TestJSON-611468989-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:40:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba84ad5267474566aaad7bfbef1eb327',uuid=b1b1b0cd-cd43-459f-aaaa-73ae805f9984,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "address": "fa:16:3e:3b:e8:5d", "network": {"id": "99da6780-8423-4561-85a7-9cddac555ead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1622528656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff4b3482c19440abf8930632fdedf2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cdcd84-44", "ovs_interfaceid": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Converting VIF {"id": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "address": "fa:16:3e:3b:e8:5d", "network": {"id": "99da6780-8423-4561-85a7-9cddac555ead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1622528656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff4b3482c19440abf8930632fdedf2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cdcd84-44", "ovs_interfaceid": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e8:5d,bridge_name='br-int',has_traffic_filtering=True,id=d1cdcd84-44c1-4385-8671-6481d8a17e57,network=Network(99da6780-8423-4561-85a7-9cddac555ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cdcd84-44') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG os_vif [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e8:5d,bridge_name='br-int',has_traffic_filtering=True,id=d1cdcd84-44c1-4385-8671-6481d8a17e57,network=Network(99da6780-8423-4561-85a7-9cddac555ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cdcd84-44') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1cdcd84-44, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1cdcd84-44, col_values=(('external_ids', {'iface-id': 'd1cdcd84-44c1-4385-8671-6481d8a17e57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:e8:5d', 'vm-uuid': 'b1b1b0cd-cd43-459f-aaaa-73ae805f9984'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:25 user nova-compute[73258]: INFO os_vif [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e8:5d,bridge_name='br-int',has_traffic_filtering=True,id=d1cdcd84-44c1-4385-8671-6481d8a17e57,network=Network(99da6780-8423-4561-85a7-9cddac555ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cdcd84-44')
Aug 27 06:40:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:40:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] No VIF found with MAC fa:16:3e:3b:e8:5d, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:40:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "de8b1f89-9b89-439a-ab73-21e24e299460" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "de8b1f89-9b89-439a-ab73-21e24e299460" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:40:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:26 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:40:26 user nova-compute[73258]: INFO nova.compute.claims [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Claim successful on node user
Aug 27 06:40:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-991f95e5-1612-4697-9459-6ab44548cf85 req-066e9986-97a7-44ca-a693-b510eed98216 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received event network-vif-plugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-991f95e5-1612-4697-9459-6ab44548cf85 req-066e9986-97a7-44ca-a693-b510eed98216 service nova] Acquiring lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-991f95e5-1612-4697-9459-6ab44548cf85 req-066e9986-97a7-44ca-a693-b510eed98216 service nova] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-991f95e5-1612-4697-9459-6ab44548cf85 req-066e9986-97a7-44ca-a693-b510eed98216 service nova] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-991f95e5-1612-4697-9459-6ab44548cf85 req-066e9986-97a7-44ca-a693-b510eed98216 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] No waiting events found dispatching network-vif-plugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:40:26 user nova-compute[73258]: WARNING nova.compute.manager [req-991f95e5-1612-4697-9459-6ab44548cf85 req-066e9986-97a7-44ca-a693-b510eed98216 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received unexpected event network-vif-plugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 for instance with vm_state active and task_state rebuild_spawning.
Aug 27 06:40:27 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.706s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG nova.network.neutron [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:40:27 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:40:27 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG nova.policy [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff56e21976b246b297b6d15c9ba81c89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d8e2938a0a4a97ac0b3f381626e880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:40:27 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Creating image(s)
Aug 27 06:40:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "/opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "/opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "/opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.199s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.204s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG nova.network.neutron [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Successfully created port: bf9fda41-86e3-4e71-a329-d07b03ec63e6 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/disk 1073741824" returned: 0 in 0.071s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.198s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:40:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Cannot resize image /opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Ensure instance console log exists: /opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG nova.network.neutron [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Successfully updated port: bf9fda41-86e3-4e71-a329-d07b03ec63e6 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "refresh_cache-de8b1f89-9b89-439a-ab73-21e24e299460" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquired lock "refresh_cache-de8b1f89-9b89-439a-ab73-21e24e299460" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG nova.network.neutron [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-c9c593b2-b3c7-4e99-a12c-f80cdce09bb0 req-7f676734-900c-44aa-ba3a-cfaaa9f20cc6 service nova] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Received event network-changed-bf9fda41-86e3-4e71-a329-d07b03ec63e6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-c9c593b2-b3c7-4e99-a12c-f80cdce09bb0 req-7f676734-900c-44aa-ba3a-cfaaa9f20cc6 service nova] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Refreshing instance network info cache due to event network-changed-bf9fda41-86e3-4e71-a329-d07b03ec63e6. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c9c593b2-b3c7-4e99-a12c-f80cdce09bb0 req-7f676734-900c-44aa-ba3a-cfaaa9f20cc6 service nova] Acquiring lock "refresh_cache-de8b1f89-9b89-439a-ab73-21e24e299460" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG nova.network.neutron [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118428.9440584, b1b1b0cd-cd43-459f-aaaa-73ae805f9984 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:40:28 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] VM Resumed (Lifecycle Event)
Aug 27 06:40:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-0a5907fb-ae72-4f75-a67a-227c9ef955ec req-b8b675e0-400a-4a75-8d1f-7a04a29b0b9d service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received event network-vif-plugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0a5907fb-ae72-4f75-a67a-227c9ef955ec req-b8b675e0-400a-4a75-8d1f-7a04a29b0b9d service nova] Acquiring lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0a5907fb-ae72-4f75-a67a-227c9ef955ec req-b8b675e0-400a-4a75-8d1f-7a04a29b0b9d service nova] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0a5907fb-ae72-4f75-a67a-227c9ef955ec req-b8b675e0-400a-4a75-8d1f-7a04a29b0b9d service nova] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-0a5907fb-ae72-4f75-a67a-227c9ef955ec req-b8b675e0-400a-4a75-8d1f-7a04a29b0b9d service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] No waiting events found dispatching network-vif-plugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:40:28 user nova-compute[73258]: WARNING nova.compute.manager [req-0a5907fb-ae72-4f75-a67a-227c9ef955ec req-b8b675e0-400a-4a75-8d1f-7a04a29b0b9d service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received unexpected event network-vif-plugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 for instance with vm_state active and task_state rebuild_spawning.
Aug 27 06:40:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:40:28 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Instance spawned successfully.
Aug 27 06:40:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:40:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:40:29 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118428.9442346, b1b1b0cd-cd43-459f-aaaa-73ae805f9984 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:40:29 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] VM Started (Lifecycle Event)
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:40:29 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73258) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.network.neutron [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Updating instance_info_cache with network_info: [{"id": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "address": "fa:16:3e:d9:7a:b3", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fda41-86", "ovs_interfaceid": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Releasing lock "refresh_cache-de8b1f89-9b89-439a-ab73-21e24e299460" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Instance network_info: |[{"id": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "address": "fa:16:3e:d9:7a:b3", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fda41-86", "ovs_interfaceid": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c9c593b2-b3c7-4e99-a12c-f80cdce09bb0 req-7f676734-900c-44aa-ba3a-cfaaa9f20cc6 service nova] Acquired lock "refresh_cache-de8b1f89-9b89-439a-ab73-21e24e299460" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.network.neutron [req-c9c593b2-b3c7-4e99-a12c-f80cdce09bb0 req-7f676734-900c-44aa-ba3a-cfaaa9f20cc6 service nova] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Refreshing network info cache for port bf9fda41-86e3-4e71-a329-d07b03ec63e6 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Start _get_guest_xml network_info=[{"id": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "address": "fa:16:3e:d9:7a:b3", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fda41-86", "ovs_interfaceid": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:40:29 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:40:29 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:40:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a608d0bb-53cf-463d-ae83-0fd5902a12bf tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.084s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-918449526',display_name='tempest-VolumesAdminNegativeTest-server-918449526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-918449526',id=16,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28d8e2938a0a4a97ac0b3f381626e880',ramdisk_id='',reservation_id='r-avy19eqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2002818274',owner_user_name='tempest-VolumesAdminNegativeTest-2002818274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:40:27Z,user_data=None,user_id='ff56e21976b246b297b6d15c9ba81c89',uuid=de8b1f89-9b89-439a-ab73-21e24e299460,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "address": "fa:16:3e:d9:7a:b3", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fda41-86", "ovs_interfaceid": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Converting VIF {"id": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "address": "fa:16:3e:d9:7a:b3", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fda41-86", "ovs_interfaceid": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:7a:b3,bridge_name='br-int',has_traffic_filtering=True,id=bf9fda41-86e3-4e71-a329-d07b03ec63e6,network=Network(41b0df8b-c615-470d-85ba-7289905946cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fda41-86') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.objects.instance [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lazy-loading 'pci_devices' on Instance uuid de8b1f89-9b89-439a-ab73-21e24e299460 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:40:29 user nova-compute[73258]:   <uuid>de8b1f89-9b89-439a-ab73-21e24e299460</uuid>
Aug 27 06:40:29 user nova-compute[73258]:   <name>instance-00000010</name>
Aug 27 06:40:29 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:40:29 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:40:29 user nova-compute[73258]:   <metadata>
Aug 27 06:40:29 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:40:29 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:40:29 user nova-compute[73258]:       <nova:name>tempest-VolumesAdminNegativeTest-server-918449526</nova:name>
Aug 27 06:40:29 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:40:29</nova:creationTime>
Aug 27 06:40:29 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:40:29 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:40:29 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:40:29 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:40:29 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:40:29 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:40:29 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:40:29 user nova-compute[73258]:       <nova:owner>
Aug 27 06:40:29 user nova-compute[73258]:         <nova:user uuid="ff56e21976b246b297b6d15c9ba81c89">tempest-VolumesAdminNegativeTest-2002818274-project-member</nova:user>
Aug 27 06:40:29 user nova-compute[73258]:         <nova:project uuid="28d8e2938a0a4a97ac0b3f381626e880">tempest-VolumesAdminNegativeTest-2002818274</nova:project>
Aug 27 06:40:29 user nova-compute[73258]:       </nova:owner>
Aug 27 06:40:29 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:40:29 user nova-compute[73258]:       <nova:ports>
Aug 27 06:40:29 user nova-compute[73258]:         <nova:port uuid="bf9fda41-86e3-4e71-a329-d07b03ec63e6">
Aug 27 06:40:29 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 06:40:29 user nova-compute[73258]:         </nova:port>
Aug 27 06:40:29 user nova-compute[73258]:       </nova:ports>
Aug 27 06:40:29 user nova-compute[73258]:     </nova:instance>
Aug 27 06:40:29 user nova-compute[73258]:   </metadata>
Aug 27 06:40:29 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:40:29 user nova-compute[73258]:     <system>
Aug 27 06:40:29 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:40:29 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:40:29 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:40:29 user nova-compute[73258]:       <entry name="serial">de8b1f89-9b89-439a-ab73-21e24e299460</entry>
Aug 27 06:40:29 user nova-compute[73258]:       <entry name="uuid">de8b1f89-9b89-439a-ab73-21e24e299460</entry>
Aug 27 06:40:29 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:40:29 user nova-compute[73258]:     </system>
Aug 27 06:40:29 user nova-compute[73258]:   </sysinfo>
Aug 27 06:40:29 user nova-compute[73258]:   <os>
Aug 27 06:40:29 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:40:29 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:40:29 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:40:29 user nova-compute[73258]:   </os>
Aug 27 06:40:29 user nova-compute[73258]:   <features>
Aug 27 06:40:29 user nova-compute[73258]:     <acpi/>
Aug 27 06:40:29 user nova-compute[73258]:     <apic/>
Aug 27 06:40:29 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:40:29 user nova-compute[73258]:   </features>
Aug 27 06:40:29 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:40:29 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:40:29 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:40:29 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:40:29 user nova-compute[73258]:   </clock>
Aug 27 06:40:29 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:40:29 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:40:29 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:40:29 user nova-compute[73258]:   </cpu>
Aug 27 06:40:29 user nova-compute[73258]:   <devices>
Aug 27 06:40:29 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:40:29 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:40:29 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/disk"/>
Aug 27 06:40:29 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:40:29 user nova-compute[73258]:     </disk>
Aug 27 06:40:29 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:40:29 user nova-compute[73258]:       <mac address="fa:16:3e:d9:7a:b3"/>
Aug 27 06:40:29 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:40:29 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:40:29 user nova-compute[73258]:       <target dev="tapbf9fda41-86"/>
Aug 27 06:40:29 user nova-compute[73258]:     </interface>
Aug 27 06:40:29 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:40:29 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/console.log" append="off"/>
Aug 27 06:40:29 user nova-compute[73258]:     </serial>
Aug 27 06:40:29 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:40:29 user nova-compute[73258]:     <video>
Aug 27 06:40:29 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:40:29 user nova-compute[73258]:     </video>
Aug 27 06:40:29 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:40:29 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:40:29 user nova-compute[73258]:     </rng>
Aug 27 06:40:29 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:40:29 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:40:29 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:40:29 user nova-compute[73258]:     </memballoon>
Aug 27 06:40:29 user nova-compute[73258]:   </devices>
Aug 27 06:40:29 user nova-compute[73258]: </domain>
Aug 27 06:40:29 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-918449526',display_name='tempest-VolumesAdminNegativeTest-server-918449526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-918449526',id=16,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28d8e2938a0a4a97ac0b3f381626e880',ramdisk_id='',reservation_id='r-avy19eqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2002818274',owner_user_name='tempest-VolumesAdminNegativeTest-2002818274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:40:27Z,user_data=None,user_id='ff56e21976b246b297b6d15c9ba81c89',uuid=de8b1f89-9b89-439a-ab73-21e24e299460,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "address": "fa:16:3e:d9:7a:b3", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fda41-86", "ovs_interfaceid": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Converting VIF {"id": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "address": "fa:16:3e:d9:7a:b3", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fda41-86", "ovs_interfaceid": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:7a:b3,bridge_name='br-int',has_traffic_filtering=True,id=bf9fda41-86e3-4e71-a329-d07b03ec63e6,network=Network(41b0df8b-c615-470d-85ba-7289905946cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fda41-86') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG os_vif [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:7a:b3,bridge_name='br-int',has_traffic_filtering=True,id=bf9fda41-86e3-4e71-a329-d07b03ec63e6,network=Network(41b0df8b-c615-470d-85ba-7289905946cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fda41-86') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf9fda41-86, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf9fda41-86, col_values=(('external_ids', {'iface-id': 'bf9fda41-86e3-4e71-a329-d07b03ec63e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:7a:b3', 'vm-uuid': 'de8b1f89-9b89-439a-ab73-21e24e299460'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:29 user nova-compute[73258]: INFO os_vif [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:7a:b3,bridge_name='br-int',has_traffic_filtering=True,id=bf9fda41-86e3-4e71-a329-d07b03ec63e6,network=Network(41b0df8b-c615-470d-85ba-7289905946cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fda41-86')
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] No VIF found with MAC fa:16:3e:d9:7a:b3, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.network.neutron [req-c9c593b2-b3c7-4e99-a12c-f80cdce09bb0 req-7f676734-900c-44aa-ba3a-cfaaa9f20cc6 service nova] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Updated VIF entry in instance network info cache for port bf9fda41-86e3-4e71-a329-d07b03ec63e6. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG nova.network.neutron [req-c9c593b2-b3c7-4e99-a12c-f80cdce09bb0 req-7f676734-900c-44aa-ba3a-cfaaa9f20cc6 service nova] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Updating instance_info_cache with network_info: [{"id": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "address": "fa:16:3e:d9:7a:b3", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fda41-86", "ovs_interfaceid": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:40:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c9c593b2-b3c7-4e99-a12c-f80cdce09bb0 req-7f676734-900c-44aa-ba3a-cfaaa9f20cc6 service nova] Releasing lock "refresh_cache-de8b1f89-9b89-439a-ab73-21e24e299460" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:40:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:31 user nova-compute[73258]: DEBUG nova.compute.manager [req-ff653c1c-9f6c-4282-839f-c1675d244d92 req-82c05dd5-09c6-4531-a4e6-241af43fdcb2 service nova] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Received event network-vif-plugged-bf9fda41-86e3-4e71-a329-d07b03ec63e6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ff653c1c-9f6c-4282-839f-c1675d244d92 req-82c05dd5-09c6-4531-a4e6-241af43fdcb2 service nova] Acquiring lock "de8b1f89-9b89-439a-ab73-21e24e299460-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ff653c1c-9f6c-4282-839f-c1675d244d92 req-82c05dd5-09c6-4531-a4e6-241af43fdcb2 service nova] Lock "de8b1f89-9b89-439a-ab73-21e24e299460-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ff653c1c-9f6c-4282-839f-c1675d244d92 req-82c05dd5-09c6-4531-a4e6-241af43fdcb2 service nova] Lock "de8b1f89-9b89-439a-ab73-21e24e299460-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:31 user nova-compute[73258]: DEBUG nova.compute.manager [req-ff653c1c-9f6c-4282-839f-c1675d244d92 req-82c05dd5-09c6-4531-a4e6-241af43fdcb2 service nova] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] No waiting events found dispatching network-vif-plugged-bf9fda41-86e3-4e71-a329-d07b03ec63e6 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:40:31 user nova-compute[73258]: WARNING nova.compute.manager [req-ff653c1c-9f6c-4282-839f-c1675d244d92 req-82c05dd5-09c6-4531-a4e6-241af43fdcb2 service nova] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Received unexpected event network-vif-plugged-bf9fda41-86e3-4e71-a329-d07b03ec63e6 for instance with vm_state building and task_state spawning.
Aug 27 06:40:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:33 user nova-compute[73258]: DEBUG nova.compute.manager [req-0ab116e1-eaf9-4849-a1f9-ebbab83d15c3 req-c4780829-96d5-4b14-94d2-bfed01470391 service nova] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Received event network-vif-plugged-bf9fda41-86e3-4e71-a329-d07b03ec63e6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0ab116e1-eaf9-4849-a1f9-ebbab83d15c3 req-c4780829-96d5-4b14-94d2-bfed01470391 service nova] Acquiring lock "de8b1f89-9b89-439a-ab73-21e24e299460-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0ab116e1-eaf9-4849-a1f9-ebbab83d15c3 req-c4780829-96d5-4b14-94d2-bfed01470391 service nova] Lock "de8b1f89-9b89-439a-ab73-21e24e299460-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0ab116e1-eaf9-4849-a1f9-ebbab83d15c3 req-c4780829-96d5-4b14-94d2-bfed01470391 service nova] Lock "de8b1f89-9b89-439a-ab73-21e24e299460-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:33 user nova-compute[73258]: DEBUG nova.compute.manager [req-0ab116e1-eaf9-4849-a1f9-ebbab83d15c3 req-c4780829-96d5-4b14-94d2-bfed01470391 service nova] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] No waiting events found dispatching network-vif-plugged-bf9fda41-86e3-4e71-a329-d07b03ec63e6 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:40:33 user nova-compute[73258]: WARNING nova.compute.manager [req-0ab116e1-eaf9-4849-a1f9-ebbab83d15c3 req-c4780829-96d5-4b14-94d2-bfed01470391 service nova] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Received unexpected event network-vif-plugged-bf9fda41-86e3-4e71-a329-d07b03ec63e6 for instance with vm_state building and task_state spawning.
Aug 27 06:40:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:40:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:40:33 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118433.491841, de8b1f89-9b89-439a-ab73-21e24e299460 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:40:33 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] VM Resumed (Lifecycle Event)
Aug 27 06:40:33 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Instance spawned successfully.
Aug 27 06:40:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:40:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:40:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:40:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:33 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:40:33 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118433.4919322, de8b1f89-9b89-439a-ab73-21e24e299460 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:40:33 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] VM Started (Lifecycle Event)
Aug 27 06:40:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:40:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:40:33 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:40:33 user nova-compute[73258]: INFO nova.compute.manager [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Took 6.44 seconds to spawn the instance on the hypervisor.
Aug 27 06:40:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:40:33 user nova-compute[73258]: INFO nova.compute.manager [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Took 7.52 seconds to build instance.
Aug 27 06:40:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3e5877f5-00a3-4549-8a14-a1320b15b742 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "de8b1f89-9b89-439a-ab73-21e24e299460" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.639s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Skipping network cache update for instance because it has been migrated to another host. {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquiring lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquiring lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:36 user nova-compute[73258]: INFO nova.compute.manager [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Terminating instance
Aug 27 06:40:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG nova.compute.manager [req-f6172ccb-f39c-4c25-8d17-794ea45ae1de req-f27091a3-4a59-4f5b-aabf-e2afbae0622b service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received event network-vif-unplugged-e84fffb7-b665-47d1-a38c-525d4ada5d39 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f6172ccb-f39c-4c25-8d17-794ea45ae1de req-f27091a3-4a59-4f5b-aabf-e2afbae0622b service nova] Acquiring lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f6172ccb-f39c-4c25-8d17-794ea45ae1de req-f27091a3-4a59-4f5b-aabf-e2afbae0622b service nova] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f6172ccb-f39c-4c25-8d17-794ea45ae1de req-f27091a3-4a59-4f5b-aabf-e2afbae0622b service nova] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG nova.compute.manager [req-f6172ccb-f39c-4c25-8d17-794ea45ae1de req-f27091a3-4a59-4f5b-aabf-e2afbae0622b service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] No waiting events found dispatching network-vif-unplugged-e84fffb7-b665-47d1-a38c-525d4ada5d39 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:40:36 user nova-compute[73258]: DEBUG nova.compute.manager [req-f6172ccb-f39c-4c25-8d17-794ea45ae1de req-f27091a3-4a59-4f5b-aabf-e2afbae0622b service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received event network-vif-unplugged-e84fffb7-b665-47d1-a38c-525d4ada5d39 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Updating instance_info_cache with network_info: [{"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:40:37 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Instance destroyed successfully.
Aug 27 06:40:37 user nova-compute[73258]: DEBUG nova.objects.instance [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lazy-loading 'resources' on Instance uuid 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:37:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-272504122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-272504122',id=8,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyavg0YndUGAOgB67L8HRF7F2iikxrnrdEVXLpabs98eaA0ZuhB1u8SuP+LgJpkPNPLmHjFchg3jVefSbPuOz2/jsOg0UsGBCCfjGt2BWTYtT1VtCqWWdtqNXaQw6MrAw==',key_name='tempest-keypair-967100910',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:37:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae3fc6b23bb4467891da7bc8a1b4ae49',ramdisk_id='',reservation_id='r-bpbfl8r5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-45928959',owner_user_name='tempest-TaggedAttachmentsTest-45928959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53ae2b77bfcf461fbc01429ee1f052b8',uuid=70af3b5e-3a68-41b3-9f92-2b3a36a9d21e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "address": "fa:16:3e:9e:b0:e1", "network": {"id": "9bc98272-6eb0-4ce7-ba14-721aa5b74a67", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-969683990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape84fffb7-b6", "ovs_interfaceid": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Converting VIF {"id": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "address": "fa:16:3e:9e:b0:e1", "network": {"id": "9bc98272-6eb0-4ce7-ba14-721aa5b74a67", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-969683990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae3fc6b23bb4467891da7bc8a1b4ae49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape84fffb7-b6", "ovs_interfaceid": "e84fffb7-b665-47d1-a38c-525d4ada5d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b0:e1,bridge_name='br-int',has_traffic_filtering=True,id=e84fffb7-b665-47d1-a38c-525d4ada5d39,network=Network(9bc98272-6eb0-4ce7-ba14-721aa5b74a67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape84fffb7-b6') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG os_vif [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b0:e1,bridge_name='br-int',has_traffic_filtering=True,id=e84fffb7-b665-47d1-a38c-525d4ada5d39,network=Network(9bc98272-6eb0-4ce7-ba14-721aa5b74a67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape84fffb7-b6') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape84fffb7-b6, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:37 user nova-compute[73258]: INFO os_vif [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:b0:e1,bridge_name='br-int',has_traffic_filtering=True,id=e84fffb7-b665-47d1-a38c-525d4ada5d39,network=Network(9bc98272-6eb0-4ce7-ba14-721aa5b74a67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape84fffb7-b6')
Aug 27 06:40:37 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Deleting instance files /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e_del
Aug 27 06:40:37 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Deletion of /opt/stack/data/nova/instances/70af3b5e-3a68-41b3-9f92-2b3a36a9d21e_del complete
Aug 27 06:40:37 user nova-compute[73258]: INFO nova.compute.manager [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 27 06:40:37 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:40:37 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:40:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:38 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:40:38 user nova-compute[73258]: DEBUG nova.compute.manager [req-800f5ea7-326f-4edf-81f7-3692f7410c1b req-6e97e65a-5ab6-4a87-abcb-dd2c86127d0a service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received event network-vif-deleted-e84fffb7-b665-47d1-a38c-525d4ada5d39 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:38 user nova-compute[73258]: INFO nova.compute.manager [req-800f5ea7-326f-4edf-81f7-3692f7410c1b req-6e97e65a-5ab6-4a87-abcb-dd2c86127d0a service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Neutron deleted interface e84fffb7-b665-47d1-a38c-525d4ada5d39; detaching it from the instance and deleting it from the info cache
Aug 27 06:40:38 user nova-compute[73258]: DEBUG nova.network.neutron [req-800f5ea7-326f-4edf-81f7-3692f7410c1b req-6e97e65a-5ab6-4a87-abcb-dd2c86127d0a service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:40:38 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Took 1.04 seconds to deallocate network for instance.
Aug 27 06:40:38 user nova-compute[73258]: DEBUG nova.compute.manager [req-800f5ea7-326f-4edf-81f7-3692f7410c1b req-6e97e65a-5ab6-4a87-abcb-dd2c86127d0a service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Detach interface failed, port_id=e84fffb7-b665-47d1-a38c-525d4ada5d39, reason: Instance 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:40:38 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:38 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:39 user nova-compute[73258]: DEBUG nova.compute.manager [req-df9090f8-2bcd-40f5-8dcb-9bc1856b3039 req-f2b1563e-5446-436a-af9c-53e01a5b5de3 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received event network-vif-plugged-e84fffb7-b665-47d1-a38c-525d4ada5d39 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-df9090f8-2bcd-40f5-8dcb-9bc1856b3039 req-f2b1563e-5446-436a-af9c-53e01a5b5de3 service nova] Acquiring lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-df9090f8-2bcd-40f5-8dcb-9bc1856b3039 req-f2b1563e-5446-436a-af9c-53e01a5b5de3 service nova] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-df9090f8-2bcd-40f5-8dcb-9bc1856b3039 req-f2b1563e-5446-436a-af9c-53e01a5b5de3 service nova] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:39 user nova-compute[73258]: DEBUG nova.compute.manager [req-df9090f8-2bcd-40f5-8dcb-9bc1856b3039 req-f2b1563e-5446-436a-af9c-53e01a5b5de3 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] No waiting events found dispatching network-vif-plugged-e84fffb7-b665-47d1-a38c-525d4ada5d39 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:40:39 user nova-compute[73258]: WARNING nova.compute.manager [req-df9090f8-2bcd-40f5-8dcb-9bc1856b3039 req-f2b1563e-5446-436a-af9c-53e01a5b5de3 service nova] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Received unexpected event network-vif-plugged-e84fffb7-b665-47d1-a38c-525d4ada5d39 for instance with vm_state deleted and task_state None.
Aug 27 06:40:39 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:40:39 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:40:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.568s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:39 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Deleted allocations for instance 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e
Aug 27 06:40:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-807d3397-0e77-4614-9faa-c2905fb4f81b tempest-TaggedAttachmentsTest-45928959 tempest-TaggedAttachmentsTest-45928959-project-member] Lock "70af3b5e-3a68-41b3-9f92-2b3a36a9d21e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.150s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG nova.objects.instance [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lazy-loading 'flavor' on Instance uuid 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:40 user nova-compute[73258]: INFO nova.compute.manager [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Attaching volume 9cd5d71a-02b4-444b-9f79-09f9c5ea5109 to /dev/vdb
Aug 27 06:40:40 user nova-compute[73258]: DEBUG os_brick.utils [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[65256171-fd02-49b4-babb-82fc1d0950f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d56e81-ef32-4b1c-b0c8-0304f036602d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "4a2970a3-2a05-4462-bf0b-1595743222fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[73005cc2-b7e3-4905-bffe-46e33676084f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bcb6fc-19e7-4322-9974-5c25534b4179]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG nova.compute.manager [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:40:40 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0201d8e-df35-45de-99e3-ad0b5c8554fc]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG os_brick.utils [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Updating existing volume attachment record: b0e70499-ab70-429e-ad02-950f5ad7a8a4 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:40:40 user nova-compute[73258]: INFO nova.compute.claims [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Claim successful on node user
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:40:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:41 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:40:41 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:40:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.727s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:40:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.596s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:41 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:40:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:40:41 user nova-compute[73258]: DEBUG nova.network.neutron [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:40:41 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:40:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:40:41 user nova-compute[73258]: DEBUG nova.policy [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67f8a06ab5634f60b6ed2d1d9b2c342e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57faf7cb6c704c05aba06857a6cdd29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:40:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:40:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:40:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:40:41 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Creating image(s)
Aug 27 06:40:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "/opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "/opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.211s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.251s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk 1073741824" returned: 0 in 0.071s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG nova.network.neutron [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Successfully created port: 85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.212s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Cannot resize image /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Ensure instance console log exists: /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:40:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:43 user nova-compute[73258]: DEBUG nova.network.neutron [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Successfully updated port: 85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:40:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "refresh_cache-4a2970a3-2a05-4462-bf0b-1595743222fb" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:40:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquired lock "refresh_cache-4a2970a3-2a05-4462-bf0b-1595743222fb" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:40:43 user nova-compute[73258]: DEBUG nova.network.neutron [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:40:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-38e476f0-1cf1-4a73-85a4-3477b4a2c0f0 req-e3d943e2-1d37-4b62-b465-bd3f14933ce5 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Received event network-changed-85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-38e476f0-1cf1-4a73-85a4-3477b4a2c0f0 req-e3d943e2-1d37-4b62-b465-bd3f14933ce5 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Refreshing instance network info cache due to event network-changed-85410bb9-dbd6-481c-a090-46d04e0d54b6. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:40:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-38e476f0-1cf1-4a73-85a4-3477b4a2c0f0 req-e3d943e2-1d37-4b62-b465-bd3f14933ce5 service nova] Acquiring lock "refresh_cache-4a2970a3-2a05-4462-bf0b-1595743222fb" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:40:43 user nova-compute[73258]: DEBUG nova.network.neutron [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:40:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.network.neutron [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Updating instance_info_cache with network_info: [{"id": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "address": "fa:16:3e:d3:c2:3b", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85410bb9-db", "ovs_interfaceid": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Releasing lock "refresh_cache-4a2970a3-2a05-4462-bf0b-1595743222fb" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.compute.manager [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Instance network_info: |[{"id": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "address": "fa:16:3e:d3:c2:3b", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85410bb9-db", "ovs_interfaceid": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-38e476f0-1cf1-4a73-85a4-3477b4a2c0f0 req-e3d943e2-1d37-4b62-b465-bd3f14933ce5 service nova] Acquired lock "refresh_cache-4a2970a3-2a05-4462-bf0b-1595743222fb" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.network.neutron [req-38e476f0-1cf1-4a73-85a4-3477b4a2c0f0 req-e3d943e2-1d37-4b62-b465-bd3f14933ce5 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Refreshing network info cache for port 85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Start _get_guest_xml network_info=[{"id": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "address": "fa:16:3e:d3:c2:3b", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85410bb9-db", "ovs_interfaceid": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:40:44 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:40:44 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:40:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-968445551',display_name='tempest-tempest.common.compute-instance-968445551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-968445551',id=17,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdMnm+iJuT1xHxSDO3grlX9YhSVQuwPM7dsQXKJfx/OYDCb58PWILkOo0/JLzQygTw7Q96Wku55I12d7cqqFJX+FkBYpsqqlHI6UIfaBvOqiUrbrpnkTTfTzPPZnAM/+Q==',key_name='tempest-keypair-1720190692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57faf7cb6c704c05aba06857a6cdd29f',ramdisk_id='',reservation_id='r-62w17hhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1477462030',owner_user_name='tempest-ServerActionsTestOtherA-1477462030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f8a06ab5634f60b6ed2d1d9b2c342e',uuid=4a2970a3-2a05-4462-bf0b-1595743222fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "address": "fa:16:3e:d3:c2:3b", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85410bb9-db", "ovs_interfaceid": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converting VIF {"id": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "address": "fa:16:3e:d3:c2:3b", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85410bb9-db", "ovs_interfaceid": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:c2:3b,bridge_name='br-int',has_traffic_filtering=True,id=85410bb9-dbd6-481c-a090-46d04e0d54b6,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85410bb9-db') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.objects.instance [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a2970a3-2a05-4462-bf0b-1595743222fb {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:40:44 user nova-compute[73258]:   <uuid>4a2970a3-2a05-4462-bf0b-1595743222fb</uuid>
Aug 27 06:40:44 user nova-compute[73258]:   <name>instance-00000011</name>
Aug 27 06:40:44 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:40:44 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:40:44 user nova-compute[73258]:   <metadata>
Aug 27 06:40:44 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:40:44 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:40:44 user nova-compute[73258]:       <nova:name>tempest-tempest.common.compute-instance-968445551</nova:name>
Aug 27 06:40:44 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:40:44</nova:creationTime>
Aug 27 06:40:44 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:40:44 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:40:44 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:40:44 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:40:44 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:40:44 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:40:44 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:40:44 user nova-compute[73258]:       <nova:owner>
Aug 27 06:40:44 user nova-compute[73258]:         <nova:user uuid="67f8a06ab5634f60b6ed2d1d9b2c342e">tempest-ServerActionsTestOtherA-1477462030-project-member</nova:user>
Aug 27 06:40:44 user nova-compute[73258]:         <nova:project uuid="57faf7cb6c704c05aba06857a6cdd29f">tempest-ServerActionsTestOtherA-1477462030</nova:project>
Aug 27 06:40:44 user nova-compute[73258]:       </nova:owner>
Aug 27 06:40:44 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:40:44 user nova-compute[73258]:       <nova:ports>
Aug 27 06:40:44 user nova-compute[73258]:         <nova:port uuid="85410bb9-dbd6-481c-a090-46d04e0d54b6">
Aug 27 06:40:44 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 06:40:44 user nova-compute[73258]:         </nova:port>
Aug 27 06:40:44 user nova-compute[73258]:       </nova:ports>
Aug 27 06:40:44 user nova-compute[73258]:     </nova:instance>
Aug 27 06:40:44 user nova-compute[73258]:   </metadata>
Aug 27 06:40:44 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:40:44 user nova-compute[73258]:     <system>
Aug 27 06:40:44 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:40:44 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:40:44 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:40:44 user nova-compute[73258]:       <entry name="serial">4a2970a3-2a05-4462-bf0b-1595743222fb</entry>
Aug 27 06:40:44 user nova-compute[73258]:       <entry name="uuid">4a2970a3-2a05-4462-bf0b-1595743222fb</entry>
Aug 27 06:40:44 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:40:44 user nova-compute[73258]:     </system>
Aug 27 06:40:44 user nova-compute[73258]:   </sysinfo>
Aug 27 06:40:44 user nova-compute[73258]:   <os>
Aug 27 06:40:44 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:40:44 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:40:44 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:40:44 user nova-compute[73258]:   </os>
Aug 27 06:40:44 user nova-compute[73258]:   <features>
Aug 27 06:40:44 user nova-compute[73258]:     <acpi/>
Aug 27 06:40:44 user nova-compute[73258]:     <apic/>
Aug 27 06:40:44 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:40:44 user nova-compute[73258]:   </features>
Aug 27 06:40:44 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:40:44 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:40:44 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:40:44 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:40:44 user nova-compute[73258]:   </clock>
Aug 27 06:40:44 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:40:44 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:40:44 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:40:44 user nova-compute[73258]:   </cpu>
Aug 27 06:40:44 user nova-compute[73258]:   <devices>
Aug 27 06:40:44 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:40:44 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:40:44 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk"/>
Aug 27 06:40:44 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:40:44 user nova-compute[73258]:     </disk>
Aug 27 06:40:44 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:40:44 user nova-compute[73258]:       <mac address="fa:16:3e:d3:c2:3b"/>
Aug 27 06:40:44 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:40:44 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:40:44 user nova-compute[73258]:       <target dev="tap85410bb9-db"/>
Aug 27 06:40:44 user nova-compute[73258]:     </interface>
Aug 27 06:40:44 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:40:44 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/console.log" append="off"/>
Aug 27 06:40:44 user nova-compute[73258]:     </serial>
Aug 27 06:40:44 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:40:44 user nova-compute[73258]:     <video>
Aug 27 06:40:44 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:40:44 user nova-compute[73258]:     </video>
Aug 27 06:40:44 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:40:44 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:40:44 user nova-compute[73258]:     </rng>
Aug 27 06:40:44 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:40:44 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:40:44 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:40:44 user nova-compute[73258]:     </memballoon>
Aug 27 06:40:44 user nova-compute[73258]:   </devices>
Aug 27 06:40:44 user nova-compute[73258]: </domain>
Aug 27 06:40:44 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:40:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-968445551',display_name='tempest-tempest.common.compute-instance-968445551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-968445551',id=17,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdMnm+iJuT1xHxSDO3grlX9YhSVQuwPM7dsQXKJfx/OYDCb58PWILkOo0/JLzQygTw7Q96Wku55I12d7cqqFJX+FkBYpsqqlHI6UIfaBvOqiUrbrpnkTTfTzPPZnAM/+Q==',key_name='tempest-keypair-1720190692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57faf7cb6c704c05aba06857a6cdd29f',ramdisk_id='',reservation_id='r-62w17hhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1477462030',owner_user_name='tempest-ServerActionsTestOtherA-1477462030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f8a06ab5634f60b6ed2d1d9b2c342e',uuid=4a2970a3-2a05-4462-bf0b-1595743222fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "address": "fa:16:3e:d3:c2:3b", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85410bb9-db", "ovs_interfaceid": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converting VIF {"id": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "address": "fa:16:3e:d3:c2:3b", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85410bb9-db", "ovs_interfaceid": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:c2:3b,bridge_name='br-int',has_traffic_filtering=True,id=85410bb9-dbd6-481c-a090-46d04e0d54b6,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85410bb9-db') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG os_vif [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:c2:3b,bridge_name='br-int',has_traffic_filtering=True,id=85410bb9-dbd6-481c-a090-46d04e0d54b6,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85410bb9-db') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85410bb9-db, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85410bb9-db, col_values=(('external_ids', {'iface-id': '85410bb9-dbd6-481c-a090-46d04e0d54b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:c2:3b', 'vm-uuid': '4a2970a3-2a05-4462-bf0b-1595743222fb'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:44 user nova-compute[73258]: INFO os_vif [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:c2:3b,bridge_name='br-int',has_traffic_filtering=True,id=85410bb9-dbd6-481c-a090-46d04e0d54b6,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85410bb9-db')
Aug 27 06:40:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] No VIF found with MAC fa:16:3e:d3:c2:3b, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.network.neutron [req-38e476f0-1cf1-4a73-85a4-3477b4a2c0f0 req-e3d943e2-1d37-4b62-b465-bd3f14933ce5 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Updated VIF entry in instance network info cache for port 85410bb9-dbd6-481c-a090-46d04e0d54b6. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG nova.network.neutron [req-38e476f0-1cf1-4a73-85a4-3477b4a2c0f0 req-e3d943e2-1d37-4b62-b465-bd3f14933ce5 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Updating instance_info_cache with network_info: [{"id": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "address": "fa:16:3e:d3:c2:3b", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85410bb9-db", "ovs_interfaceid": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-38e476f0-1cf1-4a73-85a4-3477b4a2c0f0 req-e3d943e2-1d37-4b62-b465-bd3f14933ce5 service nova] Releasing lock "refresh_cache-4a2970a3-2a05-4462-bf0b-1595743222fb" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:40:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118448.8302798, 4a2970a3-2a05-4462-bf0b-1595743222fb => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:40:49 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] VM Resumed (Lifecycle Event)
Aug 27 06:40:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-26683d58-ac77-421d-bfab-0df4638c7a72 req-117ec466-c6f7-45af-b7f8-d5d0dc5246b9 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Received event network-vif-plugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-26683d58-ac77-421d-bfab-0df4638c7a72 req-117ec466-c6f7-45af-b7f8-d5d0dc5246b9 service nova] Acquiring lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-26683d58-ac77-421d-bfab-0df4638c7a72 req-117ec466-c6f7-45af-b7f8-d5d0dc5246b9 service nova] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-26683d58-ac77-421d-bfab-0df4638c7a72 req-117ec466-c6f7-45af-b7f8-d5d0dc5246b9 service nova] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-26683d58-ac77-421d-bfab-0df4638c7a72 req-117ec466-c6f7-45af-b7f8-d5d0dc5246b9 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] No waiting events found dispatching network-vif-plugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:40:49 user nova-compute[73258]: WARNING nova.compute.manager [req-26683d58-ac77-421d-bfab-0df4638c7a72 req-117ec466-c6f7-45af-b7f8-d5d0dc5246b9 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Received unexpected event network-vif-plugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 for instance with vm_state building and task_state spawning.
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-86bee7f9-6cca-4bb3-a6c5-a5bcba1686db req-fed302e4-39b2-4bf6-880e-675b4340eb8d service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Received event network-vif-plugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-86bee7f9-6cca-4bb3-a6c5-a5bcba1686db req-fed302e4-39b2-4bf6-880e-675b4340eb8d service nova] Acquiring lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-86bee7f9-6cca-4bb3-a6c5-a5bcba1686db req-fed302e4-39b2-4bf6-880e-675b4340eb8d service nova] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-86bee7f9-6cca-4bb3-a6c5-a5bcba1686db req-fed302e4-39b2-4bf6-880e-675b4340eb8d service nova] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-86bee7f9-6cca-4bb3-a6c5-a5bcba1686db req-fed302e4-39b2-4bf6-880e-675b4340eb8d service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] No waiting events found dispatching network-vif-plugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:40:49 user nova-compute[73258]: WARNING nova.compute.manager [req-86bee7f9-6cca-4bb3-a6c5-a5bcba1686db req-fed302e4-39b2-4bf6-880e-675b4340eb8d service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Received unexpected event network-vif-plugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 for instance with vm_state building and task_state spawning.
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:40:49 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:40:49 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=6903MB free_disk=24.345630645751953GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:40:49 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Instance spawned successfully.
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:40:49 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118448.8309646, 4a2970a3-2a05-4462-bf0b-1595743222fb => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:40:49 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] VM Started (Lifecycle Event)
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:40:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:40:49 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:40:50 user nova-compute[73258]: INFO nova.compute.manager [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Took 8.24 seconds to spawn the instance on the hypervisor.
Aug 27 06:40:50 user nova-compute[73258]: DEBUG nova.compute.manager [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:40:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:40:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:40:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:40:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 33b995be-307d-4491-a1b4-fb75ececea1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:40:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance b51f0635-3ec5-4623-9265-350033b778c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:40:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance b1b1b0cd-cd43-459f-aaaa-73ae805f9984 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:40:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance d7b11762-9244-481b-87dd-757782d68101 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:40:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 32d3fdfc-82ad-46ee-b673-4e73f43b85e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:40:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 3ad98f0c-e26f-4913-bf49-755cd63ece60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:40:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1672aa9f-be6f-4357-877f-a48f62119df4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:40:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:40:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance de8b1f89-9b89-439a-ab73-21e24e299460 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:40:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 4a2970a3-2a05-4462-bf0b-1595743222fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:40:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:40:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:40:50 user nova-compute[73258]: INFO nova.compute.manager [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Took 9.49 seconds to build instance.
Aug 27 06:40:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-12fe7e69-39a3-4267-8ed5-b82d9de58559 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.722s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:50 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:40:50 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:40:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:40:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.006s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:52 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118437.5995238, 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:40:52 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] VM Stopped (Lifecycle Event)
Aug 27 06:40:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-807731de-d0b5-4fc2-a115-7ee6d2791b3e None None] [instance: 70af3b5e-3a68-41b3-9f92-2b3a36a9d21e] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:40:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Acquiring lock "b51f0635-3ec5-4623-9265-350033b778c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Lock "b51f0635-3ec5-4623-9265-350033b778c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Acquiring lock "b51f0635-3ec5-4623-9265-350033b778c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Lock "b51f0635-3ec5-4623-9265-350033b778c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Lock "b51f0635-3ec5-4623-9265-350033b778c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:52 user nova-compute[73258]: INFO nova.compute.manager [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Terminating instance
Aug 27 06:40:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG nova.compute.manager [req-72ad7a3d-0eb6-468a-9223-7e6ad2c9a10e req-cbf1092d-5f60-43ee-97d4-7f097ae9b94e service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Received event network-vif-unplugged-c40794f4-8107-411d-b2b9-541a4fc5072d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-72ad7a3d-0eb6-468a-9223-7e6ad2c9a10e req-cbf1092d-5f60-43ee-97d4-7f097ae9b94e service nova] Acquiring lock "b51f0635-3ec5-4623-9265-350033b778c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-72ad7a3d-0eb6-468a-9223-7e6ad2c9a10e req-cbf1092d-5f60-43ee-97d4-7f097ae9b94e service nova] Lock "b51f0635-3ec5-4623-9265-350033b778c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-72ad7a3d-0eb6-468a-9223-7e6ad2c9a10e req-cbf1092d-5f60-43ee-97d4-7f097ae9b94e service nova] Lock "b51f0635-3ec5-4623-9265-350033b778c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG nova.compute.manager [req-72ad7a3d-0eb6-468a-9223-7e6ad2c9a10e req-cbf1092d-5f60-43ee-97d4-7f097ae9b94e service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] No waiting events found dispatching network-vif-unplugged-c40794f4-8107-411d-b2b9-541a4fc5072d {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG nova.compute.manager [req-72ad7a3d-0eb6-468a-9223-7e6ad2c9a10e req-cbf1092d-5f60-43ee-97d4-7f097ae9b94e service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Received event network-vif-unplugged-c40794f4-8107-411d-b2b9-541a4fc5072d for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:40:53 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Instance destroyed successfully.
Aug 27 06:40:53 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Lazy-loading 'resources' on Instance uuid b51f0635-3ec5-4623-9265-350033b778c6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-782123991',display_name='tempest-VolumesAssistedSnapshotsTest-server-782123991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-782123991',id=9,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+jM+XlfkMHjbw9mW3kXB8iS+4Lgn0kp4cMUUO7p19071/4uKq/ggu8TG40r3vZ9/hgt6wilput9XdE6EbaM6aPywwajAKoY1JLVvGxWL/zQ+19NediuGYlgssdrAcduw==',key_name='tempest-keypair-1275699090',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:37:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73a1937be8e045ab9d5e4f96128a60a6',ramdisk_id='',reservation_id='r-vhpd8y9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-316912335',owner_user_name='tempest-VolumesAssistedSnapshotsTest-316912335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a4804286d8a49719501fcd7c82ab011',uuid=b51f0635-3ec5-4623-9265-350033b778c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c40794f4-8107-411d-b2b9-541a4fc5072d", "address": "fa:16:3e:a6:3c:ca", "network": {"id": "e78617e0-56b0-4b80-bbd2-f370603e4cd3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508001975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a1937be8e045ab9d5e4f96128a60a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40794f4-81", "ovs_interfaceid": "c40794f4-8107-411d-b2b9-541a4fc5072d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Converting VIF {"id": "c40794f4-8107-411d-b2b9-541a4fc5072d", "address": "fa:16:3e:a6:3c:ca", "network": {"id": "e78617e0-56b0-4b80-bbd2-f370603e4cd3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-508001975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73a1937be8e045ab9d5e4f96128a60a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc40794f4-81", "ovs_interfaceid": "c40794f4-8107-411d-b2b9-541a4fc5072d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:3c:ca,bridge_name='br-int',has_traffic_filtering=True,id=c40794f4-8107-411d-b2b9-541a4fc5072d,network=Network(e78617e0-56b0-4b80-bbd2-f370603e4cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40794f4-81') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG os_vif [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:3c:ca,bridge_name='br-int',has_traffic_filtering=True,id=c40794f4-8107-411d-b2b9-541a4fc5072d,network=Network(e78617e0-56b0-4b80-bbd2-f370603e4cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40794f4-81') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc40794f4-81, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:53 user nova-compute[73258]: INFO os_vif [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:3c:ca,bridge_name='br-int',has_traffic_filtering=True,id=c40794f4-8107-411d-b2b9-541a4fc5072d,network=Network(e78617e0-56b0-4b80-bbd2-f370603e4cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc40794f4-81')
Aug 27 06:40:53 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Deleting instance files /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6_del
Aug 27 06:40:53 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Deletion of /opt/stack/data/nova/instances/b51f0635-3ec5-4623-9265-350033b778c6_del complete
Aug 27 06:40:53 user nova-compute[73258]: INFO nova.compute.manager [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 27 06:40:53 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:40:53 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: b51f0635-3ec5-4623-9265-350033b778c6] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:40:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:54 user nova-compute[73258]: INFO nova.compute.manager [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Unshelving
Aug 27 06:40:54 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:40:54 user nova-compute[73258]: DEBUG nova.compute.manager [req-1d26cda5-3037-4feb-bbdb-36c333cfea2f req-030e7889-cc1b-42c8-b58e-bb8eb4a652ea service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Received event network-vif-deleted-c40794f4-8107-411d-b2b9-541a4fc5072d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:54 user nova-compute[73258]: INFO nova.compute.manager [req-1d26cda5-3037-4feb-bbdb-36c333cfea2f req-030e7889-cc1b-42c8-b58e-bb8eb4a652ea service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Neutron deleted interface c40794f4-8107-411d-b2b9-541a4fc5072d; detaching it from the instance and deleting it from the info cache
Aug 27 06:40:54 user nova-compute[73258]: DEBUG nova.network.neutron [req-1d26cda5-3037-4feb-bbdb-36c333cfea2f req-030e7889-cc1b-42c8-b58e-bb8eb4a652ea service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:40:54 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Took 0.98 seconds to deallocate network for instance.
Aug 27 06:40:54 user nova-compute[73258]: DEBUG nova.compute.manager [req-1d26cda5-3037-4feb-bbdb-36c333cfea2f req-030e7889-cc1b-42c8-b58e-bb8eb4a652ea service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Detach interface failed, port_id=c40794f4-8107-411d-b2b9-541a4fc5072d, reason: Instance b51f0635-3ec5-4623-9265-350033b778c6 could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:40:55 user nova-compute[73258]: INFO nova.virt.block_device [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Booting with volume 46a83178-b67e-4624-896c-79871e2c4b15 at /dev/vdc
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG os_brick.utils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[67be2ab7-dc71-4673-bdb1-9d8cbeb9938b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a83ca9c-fe58-4912-8e10-7a74312d73e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f6774b-c0af-4568-8dd3-92cabf86610c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96e73c9-dd57-4f38-9244-c7cdc844637e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:40:55 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c7f641-4b02-40fb-9f64-bdc282663939]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG os_brick.utils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Updating existing volume attachment record: c68ac0ba-d34b-4274-9485-ee05e7a001e2 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG nova.compute.manager [req-93f4e310-7e6e-409a-9659-e0a2d90b0638 req-98279a95-fd32-4a87-8030-b40cd81994ab service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Received event network-vif-plugged-c40794f4-8107-411d-b2b9-541a4fc5072d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-93f4e310-7e6e-409a-9659-e0a2d90b0638 req-98279a95-fd32-4a87-8030-b40cd81994ab service nova] Acquiring lock "b51f0635-3ec5-4623-9265-350033b778c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-93f4e310-7e6e-409a-9659-e0a2d90b0638 req-98279a95-fd32-4a87-8030-b40cd81994ab service nova] Lock "b51f0635-3ec5-4623-9265-350033b778c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-93f4e310-7e6e-409a-9659-e0a2d90b0638 req-98279a95-fd32-4a87-8030-b40cd81994ab service nova] Lock "b51f0635-3ec5-4623-9265-350033b778c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG nova.compute.manager [req-93f4e310-7e6e-409a-9659-e0a2d90b0638 req-98279a95-fd32-4a87-8030-b40cd81994ab service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] No waiting events found dispatching network-vif-plugged-c40794f4-8107-411d-b2b9-541a4fc5072d {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:40:55 user nova-compute[73258]: WARNING nova.compute.manager [req-93f4e310-7e6e-409a-9659-e0a2d90b0638 req-98279a95-fd32-4a87-8030-b40cd81994ab service nova] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Received unexpected event network-vif-plugged-c40794f4-8107-411d-b2b9-541a4fc5072d for instance with vm_state deleted and task_state None.
Aug 27 06:40:55 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.571s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:55 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Deleted allocations for instance b51f0635-3ec5-4623-9265-350033b778c6
Aug 27 06:40:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a7dac9c3-0827-457c-adea-04fedfeeac67 tempest-VolumesAssistedSnapshotsTest-316912335 tempest-VolumesAssistedSnapshotsTest-316912335-project-member] Lock "b51f0635-3ec5-4623-9265-350033b778c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.767s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmQkHaRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:40:57 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:40:57 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:40:57 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a11556f-6901-4601-a320-5a5ccdb2252b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:40:57 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[07855846-a5b3-4675-b169-36f27c35376a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109] added
Aug 27 06:40:57 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60ecf79-5ac5-4bb0-9d6a-3a129863a1d2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d548071-98b4-4d4a-8418-313b608dcbb8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmQkHaRA {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmQkHaRA" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cae04ed-30a0-4770-8c88-5d5f30c994d2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gmQkHaRA'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc9531b-fe01-47a3-9c19-a5a537846284]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[222b1cd4-2244-43fc-810e-420c90e341e5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:40:57 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:40:57 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff72e41-3e8e-48a6-9c70-b908e7aedf83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109, portal: 172.16.0.220,3260]
Aug 27 06:40:57 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109, portal: 172.16.0.220,3260] successful.
Aug 27 06:40:57 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.102s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e88c5a0-43a6-4ed9-b786-b1d5b1c168be]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be0d8ad-3291-4682-a0cc-a20744da9868]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:40:57 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:40:57 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:40:57 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.485s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] HCTL ('41', '-', '-', 0) found on session 17 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1f07c3-ec3d-407c-980c-f78332ca95fc]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Searching for a device in session 17 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:40:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmQkHaRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:40:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.556s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:40:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] <== connect_volume: return (1559ms) {'type': 'block', 'scsi_wwn': '23433666661393363', 'path': '/dev/sdj'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:40:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433666661393363', 'path': '/dev/sdj'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:40:58 user nova-compute[73258]: DEBUG nova.objects.instance [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lazy-loading 'flavor' on Instance uuid 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:40:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:40:58 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:40:58 user nova-compute[73258]:   <source dev="/dev/sdj"/>
Aug 27 06:40:58 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:40:58 user nova-compute[73258]:   <serial>9cd5d71a-02b4-444b-9f79-09f9c5ea5109</serial>
Aug 27 06:40:58 user nova-compute[73258]: </disk>
Aug 27 06:40:58 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:40:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:40:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:40:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:40:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] No VIF found with MAC fa:16:3e:b1:1f:48, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:40:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-16adcd26-3d8e-4aff-93a4-fe58bb717eb0 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.084s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:00 user nova-compute[73258]: INFO nova.compute.manager [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Rescuing
Aug 27 06:41:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:41:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquired lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:41:00 user nova-compute[73258]: DEBUG nova.network.neutron [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:41:01 user nova-compute[73258]: DEBUG nova.network.neutron [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Updating instance_info_cache with network_info: [{"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:41:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Releasing lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:41:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:01 user nova-compute[73258]: DEBUG nova.compute.manager [req-fa6b0b66-d3fe-42e4-bd35-a4bc7dba4620 req-6110bbb9-276f-4882-b34e-e81a19d83f71 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-vif-unplugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fa6b0b66-d3fe-42e4-bd35-a4bc7dba4620 req-6110bbb9-276f-4882-b34e-e81a19d83f71 service nova] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fa6b0b66-d3fe-42e4-bd35-a4bc7dba4620 req-6110bbb9-276f-4882-b34e-e81a19d83f71 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fa6b0b66-d3fe-42e4-bd35-a4bc7dba4620 req-6110bbb9-276f-4882-b34e-e81a19d83f71 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:01 user nova-compute[73258]: DEBUG nova.compute.manager [req-fa6b0b66-d3fe-42e4-bd35-a4bc7dba4620 req-6110bbb9-276f-4882-b34e-e81a19d83f71 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] No waiting events found dispatching network-vif-unplugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:01 user nova-compute[73258]: WARNING nova.compute.manager [req-fa6b0b66-d3fe-42e4-bd35-a4bc7dba4620 req-6110bbb9-276f-4882-b34e-e81a19d83f71 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received unexpected event network-vif-unplugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 for instance with vm_state active and task_state rescuing.
Aug 27 06:41:02 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Instance destroyed successfully.
Aug 27 06:41:02 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Attempting a stable device rescue
Aug 27 06:41:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73258) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 06:41:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Instance directory exists: not creating {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 06:41:02 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Creating image(s)
Aug 27 06:41:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "/opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "/opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:02 user nova-compute[73258]: DEBUG nova.objects.instance [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:41:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "c1c527070dbaf8dff9c5a5258ab4c18edf236c1c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "c1c527070dbaf8dff9c5a5258ab4c18edf236c1c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1c527070dbaf8dff9c5a5258ab4c18edf236c1c.part --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1c527070dbaf8dff9c5a5258ab4c18edf236c1c.part --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:03 user nova-compute[73258]: DEBUG nova.virt.images [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] 1eb15b5d-492d-411a-a401-465328788344 was qcow2, converting to raw {{(pid=73258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 06:41:03 user nova-compute[73258]: DEBUG nova.privsep.utils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 06:41:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1c527070dbaf8dff9c5a5258ab4c18edf236c1c.part /opt/stack/data/nova/instances/_base/c1c527070dbaf8dff9c5a5258ab4c18edf236c1c.converted {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:03 user nova-compute[73258]: DEBUG nova.compute.manager [req-e9b5a1a4-5e34-41ff-a4d0-a34c35ea6be3 req-f84af3b4-618e-46bb-a4b1-140c2cd24d5f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e9b5a1a4-5e34-41ff-a4d0-a34c35ea6be3 req-f84af3b4-618e-46bb-a4b1-140c2cd24d5f service nova] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e9b5a1a4-5e34-41ff-a4d0-a34c35ea6be3 req-f84af3b4-618e-46bb-a4b1-140c2cd24d5f service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e9b5a1a4-5e34-41ff-a4d0-a34c35ea6be3 req-f84af3b4-618e-46bb-a4b1-140c2cd24d5f service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:03 user nova-compute[73258]: DEBUG nova.compute.manager [req-e9b5a1a4-5e34-41ff-a4d0-a34c35ea6be3 req-f84af3b4-618e-46bb-a4b1-140c2cd24d5f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] No waiting events found dispatching network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:03 user nova-compute[73258]: WARNING nova.compute.manager [req-e9b5a1a4-5e34-41ff-a4d0-a34c35ea6be3 req-f84af3b4-618e-46bb-a4b1-140c2cd24d5f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received unexpected event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 for instance with vm_state active and task_state rescuing.
Aug 27 06:41:03 user nova-compute[73258]: DEBUG nova.compute.manager [req-e9b5a1a4-5e34-41ff-a4d0-a34c35ea6be3 req-f84af3b4-618e-46bb-a4b1-140c2cd24d5f service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-changed-933454ca-76f3-4f90-aab9-14e915a58487 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:03 user nova-compute[73258]: DEBUG nova.compute.manager [req-e9b5a1a4-5e34-41ff-a4d0-a34c35ea6be3 req-f84af3b4-618e-46bb-a4b1-140c2cd24d5f service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Refreshing instance network info cache due to event network-changed-933454ca-76f3-4f90-aab9-14e915a58487. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:41:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e9b5a1a4-5e34-41ff-a4d0-a34c35ea6be3 req-f84af3b4-618e-46bb-a4b1-140c2cd24d5f service nova] Acquiring lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:41:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e9b5a1a4-5e34-41ff-a4d0-a34c35ea6be3 req-f84af3b4-618e-46bb-a4b1-140c2cd24d5f service nova] Acquired lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:41:03 user nova-compute[73258]: DEBUG nova.network.neutron [req-e9b5a1a4-5e34-41ff-a4d0-a34c35ea6be3 req-f84af3b4-618e-46bb-a4b1-140c2cd24d5f service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Refreshing network info cache for port 933454ca-76f3-4f90-aab9-14e915a58487 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:41:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1c527070dbaf8dff9c5a5258ab4c18edf236c1c.part /opt/stack/data/nova/instances/_base/c1c527070dbaf8dff9c5a5258ab4c18edf236c1c.converted" returned: 0 in 0.290s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1c527070dbaf8dff9c5a5258ab4c18edf236c1c.converted --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1c527070dbaf8dff9c5a5258ab4c18edf236c1c.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "c1c527070dbaf8dff9c5a5258ab4c18edf236c1c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.686s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "c1c527070dbaf8dff9c5a5258ab4c18edf236c1c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "c1c527070dbaf8dff9c5a5258ab4c18edf236c1c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1c527070dbaf8dff9c5a5258ab4c18edf236c1c --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1c527070dbaf8dff9c5a5258ab4c18edf236c1c --force-share --output=json" returned: 0 in 0.212s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1c527070dbaf8dff9c5a5258ab4c18edf236c1c,backing_fmt=raw /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk.rescue {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1c527070dbaf8dff9c5a5258ab4c18edf236c1c,backing_fmt=raw /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk.rescue" returned: 0 in 0.056s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "c1c527070dbaf8dff9c5a5258ab4c18edf236c1c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.objects.instance [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lazy-loading 'migration_context' on Instance uuid 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.objects.base [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Object Instance<0a70cda7-b972-4d06-ac46-27ebb6d9d8ae> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Start _get_guest_xml network_info=[{"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "vif_mac": "fa:16:3e:b1:1f:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1eb15b5d-492d-411a-a401-465328788344', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmQkHaRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '0a70cda7-b972-4d06-ac46-27ebb6d9d8ae', 'attached_at': '', 'detached_at': '', 'volume_id': '9cd5d71a-02b4-444b-9f79-09f9c5ea5109', 'serial': '9cd5d71a-02b4-444b-9f79-09f9c5ea5109'}, 'attachment_id': 'b0e70499-ab70-429e-ad02-950f5ad7a8a4', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.objects.instance [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lazy-loading 'resources' on Instance uuid 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.objects.base [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Object Instance<0a70cda7-b972-4d06-ac46-27ebb6d9d8ae> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.objects.instance [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lazy-loading 'numa_topology' on Instance uuid 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.objects.base [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Object Instance<0a70cda7-b972-4d06-ac46-27ebb6d9d8ae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:41:04 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:41:04 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.objects.instance [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.objects.base [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Object Instance<0a70cda7-b972-4d06-ac46-27ebb6d9d8ae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmQkHaRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:41:04 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:41:04 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:41:04 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2956bfdb-0d7e-4690-a744-a176d963ef84]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = gmQkHaRA\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 27 06:41:04 user nova-compute[73258]: node.name = iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109
Aug 27 06:41:04 user nova-compute[73258]: node.tpgt = -1
Aug 27 06:41:04 user nova-compute[73258]: node.startup = automatic
Aug 27 06:41:04 user nova-compute[73258]: node.leading_login = No
Aug 27 06:41:04 user nova-compute[73258]: iface.iscsi_ifacename = default
Aug 27 06:41:04 user nova-compute[73258]: iface.net_ifacename = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.ipaddress = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.prefix_len = 0
Aug 27 06:41:04 user nova-compute[73258]: iface.hwaddress = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.transport_name = tcp
Aug 27 06:41:04 user nova-compute[73258]: iface.initiatorname = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.state = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.vlan_id = 0
Aug 27 06:41:04 user nova-compute[73258]: iface.vlan_priority = 0
Aug 27 06:41:04 user nova-compute[73258]: iface.vlan_state = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.iface_num = 0
Aug 27 06:41:04 user nova-compute[73258]: iface.mtu = 0
Aug 27 06:41:04 user nova-compute[73258]: iface.port = 0
Aug 27 06:41:04 user nova-compute[73258]: iface.bootproto = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.subnet_mask = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.gateway = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.dhcp_alt_client_id_state = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.dhcp_alt_client_id = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.dhcp_dns = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.dhcp_learn_iqn = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.dhcp_req_vendor_id_state = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.dhcp_vendor_id_state = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.dhcp_vendor_id = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.dhcp_slp_da = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.fragmentation = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.gratuitous_arp = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.incoming_forwarding = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.tos_state = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.tos = 0
Aug 27 06:41:04 user nova-compute[73258]: iface.ttl = 0
Aug 27 06:41:04 user nova-compute[73258]: iface.delayed_ack = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.tcp_nagle = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.tcp_wsf_state = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.tcp_wsf = 0
Aug 27 06:41:04 user nova-compute[73258]: iface.tcp_timer_scale = 0
Aug 27 06:41:04 user nova-compute[73258]: iface.tcp_timestamp = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.redirect = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.def_task_mgmt_timeout = 0
Aug 27 06:41:04 user nova-compute[73258]: iface.header_digest = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.data_digest = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.immediate_data = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.initial_r2t = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.data_seq_inorder = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.data_pdu_inorder = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.erl = 0
Aug 27 06:41:04 user nova-compute[73258]: iface.max_receive_data_len = 0
Aug 27 06:41:04 user nova-compute[73258]: iface.first_burst_len = 0
Aug 27 06:41:04 user nova-compute[73258]: iface.max_outstanding_r2t = 0
Aug 27 06:41:04 user nova-compute[73258]: iface.max_burst_len = 0
Aug 27 06:41:04 user nova-compute[73258]: iface.chap_auth = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.bidi_chap = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.strict_login_compliance = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.discovery_auth = <empty>
Aug 27 06:41:04 user nova-compute[73258]: iface.discovery_logout = <empty>
Aug 27 06:41:04 user nova-compute[73258]: node.discovery_address = <empty>
Aug 27 06:41:04 user nova-compute[73258]: node.discovery_port = 0
Aug 27 06:41:04 user nova-compute[73258]: node.discovery_type = static
Aug 27 06:41:04 user nova-compute[73258]: node.session.initial_cmdsn = 0
Aug 27 06:41:04 user nova-compute[73258]: node.session.initial_login_retry_max = 8
Aug 27 06:41:04 user nova-compute[73258]: node.session.xmit_thread_priority = -20
Aug 27 06:41:04 user nova-compute[73258]: node.session.cmds_max = 128
Aug 27 06:41:04 user nova-compute[73258]: node.session.queue_depth = 32
Aug 27 06:41:04 user nova-compute[73258]: node.session.nr_sessions = 1
Aug 27 06:41:04 user nova-compute[73258]: node.session.auth.authmethod = CHAP
Aug 27 06:41:04 user nova-compute[73258]: node.session.auth.username = gmQkHaRA
Aug 27 06:41:04 user nova-compute[73258]: node.session.auth.password = ***
Aug 27 06:41:04 user nova-compute[73258]: node.session.auth.username_in = <empty>
Aug 27 06:41:04 user nova-compute[73258]: node.session.auth.password_in = <empty>
Aug 27 06:41:04 user nova-compute[73258]: node.session.auth.chap_algs = MD5
Aug 27 06:41:04 user nova-compute[73258]: node.session.timeo.replacement_timeout = 120
Aug 27 06:41:04 user nova-compute[73258]: node.session.err_timeo.abort_timeout = 15
Aug 27 06:41:04 user nova-compute[73258]: node.session.err_timeo.lu_reset_timeout = 30
Aug 27 06:41:04 user nova-compute[73258]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 27 06:41:04 user nova-compute[73258]: node.session.err_timeo.host_reset_timeout = 60
Aug 27 06:41:04 user nova-compute[73258]: node.session.iscsi.FastAbort = Yes
Aug 27 06:41:04 user nova-compute[73258]: node.session.iscsi.InitialR2T = No
Aug 27 06:41:04 user nova-compute[73258]: node.session.iscsi.ImmediateData = Yes
Aug 27 06:41:04 user nova-compute[73258]: node.session.iscsi.FirstBurstLength = 262144
Aug 27 06:41:04 user nova-compute[73258]: node.session.iscsi.MaxBurstLength = 16776192
Aug 27 06:41:04 user nova-compute[73258]: node.session.iscsi.DefaultTime2Retain = 0
Aug 27 06:41:04 user nova-compute[73258]: node.session.iscsi.DefaultTime2Wait = 2
Aug 27 06:41:04 user nova-compute[73258]: node.session.iscsi.MaxConnections = 1
Aug 27 06:41:04 user nova-compute[73258]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 27 06:41:04 user nova-compute[73258]: node.session.iscsi.ERL = 0
Aug 27 06:41:04 user nova-compute[73258]: node.session.scan = manual
Aug 27 06:41:04 user nova-compute[73258]: node.session.reopen_max = 0
Aug 27 06:41:04 user nova-compute[73258]: node.conn[0].address = 172.16.0.220
Aug 27 06:41:04 user nova-compute[73258]: node.conn[0].port = 3260
Aug 27 06:41:04 user nova-compute[73258]: node.conn[0].startup = manual
Aug 27 06:41:04 user nova-compute[73258]: node.conn[0].tcp.window_size = 524288
Aug 27 06:41:04 user nova-compute[73258]: node.conn[0].tcp.type_of_service = 0
Aug 27 06:41:04 user nova-compute[73258]: node.conn[0].timeo.logout_timeout = 15
Aug 27 06:41:04 user nova-compute[73258]: node.conn[0].timeo.login_timeout = 15
Aug 27 06:41:04 user nova-compute[73258]: node.conn[0].timeo.auth_timeout = 45
Aug 27 06:41:04 user nova-compute[73258]: node.conn[0].timeo.noop_out_interval = 5
Aug 27 06:41:04 user nova-compute[73258]: node.conn[0].timeo.noop_out_timeout = 5
Aug 27 06:41:04 user nova-compute[73258]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 27 06:41:04 user nova-compute[73258]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 27 06:41:04 user nova-compute[73258]: node.conn[0].iscsi.HeaderDigest = None
Aug 27 06:41:04 user nova-compute[73258]: node.conn[0].iscsi.DataDigest = None
Aug 27 06:41:04 user nova-compute[73258]: node.conn[0].iscsi.IFMarker = No
Aug 27 06:41:04 user nova-compute[73258]: node.conn[0].iscsi.OFMarker = No
Aug 27 06:41:04 user nova-compute[73258]: # END RECORD
Aug 27 06:41:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[601b8cf4-c628-4e8c-b732-2e3040f595f8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5971e7ba-9b11-4e8a-b1e6-5af2333309cf]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmQkHaRA {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmQkHaRA" returned: 0 in 0.049s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4eceeb1-7ab3-4db3-8d52-99ab34b37e56]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gmQkHaRA'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.052s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5130e167-ccfa-4171-be53-ac43764df41b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa08281-be56-4127-9902-b9d6527d31a6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:41:04 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:04 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:04 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:41:04 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:41:04 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:41:04 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:41:04 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:04 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:41:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:41:04 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:04 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:04 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:41:04 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:41:04 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:41:04 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:41:04 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:04 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:41:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] HCTL ('41', '0', '0', 0) found on session 17 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Scanning host 41 c: 0, t: 0, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad666e97-9876-4799-a361-48ac1c7c7b05]: (4, ('0 0 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Searching for a device in session 17 and hctl ('41', '0', '0', 0) yield: sdj {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmQkHaRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.293s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] <== connect_volume: return (295ms) {'type': 'block', 'scsi_wwn': '23433666661393363', 'path': '/dev/sdj'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433666661393363', 'path': '/dev/sdj'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.network.neutron [req-e9b5a1a4-5e34-41ff-a4d0-a34c35ea6be3 req-f84af3b4-618e-46bb-a4b1-140c2cd24d5f service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Updated VIF entry in instance network info cache for port 933454ca-76f3-4f90-aab9-14e915a58487. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:41:04 user nova-compute[73258]: DEBUG nova.network.neutron [req-e9b5a1a4-5e34-41ff-a4d0-a34c35ea6be3 req-f84af3b4-618e-46bb-a4b1-140c2cd24d5f service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Updating instance_info_cache with network_info: [{"id": "933454ca-76f3-4f90-aab9-14e915a58487", "address": "fa:16:3e:41:30:a9", "network": {"id": "a2ca5db5-8c6d-44d0-acf5-c46a564a0247", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058086289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933454ca-76", "ovs_interfaceid": "933454ca-76f3-4f90-aab9-14e915a58487", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "address": "fa:16:3e:34:10:b5", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2f38b2-1d", "ovs_interfaceid": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f0370f5d-defe-48bd-b320-47db121211e2", "address": "fa:16:3e:f6:03:41", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0370f5d-de", "ovs_interfaceid": "f0370f5d-defe-48bd-b320-47db121211e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "384e3fbf-506e-42cb-8050-e05c2ee95749", "address": "fa:16:3e:4d:cd:a0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384e3fbf-50", "ovs_interfaceid": "384e3fbf-506e-42cb-8050-e05c2ee95749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e184532a-df10-431e-9ef2-c3a595e56b5d", "address": "fa:16:3e:a6:7a:e0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184532a-df", "ovs_interfaceid": "e184532a-df10-431e-9ef2-c3a595e56b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87427dc4-15ba-4179-999a-217c5eef5fd3", "address": "fa:16:3e:41:44:fc", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87427dc4-15", "ovs_interfaceid": "87427dc4-15ba-4179-999a-217c5eef5fd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "address": "fa:16:3e:ca:07:e5", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9688c75d-c1", "ovs_interfaceid": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1098597537',display_name='tempest-ServerStableDeviceRescueTest-server-1098597537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1098597537',id=5,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAM0bmrEujlL8AI20zgQ/6kDsTFJuTxBCGvCarDVibclhhoc8ycGQgzzGiJjqiEsO14pVdFTzq5p35TGFRRkumZiqKN3fKgLokKihqSJCwjk5FC1NUqd8yScmsAcMPUhUg==',key_name='tempest-keypair-275662107',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:37:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f79d0a3715b343dea709d64cc322db6f',ramdisk_id='',reservation_id='r-epepb7c3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-543871806',owner_user_name='tempest-ServerStableDeviceRescueTest-543871806-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:38:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='526f6ab3befe4130ac81cd46f9678ebe',uuid=0a70cda7-b972-4d06-ac46-27ebb6d9d8ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "vif_mac": "fa:16:3e:b1:1f:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Converting VIF {"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "vif_mac": "fa:16:3e:b1:1f:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:1f:48,bridge_name='br-int',has_traffic_filtering=True,id=a695f0b6-9494-4a0c-9bd1-853631b8d8f4,network=Network(2584e799-abc7-4e9b-9295-e30c677c03b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa695f0b6-94') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG nova.objects.instance [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e9b5a1a4-5e34-41ff-a4d0-a34c35ea6be3 req-f84af3b4-618e-46bb-a4b1-140c2cd24d5f service nova] Releasing lock "refresh_cache-d7b11762-9244-481b-87dd-757782d68101" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG nova.objects.base [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Object Instance<0a70cda7-b972-4d06-ac46-27ebb6d9d8ae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:41:05 user nova-compute[73258]:   <uuid>0a70cda7-b972-4d06-ac46-27ebb6d9d8ae</uuid>
Aug 27 06:41:05 user nova-compute[73258]:   <name>instance-00000005</name>
Aug 27 06:41:05 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:41:05 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:41:05 user nova-compute[73258]:   <metadata>
Aug 27 06:41:05 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:41:05 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:41:05 user nova-compute[73258]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1098597537</nova:name>
Aug 27 06:41:05 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:41:04</nova:creationTime>
Aug 27 06:41:05 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:41:05 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:41:05 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:41:05 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:41:05 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:41:05 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:41:05 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:41:05 user nova-compute[73258]:       <nova:owner>
Aug 27 06:41:05 user nova-compute[73258]:         <nova:user uuid="526f6ab3befe4130ac81cd46f9678ebe">tempest-ServerStableDeviceRescueTest-543871806-project-member</nova:user>
Aug 27 06:41:05 user nova-compute[73258]:         <nova:project uuid="f79d0a3715b343dea709d64cc322db6f">tempest-ServerStableDeviceRescueTest-543871806</nova:project>
Aug 27 06:41:05 user nova-compute[73258]:       </nova:owner>
Aug 27 06:41:05 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:41:05 user nova-compute[73258]:       <nova:ports>
Aug 27 06:41:05 user nova-compute[73258]:         <nova:port uuid="a695f0b6-9494-4a0c-9bd1-853631b8d8f4">
Aug 27 06:41:05 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 06:41:05 user nova-compute[73258]:         </nova:port>
Aug 27 06:41:05 user nova-compute[73258]:       </nova:ports>
Aug 27 06:41:05 user nova-compute[73258]:     </nova:instance>
Aug 27 06:41:05 user nova-compute[73258]:   </metadata>
Aug 27 06:41:05 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:41:05 user nova-compute[73258]:     <system>
Aug 27 06:41:05 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:41:05 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:41:05 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:41:05 user nova-compute[73258]:       <entry name="serial">0a70cda7-b972-4d06-ac46-27ebb6d9d8ae</entry>
Aug 27 06:41:05 user nova-compute[73258]:       <entry name="uuid">0a70cda7-b972-4d06-ac46-27ebb6d9d8ae</entry>
Aug 27 06:41:05 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:41:05 user nova-compute[73258]:     </system>
Aug 27 06:41:05 user nova-compute[73258]:   </sysinfo>
Aug 27 06:41:05 user nova-compute[73258]:   <os>
Aug 27 06:41:05 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:41:05 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:41:05 user nova-compute[73258]:   </os>
Aug 27 06:41:05 user nova-compute[73258]:   <features>
Aug 27 06:41:05 user nova-compute[73258]:     <acpi/>
Aug 27 06:41:05 user nova-compute[73258]:     <apic/>
Aug 27 06:41:05 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:41:05 user nova-compute[73258]:   </features>
Aug 27 06:41:05 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:41:05 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:41:05 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:41:05 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:41:05 user nova-compute[73258]:   </clock>
Aug 27 06:41:05 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:41:05 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:41:05 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:41:05 user nova-compute[73258]:   </cpu>
Aug 27 06:41:05 user nova-compute[73258]:   <devices>
Aug 27 06:41:05 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:41:05 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:41:05 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk"/>
Aug 27 06:41:05 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:41:05 user nova-compute[73258]:     </disk>
Aug 27 06:41:05 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:41:05 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:41:05 user nova-compute[73258]:       <source dev="/dev/sdj"/>
Aug 27 06:41:05 user nova-compute[73258]:       <target dev="vdb" bus="virtio"/>
Aug 27 06:41:05 user nova-compute[73258]:       <serial>9cd5d71a-02b4-444b-9f79-09f9c5ea5109</serial>
Aug 27 06:41:05 user nova-compute[73258]:     </disk>
Aug 27 06:41:05 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:41:05 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:41:05 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk.rescue"/>
Aug 27 06:41:05 user nova-compute[73258]:       <target dev="vdc" bus="virtio"/>
Aug 27 06:41:05 user nova-compute[73258]:       <boot order="1"/>
Aug 27 06:41:05 user nova-compute[73258]:     </disk>
Aug 27 06:41:05 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:41:05 user nova-compute[73258]:       <mac address="fa:16:3e:b1:1f:48"/>
Aug 27 06:41:05 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:41:05 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:41:05 user nova-compute[73258]:       <target dev="tapa695f0b6-94"/>
Aug 27 06:41:05 user nova-compute[73258]:     </interface>
Aug 27 06:41:05 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:41:05 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/console.log" append="off"/>
Aug 27 06:41:05 user nova-compute[73258]:     </serial>
Aug 27 06:41:05 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:41:05 user nova-compute[73258]:     <video>
Aug 27 06:41:05 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:41:05 user nova-compute[73258]:     </video>
Aug 27 06:41:05 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:41:05 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:41:05 user nova-compute[73258]:     </rng>
Aug 27 06:41:05 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:41:05 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:41:05 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:41:05 user nova-compute[73258]:     </memballoon>
Aug 27 06:41:05 user nova-compute[73258]:   </devices>
Aug 27 06:41:05 user nova-compute[73258]: </domain>
Aug 27 06:41:05 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:41:05 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Instance destroyed successfully.
Aug 27 06:41:05 user nova-compute[73258]: DEBUG nova.compute.manager [req-9218f330-77d6-4258-93e1-0a899437dffa req-861f9176-90c0-4250-b5c0-05547ce8f83c service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Received event network-changed-be5db165-8b27-41aa-b600-d5cae17b3739 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG nova.compute.manager [req-9218f330-77d6-4258-93e1-0a899437dffa req-861f9176-90c0-4250-b5c0-05547ce8f83c service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Refreshing instance network info cache due to event network-changed-be5db165-8b27-41aa-b600-d5cae17b3739. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9218f330-77d6-4258-93e1-0a899437dffa req-861f9176-90c0-4250-b5c0-05547ce8f83c service nova] Acquiring lock "refresh_cache-3ad98f0c-e26f-4913-bf49-755cd63ece60" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9218f330-77d6-4258-93e1-0a899437dffa req-861f9176-90c0-4250-b5c0-05547ce8f83c service nova] Acquired lock "refresh_cache-3ad98f0c-e26f-4913-bf49-755cd63ece60" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG nova.network.neutron [req-9218f330-77d6-4258-93e1-0a899437dffa req-861f9176-90c0-4250-b5c0-05547ce8f83c service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Refreshing network info cache for port be5db165-8b27-41aa-b600-d5cae17b3739 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] No VIF found with MAC fa:16:3e:b1:1f:48, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "3ad98f0c-e26f-4913-bf49-755cd63ece60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "3ad98f0c-e26f-4913-bf49-755cd63ece60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "3ad98f0c-e26f-4913-bf49-755cd63ece60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "3ad98f0c-e26f-4913-bf49-755cd63ece60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "3ad98f0c-e26f-4913-bf49-755cd63ece60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:05 user nova-compute[73258]: INFO nova.compute.manager [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Terminating instance
Aug 27 06:41:05 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG nova.network.neutron [req-9218f330-77d6-4258-93e1-0a899437dffa req-861f9176-90c0-4250-b5c0-05547ce8f83c service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Updated VIF entry in instance network info cache for port be5db165-8b27-41aa-b600-d5cae17b3739. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG nova.network.neutron [req-9218f330-77d6-4258-93e1-0a899437dffa req-861f9176-90c0-4250-b5c0-05547ce8f83c service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Updating instance_info_cache with network_info: [{"id": "be5db165-8b27-41aa-b600-d5cae17b3739", "address": "fa:16:3e:1f:f3:8c", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5db165-8b", "ovs_interfaceid": "be5db165-8b27-41aa-b600-d5cae17b3739", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9218f330-77d6-4258-93e1-0a899437dffa req-861f9176-90c0-4250-b5c0-05547ce8f83c service nova] Releasing lock "refresh_cache-3ad98f0c-e26f-4913-bf49-755cd63ece60" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:06 user nova-compute[73258]: DEBUG nova.compute.manager [req-f81a65b4-cf8c-4116-9279-b1e1fc6fcd4e req-ace5d725-730e-4111-8f01-56c2d7a75898 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-changed-59275472-b18f-4e4b-922f-475dd553833c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:06 user nova-compute[73258]: DEBUG nova.compute.manager [req-f81a65b4-cf8c-4116-9279-b1e1fc6fcd4e req-ace5d725-730e-4111-8f01-56c2d7a75898 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Refreshing instance network info cache due to event network-changed-59275472-b18f-4e4b-922f-475dd553833c. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:41:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f81a65b4-cf8c-4116-9279-b1e1fc6fcd4e req-ace5d725-730e-4111-8f01-56c2d7a75898 service nova] Acquiring lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:41:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f81a65b4-cf8c-4116-9279-b1e1fc6fcd4e req-ace5d725-730e-4111-8f01-56c2d7a75898 service nova] Acquired lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:41:06 user nova-compute[73258]: DEBUG nova.network.neutron [req-f81a65b4-cf8c-4116-9279-b1e1fc6fcd4e req-ace5d725-730e-4111-8f01-56c2d7a75898 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Refreshing network info cache for port 59275472-b18f-4e4b-922f-475dd553833c {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:41:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "d7b11762-9244-481b-87dd-757782d68101" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:06 user nova-compute[73258]: INFO nova.compute.manager [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Terminating instance
Aug 27 06:41:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:41:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:06 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Instance destroyed successfully.
Aug 27 06:41:06 user nova-compute[73258]: DEBUG nova.objects.instance [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lazy-loading 'resources' on Instance uuid 3ad98f0c-e26f-4913-bf49-755cd63ece60 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:39:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1198913328',display_name='tempest-AttachVolumeNegativeTest-server-1198913328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1198913328',id=13,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSv9f865BAjjL/VrtPAy26T1z8cZ8RXLF7lXF9lveH5S3xpAfUQM7e5rY9AKjWCh8N1w1VYX9/tVOJ7rAh3cN4xomVK7wGcgkVxgNExnP6lVsEfI6+GQiRzuJd/+YMnIQ==',key_name='tempest-keypair-1732221652',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:39:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f43f32eaadfd4f7eacc418385cc5e474',ramdisk_id='',reservation_id='r-0fqxnv7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-537954646',owner_user_name='tempest-AttachVolumeNegativeTest-537954646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd74559df08d44e298ba6e2ccbaaefae',uuid=3ad98f0c-e26f-4913-bf49-755cd63ece60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be5db165-8b27-41aa-b600-d5cae17b3739", "address": "fa:16:3e:1f:f3:8c", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5db165-8b", "ovs_interfaceid": "be5db165-8b27-41aa-b600-d5cae17b3739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converting VIF {"id": "be5db165-8b27-41aa-b600-d5cae17b3739", "address": "fa:16:3e:1f:f3:8c", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5db165-8b", "ovs_interfaceid": "be5db165-8b27-41aa-b600-d5cae17b3739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:f3:8c,bridge_name='br-int',has_traffic_filtering=True,id=be5db165-8b27-41aa-b600-d5cae17b3739,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe5db165-8b') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG os_vif [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:f3:8c,bridge_name='br-int',has_traffic_filtering=True,id=be5db165-8b27-41aa-b600-d5cae17b3739,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe5db165-8b') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe5db165-8b, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG nova.compute.manager [req-d9705e2d-2bed-4c09-a293-219b0822d5a4 req-ea733b42-c345-42c0-9654-cde74bea9750 service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Received event network-vif-unplugged-be5db165-8b27-41aa-b600-d5cae17b3739 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d9705e2d-2bed-4c09-a293-219b0822d5a4 req-ea733b42-c345-42c0-9654-cde74bea9750 service nova] Acquiring lock "3ad98f0c-e26f-4913-bf49-755cd63ece60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d9705e2d-2bed-4c09-a293-219b0822d5a4 req-ea733b42-c345-42c0-9654-cde74bea9750 service nova] Lock "3ad98f0c-e26f-4913-bf49-755cd63ece60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d9705e2d-2bed-4c09-a293-219b0822d5a4 req-ea733b42-c345-42c0-9654-cde74bea9750 service nova] Lock "3ad98f0c-e26f-4913-bf49-755cd63ece60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG nova.compute.manager [req-d9705e2d-2bed-4c09-a293-219b0822d5a4 req-ea733b42-c345-42c0-9654-cde74bea9750 service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] No waiting events found dispatching network-vif-unplugged-be5db165-8b27-41aa-b600-d5cae17b3739 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG nova.compute.manager [req-d9705e2d-2bed-4c09-a293-219b0822d5a4 req-ea733b42-c345-42c0-9654-cde74bea9750 service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Received event network-vif-unplugged-be5db165-8b27-41aa-b600-d5cae17b3739 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG nova.compute.manager [req-d9705e2d-2bed-4c09-a293-219b0822d5a4 req-ea733b42-c345-42c0-9654-cde74bea9750 service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Received event network-vif-plugged-be5db165-8b27-41aa-b600-d5cae17b3739 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d9705e2d-2bed-4c09-a293-219b0822d5a4 req-ea733b42-c345-42c0-9654-cde74bea9750 service nova] Acquiring lock "3ad98f0c-e26f-4913-bf49-755cd63ece60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d9705e2d-2bed-4c09-a293-219b0822d5a4 req-ea733b42-c345-42c0-9654-cde74bea9750 service nova] Lock "3ad98f0c-e26f-4913-bf49-755cd63ece60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d9705e2d-2bed-4c09-a293-219b0822d5a4 req-ea733b42-c345-42c0-9654-cde74bea9750 service nova] Lock "3ad98f0c-e26f-4913-bf49-755cd63ece60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG nova.compute.manager [req-d9705e2d-2bed-4c09-a293-219b0822d5a4 req-ea733b42-c345-42c0-9654-cde74bea9750 service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] No waiting events found dispatching network-vif-plugged-be5db165-8b27-41aa-b600-d5cae17b3739 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:07 user nova-compute[73258]: WARNING nova.compute.manager [req-d9705e2d-2bed-4c09-a293-219b0822d5a4 req-ea733b42-c345-42c0-9654-cde74bea9750 service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Received unexpected event network-vif-plugged-be5db165-8b27-41aa-b600-d5cae17b3739 for instance with vm_state active and task_state deleting.
Aug 27 06:41:07 user nova-compute[73258]: DEBUG nova.compute.manager [req-d9705e2d-2bed-4c09-a293-219b0822d5a4 req-ea733b42-c345-42c0-9654-cde74bea9750 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-unplugged-933454ca-76f3-4f90-aab9-14e915a58487 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d9705e2d-2bed-4c09-a293-219b0822d5a4 req-ea733b42-c345-42c0-9654-cde74bea9750 service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d9705e2d-2bed-4c09-a293-219b0822d5a4 req-ea733b42-c345-42c0-9654-cde74bea9750 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d9705e2d-2bed-4c09-a293-219b0822d5a4 req-ea733b42-c345-42c0-9654-cde74bea9750 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG nova.compute.manager [req-d9705e2d-2bed-4c09-a293-219b0822d5a4 req-ea733b42-c345-42c0-9654-cde74bea9750 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-unplugged-933454ca-76f3-4f90-aab9-14e915a58487 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG nova.compute.manager [req-d9705e2d-2bed-4c09-a293-219b0822d5a4 req-ea733b42-c345-42c0-9654-cde74bea9750 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-unplugged-933454ca-76f3-4f90-aab9-14e915a58487 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:07 user nova-compute[73258]: INFO os_vif [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:f3:8c,bridge_name='br-int',has_traffic_filtering=True,id=be5db165-8b27-41aa-b600-d5cae17b3739,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe5db165-8b')
Aug 27 06:41:07 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Deleting instance files /opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60_del
Aug 27 06:41:07 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Deletion of /opt/stack/data/nova/instances/3ad98f0c-e26f-4913-bf49-755cd63ece60_del complete
Aug 27 06:41:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:07 user nova-compute[73258]: INFO nova.compute.manager [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Took 1.86 seconds to destroy the instance on the hypervisor.
Aug 27 06:41:07 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG nova.compute.manager [req-53d6c188-f33e-48f3-a4c7-0150820450d4 req-fc308627-3d8d-4302-bd68-98107d64c5ed service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-unplugged-f0370f5d-defe-48bd-b320-47db121211e2 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-53d6c188-f33e-48f3-a4c7-0150820450d4 req-fc308627-3d8d-4302-bd68-98107d64c5ed service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-53d6c188-f33e-48f3-a4c7-0150820450d4 req-fc308627-3d8d-4302-bd68-98107d64c5ed service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-53d6c188-f33e-48f3-a4c7-0150820450d4 req-fc308627-3d8d-4302-bd68-98107d64c5ed service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-53d6c188-f33e-48f3-a4c7-0150820450d4 req-fc308627-3d8d-4302-bd68-98107d64c5ed service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-unplugged-f0370f5d-defe-48bd-b320-47db121211e2 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-53d6c188-f33e-48f3-a4c7-0150820450d4 req-fc308627-3d8d-4302-bd68-98107d64c5ed service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-unplugged-f0370f5d-defe-48bd-b320-47db121211e2 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG nova.network.neutron [req-f81a65b4-cf8c-4116-9279-b1e1fc6fcd4e req-ace5d725-730e-4111-8f01-56c2d7a75898 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updated VIF entry in instance network info cache for port 59275472-b18f-4e4b-922f-475dd553833c. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG nova.network.neutron [req-f81a65b4-cf8c-4116-9279-b1e1fc6fcd4e req-ace5d725-730e-4111-8f01-56c2d7a75898 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updating instance_info_cache with network_info: [{"id": "59275472-b18f-4e4b-922f-475dd553833c", "address": "fa:16:3e:05:21:15", "network": {"id": "5eaba2f5-e1ca-4a9b-8195-bc8798d89753", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-374547766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59275472-b1", "ovs_interfaceid": "59275472-b18f-4e4b-922f-475dd553833c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5820add-1974-4f6c-873e-ef179593b46a", "address": "fa:16:3e:b1:35:89", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5820add-19", "ovs_interfaceid": "e5820add-1974-4f6c-873e-ef179593b46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "address": "fa:16:3e:5a:25:32", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff33d225-ef", "ovs_interfaceid": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e481124c-b62d-4fc9-9f02-ba38c027180e", "address": "fa:16:3e:ef:7e:25", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape481124c-b6", "ovs_interfaceid": "e481124c-b62d-4fc9-9f02-ba38c027180e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0914d88d-1909-4bcb-a776-37af31e16b9e", "address": "fa:16:3e:a0:a3:84", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914d88d-19", "ovs_interfaceid": "0914d88d-1909-4bcb-a776-37af31e16b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e32a9d4d-57df-4765-b5be-12cea8621fce", "address": "fa:16:3e:10:c4:37", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32a9d4d-57", "ovs_interfaceid": "e32a9d4d-57df-4765-b5be-12cea8621fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "783f5103-a178-42e0-a3b0-f523ca4c9439", "address": "fa:16:3e:4d:78:05", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap783f5103-a1", "ovs_interfaceid": "783f5103-a178-42e0-a3b0-f523ca4c9439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f81a65b4-cf8c-4116-9279-b1e1fc6fcd4e req-ace5d725-730e-4111-8f01-56c2d7a75898 service nova] Releasing lock "refresh_cache-32d3fdfc-82ad-46ee-b673-4e73f43b85e7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-ca8367ac-2d51-469a-889b-5ee5876de529 req-5bd5edfc-00a9-4afe-8bfe-c189730d15bb service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-unplugged-5c2f38b2-1d02-4e50-bc89-a2fa523fc408 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ca8367ac-2d51-469a-889b-5ee5876de529 req-5bd5edfc-00a9-4afe-8bfe-c189730d15bb service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ca8367ac-2d51-469a-889b-5ee5876de529 req-5bd5edfc-00a9-4afe-8bfe-c189730d15bb service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ca8367ac-2d51-469a-889b-5ee5876de529 req-5bd5edfc-00a9-4afe-8bfe-c189730d15bb service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-ca8367ac-2d51-469a-889b-5ee5876de529 req-5bd5edfc-00a9-4afe-8bfe-c189730d15bb service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-unplugged-5c2f38b2-1d02-4e50-bc89-a2fa523fc408 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-ca8367ac-2d51-469a-889b-5ee5876de529 req-5bd5edfc-00a9-4afe-8bfe-c189730d15bb service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-unplugged-5c2f38b2-1d02-4e50-bc89-a2fa523fc408 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-ca8367ac-2d51-469a-889b-5ee5876de529 req-5bd5edfc-00a9-4afe-8bfe-c189730d15bb service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-5c2f38b2-1d02-4e50-bc89-a2fa523fc408 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ca8367ac-2d51-469a-889b-5ee5876de529 req-5bd5edfc-00a9-4afe-8bfe-c189730d15bb service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ca8367ac-2d51-469a-889b-5ee5876de529 req-5bd5edfc-00a9-4afe-8bfe-c189730d15bb service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ca8367ac-2d51-469a-889b-5ee5876de529 req-5bd5edfc-00a9-4afe-8bfe-c189730d15bb service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-ca8367ac-2d51-469a-889b-5ee5876de529 req-5bd5edfc-00a9-4afe-8bfe-c189730d15bb service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-5c2f38b2-1d02-4e50-bc89-a2fa523fc408 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:08 user nova-compute[73258]: WARNING nova.compute.manager [req-ca8367ac-2d51-469a-889b-5ee5876de529 req-5bd5edfc-00a9-4afe-8bfe-c189730d15bb service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-5c2f38b2-1d02-4e50-bc89-a2fa523fc408 for instance with vm_state active and task_state deleting.
Aug 27 06:41:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:08 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: d7b11762-9244-481b-87dd-757782d68101] Instance destroyed successfully.
Aug 27 06:41:08 user nova-compute[73258]: DEBUG nova.objects.instance [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lazy-loading 'resources' on Instance uuid d7b11762-9244-481b-87dd-757782d68101 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:39:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:39:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "933454ca-76f3-4f90-aab9-14e915a58487", "address": "fa:16:3e:41:30:a9", "network": {"id": "a2ca5db5-8c6d-44d0-acf5-c46a564a0247", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058086289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933454ca-76", "ovs_interfaceid": "933454ca-76f3-4f90-aab9-14e915a58487", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "933454ca-76f3-4f90-aab9-14e915a58487", "address": "fa:16:3e:41:30:a9", "network": {"id": "a2ca5db5-8c6d-44d0-acf5-c46a564a0247", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2058086289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933454ca-76", "ovs_interfaceid": "933454ca-76f3-4f90-aab9-14e915a58487", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:30:a9,bridge_name='br-int',has_traffic_filtering=True,id=933454ca-76f3-4f90-aab9-14e915a58487,network=Network(a2ca5db5-8c6d-44d0-acf5-c46a564a0247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933454ca-76') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG os_vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:30:a9,bridge_name='br-int',has_traffic_filtering=True,id=933454ca-76f3-4f90-aab9-14e915a58487,network=Network(a2ca5db5-8c6d-44d0-acf5-c46a564a0247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933454ca-76') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap933454ca-76, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118453.8208632, b51f0635-3ec5-4623-9265-350033b778c6 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:41:08 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: b51f0635-3ec5-4623-9265-350033b778c6] VM Stopped (Lifecycle Event)
Aug 27 06:41:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG nova.compute.manager [None req-cf05d5c1-10be-494b-b921-4ee26818d7dc None None] [instance: b51f0635-3ec5-4623-9265-350033b778c6] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:08 user nova-compute[73258]: INFO os_vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:30:a9,bridge_name='br-int',has_traffic_filtering=True,id=933454ca-76f3-4f90-aab9-14e915a58487,network=Network(a2ca5db5-8c6d-44d0-acf5-c46a564a0247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933454ca-76')
Aug 27 06:41:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:39:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:39:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "address": "fa:16:3e:34:10:b5", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2f38b2-1d", "ovs_interfaceid": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "address": "fa:16:3e:34:10:b5", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2f38b2-1d", "ovs_interfaceid": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:10:b5,bridge_name='br-int',has_traffic_filtering=True,id=5c2f38b2-1d02-4e50-bc89-a2fa523fc408,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5c2f38b2-1d') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG os_vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:10:b5,bridge_name='br-int',has_traffic_filtering=True,id=5c2f38b2-1d02-4e50-bc89-a2fa523fc408,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5c2f38b2-1d') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c2f38b2-1d, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:09 user nova-compute[73258]: INFO os_vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:10:b5,bridge_name='br-int',has_traffic_filtering=True,id=5c2f38b2-1d02-4e50-bc89-a2fa523fc408,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5c2f38b2-1d')
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:39:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:39:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0370f5d-defe-48bd-b320-47db121211e2", "address": "fa:16:3e:f6:03:41", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0370f5d-de", "ovs_interfaceid": "f0370f5d-defe-48bd-b320-47db121211e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "f0370f5d-defe-48bd-b320-47db121211e2", "address": "fa:16:3e:f6:03:41", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0370f5d-de", "ovs_interfaceid": "f0370f5d-defe-48bd-b320-47db121211e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:03:41,bridge_name='br-int',has_traffic_filtering=True,id=f0370f5d-defe-48bd-b320-47db121211e2,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0370f5d-de') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:03:41,bridge_name='br-int',has_traffic_filtering=True,id=f0370f5d-defe-48bd-b320-47db121211e2,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0370f5d-de') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0370f5d-de, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:09 user nova-compute[73258]: INFO os_vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:03:41,bridge_name='br-int',has_traffic_filtering=True,id=f0370f5d-defe-48bd-b320-47db121211e2,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0370f5d-de')
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:39:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:39:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "384e3fbf-506e-42cb-8050-e05c2ee95749", "address": "fa:16:3e:4d:cd:a0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384e3fbf-50", "ovs_interfaceid": "384e3fbf-506e-42cb-8050-e05c2ee95749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "384e3fbf-506e-42cb-8050-e05c2ee95749", "address": "fa:16:3e:4d:cd:a0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384e3fbf-50", "ovs_interfaceid": "384e3fbf-506e-42cb-8050-e05c2ee95749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:cd:a0,bridge_name='br-int',has_traffic_filtering=True,id=384e3fbf-506e-42cb-8050-e05c2ee95749,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384e3fbf-50') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:cd:a0,bridge_name='br-int',has_traffic_filtering=True,id=384e3fbf-506e-42cb-8050-e05c2ee95749,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384e3fbf-50') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap384e3fbf-50, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:09 user nova-compute[73258]: INFO os_vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:cd:a0,bridge_name='br-int',has_traffic_filtering=True,id=384e3fbf-506e-42cb-8050-e05c2ee95749,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384e3fbf-50')
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:39:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:39:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e184532a-df10-431e-9ef2-c3a595e56b5d", "address": "fa:16:3e:a6:7a:e0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184532a-df", "ovs_interfaceid": "e184532a-df10-431e-9ef2-c3a595e56b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "e184532a-df10-431e-9ef2-c3a595e56b5d", "address": "fa:16:3e:a6:7a:e0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184532a-df", "ovs_interfaceid": "e184532a-df10-431e-9ef2-c3a595e56b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7a:e0,bridge_name='br-int',has_traffic_filtering=True,id=e184532a-df10-431e-9ef2-c3a595e56b5d,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape184532a-df') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7a:e0,bridge_name='br-int',has_traffic_filtering=True,id=e184532a-df10-431e-9ef2-c3a595e56b5d,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape184532a-df') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape184532a-df, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:09 user nova-compute[73258]: INFO os_vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7a:e0,bridge_name='br-int',has_traffic_filtering=True,id=e184532a-df10-431e-9ef2-c3a595e56b5d,network=Network(3806278c-f96c-43dd-9a14-e652be482b60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape184532a-df')
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:39:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:39:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87427dc4-15ba-4179-999a-217c5eef5fd3", "address": "fa:16:3e:41:44:fc", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87427dc4-15", "ovs_interfaceid": "87427dc4-15ba-4179-999a-217c5eef5fd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "87427dc4-15ba-4179-999a-217c5eef5fd3", "address": "fa:16:3e:41:44:fc", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87427dc4-15", "ovs_interfaceid": "87427dc4-15ba-4179-999a-217c5eef5fd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:44:fc,bridge_name='br-int',has_traffic_filtering=True,id=87427dc4-15ba-4179-999a-217c5eef5fd3,network=Network(0e81e535-2163-479d-beb5-a099d4366ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87427dc4-15') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:44:fc,bridge_name='br-int',has_traffic_filtering=True,id=87427dc4-15ba-4179-999a-217c5eef5fd3,network=Network(0e81e535-2163-479d-beb5-a099d4366ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87427dc4-15') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87427dc4-15, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-4ebea8fc-ff5e-4eff-be9f-8a3dc2b0f764 req-def07312-d640-4c5d-9101-51e200c0f572 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-933454ca-76f3-4f90-aab9-14e915a58487 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4ebea8fc-ff5e-4eff-be9f-8a3dc2b0f764 req-def07312-d640-4c5d-9101-51e200c0f572 service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4ebea8fc-ff5e-4eff-be9f-8a3dc2b0f764 req-def07312-d640-4c5d-9101-51e200c0f572 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4ebea8fc-ff5e-4eff-be9f-8a3dc2b0f764 req-def07312-d640-4c5d-9101-51e200c0f572 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-4ebea8fc-ff5e-4eff-be9f-8a3dc2b0f764 req-def07312-d640-4c5d-9101-51e200c0f572 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-933454ca-76f3-4f90-aab9-14e915a58487 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:09 user nova-compute[73258]: WARNING nova.compute.manager [req-4ebea8fc-ff5e-4eff-be9f-8a3dc2b0f764 req-def07312-d640-4c5d-9101-51e200c0f572 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-933454ca-76f3-4f90-aab9-14e915a58487 for instance with vm_state active and task_state deleting.
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:09 user nova-compute[73258]: INFO os_vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:44:fc,bridge_name='br-int',has_traffic_filtering=True,id=87427dc4-15ba-4179-999a-217c5eef5fd3,network=Network(0e81e535-2163-479d-beb5-a099d4366ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87427dc4-15')
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-92854641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-92854641',id=11,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFlsMoR1WN1APjdQC0BjaQMkRz9qrsZ0PIh2hV52EBoLJsdp2Uh3GEn6m9QipeqZaN6/iWijqpkKdl+ioa4+TTLM7M8CCUBgtOZCogXJqyUT+B/J1sAeTAaj14V6bN1yg==',key_name='tempest-keypair-2053922871',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:39:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfc65880fbec492095249cbc8765656a',ramdisk_id='',reservation_id='r-6xksck1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1736258197',owner_user_name='tempest-TaggedBootDevicesTest_v242-1736258197-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:39:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43938d8b904147cb993c722199ff8ebb',uuid=d7b11762-9244-481b-87dd-757782d68101,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "address": "fa:16:3e:ca:07:e5", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9688c75d-c1", "ovs_interfaceid": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converting VIF {"id": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "address": "fa:16:3e:ca:07:e5", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9688c75d-c1", "ovs_interfaceid": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:07:e5,bridge_name='br-int',has_traffic_filtering=True,id=9688c75d-c1a5-4bab-aa92-e1e3eed530bd,network=Network(0e81e535-2163-479d-beb5-a099d4366ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9688c75d-c1') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:07:e5,bridge_name='br-int',has_traffic_filtering=True,id=9688c75d-c1a5-4bab-aa92-e1e3eed530bd,network=Network(0e81e535-2163-479d-beb5-a099d4366ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9688c75d-c1') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9688c75d-c1, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:09 user nova-compute[73258]: INFO os_vif [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:07:e5,bridge_name='br-int',has_traffic_filtering=True,id=9688c75d-c1a5-4bab-aa92-e1e3eed530bd,network=Network(0e81e535-2163-479d-beb5-a099d4366ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9688c75d-c1')
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfioIUzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:41:09 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec180633-e8ee-4358-9754-80500ee69b89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:09 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Took 1.93 seconds to deallocate network for instance.
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.057s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5a894a-329a-4336-9397-d8f5d2a71da1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:41:09 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:41:09 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4105cb130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e'): ({'sdd'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Removing single pathed devices sdd {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5ba1c0-8ebf-463c-b9d5-d360f0fd6dd8]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[054c7d0a-954f-45a5-adab-bb5cc404e33b]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Flushing IO for device /dev/sdd {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a190d236-6bd9-47cd-b6e9-d9a5c602eaed]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aee5f7a-1682-4c75-b0b4-2e5c634da4fb]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] SCSI volumes sdd have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e173cf65-13aa-458f-9404-fcb31bd34833]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d54b11b-78e9-472c-a1d3-87193b9e4fc1]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e, portal: 172.16.0.220,3260]
Aug 27 06:41:09 user nova-compute[73258]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e, portal: 172.16.0.220,3260] successful.
Aug 27 06:41:09 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82843900-e694-4189-a8db-9c5fc3f8701e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[925370aa-f4ea-4cb1-bb03-5d56737a53ed]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.461s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] <== disconnect_volume: return (462ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWHXCOAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:41:09 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ebb160-43df-4d30-8ae8-21b653e66596]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.059s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e899b518-116e-4252-b2b7-497a333900ec]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:41:09 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:09 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:41:09 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa430322d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424'): ({'sde'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Removing single pathed devices sde {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-f0370f5d-defe-48bd-b320-47db121211e2 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-f0370f5d-defe-48bd-b320-47db121211e2 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:09 user nova-compute[73258]: WARNING nova.compute.manager [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-f0370f5d-defe-48bd-b320-47db121211e2 for instance with vm_state active and task_state deleting.
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-unplugged-e184532a-df10-431e-9ef2-c3a595e56b5d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-unplugged-e184532a-df10-431e-9ef2-c3a595e56b5d {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-unplugged-e184532a-df10-431e-9ef2-c3a595e56b5d for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-e184532a-df10-431e-9ef2-c3a595e56b5d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-e184532a-df10-431e-9ef2-c3a595e56b5d {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:09 user nova-compute[73258]: WARNING nova.compute.manager [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-e184532a-df10-431e-9ef2-c3a595e56b5d for instance with vm_state active and task_state deleting.
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-unplugged-9688c75d-c1a5-4bab-aa92-e1e3eed530bd {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-unplugged-9688c75d-c1a5-4bab-aa92-e1e3eed530bd {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-ea5c534e-539d-40c2-916d-bc72b8ab4669 req-1f599339-2023-48d0-99b7-59b50faec216 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-unplugged-9688c75d-c1a5-4bab-aa92-e1e3eed530bd for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3165c3a8-2e83-4a3b-93c0-068c27053094]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8462796f-6538-4a7f-8a3f-a7a4303ed2f8]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Flushing IO for device /dev/sde {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf8d78b-1048-4f5a-a059-e02778a9894a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:41:10 user nova-compute[73258]: INFO nova.compute.manager [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Terminating instance
Aug 27 06:41:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6bcce8-cf1c-4ff3-816a-6cc908d3ef11]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] SCSI volumes sde have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85051c4-356c-4ff2-8ec5-d89c07ddce1a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a991e06-98c0-48a2-a5b3-e3848e807e87]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424, portal: 172.16.0.220,3260]
Aug 27 06:41:10 user nova-compute[73258]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424, portal: 172.16.0.220,3260] successful.
Aug 27 06:41:10 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.754s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8029df-68c8-405f-8347-12cb0137e424 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bafd41c-8322-4e74-a1b3-e1479bbbdfc1]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:10 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Deleted allocations for instance 3ad98f0c-e26f-4913-bf49-755cd63ece60
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.502s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] <== disconnect_volume: return (503ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EChVXTMP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:41:10 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.106s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c26d13-550c-4a64-8c3e-ec24d974f644]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.104s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ea9428-08bf-452c-bf47-9cd802864e62]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:41:10 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:10 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:10 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:41:10 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:41:10 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:10 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:41:10 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:41:10 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:10 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:10 user nova-compute[73258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 (non-flash)
Aug 27 06:41:10 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:41:10 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:10 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:41:10 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4105376d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318'): ({'sdc'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Removing single pathed devices sdc {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[539f5ccb-f017-4da7-9846-0d2d04279c5b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bcebfafc-cf62-4e47-be46-0524adc0f352 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "3ad98f0c-e26f-4913-bf49-755cd63ece60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.048s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.037s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[504d9427-6bcf-4dc1-aaa4-b91243a7603e]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Flushing IO for device /dev/sdc {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb626452-a17f-447a-bbc0-a25601227987]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.114s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13dac89-4170-4c3b-bdf9-89f686238a1f]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-unplugged-384e3fbf-506e-42cb-8050-e05c2ee95749 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-unplugged-384e3fbf-506e-42cb-8050-e05c2ee95749 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-unplugged-384e3fbf-506e-42cb-8050-e05c2ee95749 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-384e3fbf-506e-42cb-8050-e05c2ee95749 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-384e3fbf-506e-42cb-8050-e05c2ee95749 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:10 user nova-compute[73258]: WARNING nova.compute.manager [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-384e3fbf-506e-42cb-8050-e05c2ee95749 for instance with vm_state active and task_state deleting.
Aug 27 06:41:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Received event network-vif-deleted-be5db165-8b27-41aa-b600-d5cae17b3739 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-unplugged-87427dc4-15ba-4179-999a-217c5eef5fd3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-unplugged-87427dc4-15ba-4179-999a-217c5eef5fd3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-unplugged-87427dc4-15ba-4179-999a-217c5eef5fd3 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-87427dc4-15ba-4179-999a-217c5eef5fd3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-87427dc4-15ba-4179-999a-217c5eef5fd3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:10 user nova-compute[73258]: WARNING nova.compute.manager [req-cc129c71-c780-4903-b403-11af9e95fd07 req-5b2bdb1c-fd14-4d3b-be04-22749d2c0654 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-87427dc4-15ba-4179-999a-217c5eef5fd3 for instance with vm_state active and task_state deleting.
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a2637f-c8a2-44d6-a6e8-b955d0dd1849]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a755da83-773a-4652-96cd-ac0caba1a8ba]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318, portal: 172.16.0.220,3260]
Aug 27 06:41:10 user nova-compute[73258]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318, portal: 172.16.0.220,3260] successful.
Aug 27 06:41:10 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ee2716a-3f45-4dcb-90f8-b4119f23b318 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e110a7a-4060-40d6-9a00-a06e87f0fc88]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.667s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] <== disconnect_volume: return (668ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:41:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:41:10 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Deleting instance files /opt/stack/data/nova/instances/d7b11762-9244-481b-87dd-757782d68101_del
Aug 27 06:41:10 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Deletion of /opt/stack/data/nova/instances/d7b11762-9244-481b-87dd-757782d68101_del complete
Aug 27 06:41:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Removed pending event for 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae due to event {{(pid=73258) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118470.9921596, 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:41:11 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] VM Resumed (Lifecycle Event)
Aug 27 06:41:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-1c203164-0014-432b-8114-b6fa912ce1e9 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:11 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 06:41:11 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118470.9935226, 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:41:11 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] VM Started (Lifecycle Event)
Aug 27 06:41:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:41:11 user nova-compute[73258]: INFO nova.compute.manager [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Took 4.59 seconds to destroy the instance on the hypervisor.
Aug 27 06:41:11 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: d7b11762-9244-481b-87dd-757782d68101] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: d7b11762-9244-481b-87dd-757782d68101] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG nova.compute.manager [req-bb31ccf3-4960-4b8a-b845-d3919385a1c2 req-b333ad3c-744d-449a-ada3-4db4f3dfb879 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-unplugged-e5820add-1974-4f6c-873e-ef179593b46a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bb31ccf3-4960-4b8a-b845-d3919385a1c2 req-b333ad3c-744d-449a-ada3-4db4f3dfb879 service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bb31ccf3-4960-4b8a-b845-d3919385a1c2 req-b333ad3c-744d-449a-ada3-4db4f3dfb879 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bb31ccf3-4960-4b8a-b845-d3919385a1c2 req-b333ad3c-744d-449a-ada3-4db4f3dfb879 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG nova.compute.manager [req-bb31ccf3-4960-4b8a-b845-d3919385a1c2 req-b333ad3c-744d-449a-ada3-4db4f3dfb879 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-unplugged-e5820add-1974-4f6c-873e-ef179593b46a {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG nova.compute.manager [req-bb31ccf3-4960-4b8a-b845-d3919385a1c2 req-b333ad3c-744d-449a-ada3-4db4f3dfb879 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-unplugged-e5820add-1974-4f6c-873e-ef179593b46a for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG nova.compute.manager [req-bb31ccf3-4960-4b8a-b845-d3919385a1c2 req-b333ad3c-744d-449a-ada3-4db4f3dfb879 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-e5820add-1974-4f6c-873e-ef179593b46a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bb31ccf3-4960-4b8a-b845-d3919385a1c2 req-b333ad3c-744d-449a-ada3-4db4f3dfb879 service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bb31ccf3-4960-4b8a-b845-d3919385a1c2 req-b333ad3c-744d-449a-ada3-4db4f3dfb879 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bb31ccf3-4960-4b8a-b845-d3919385a1c2 req-b333ad3c-744d-449a-ada3-4db4f3dfb879 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG nova.compute.manager [req-bb31ccf3-4960-4b8a-b845-d3919385a1c2 req-b333ad3c-744d-449a-ada3-4db4f3dfb879 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-e5820add-1974-4f6c-873e-ef179593b46a {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:11 user nova-compute[73258]: WARNING nova.compute.manager [req-bb31ccf3-4960-4b8a-b845-d3919385a1c2 req-b333ad3c-744d-449a-ada3-4db4f3dfb879 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-e5820add-1974-4f6c-873e-ef179593b46a for instance with vm_state active and task_state deleting.
Aug 27 06:41:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'pci_requests' on Instance uuid 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'numa_topology' on Instance uuid 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-plugged-9688c75d-c1a5-4bab-aa92-e1e3eed530bd {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] Acquiring lock "d7b11762-9244-481b-87dd-757782d68101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] Lock "d7b11762-9244-481b-87dd-757782d68101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] No waiting events found dispatching network-vif-plugged-9688c75d-c1a5-4bab-aa92-e1e3eed530bd {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:12 user nova-compute[73258]: WARNING nova.compute.manager [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received unexpected event network-vif-plugged-9688c75d-c1a5-4bab-aa92-e1e3eed530bd for instance with vm_state active and task_state deleting.
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-unplugged-59275472-b18f-4e4b-922f-475dd553833c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-unplugged-59275472-b18f-4e4b-922f-475dd553833c {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-unplugged-59275472-b18f-4e4b-922f-475dd553833c for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-59275472-b18f-4e4b-922f-475dd553833c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-59275472-b18f-4e4b-922f-475dd553833c {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:12 user nova-compute[73258]: WARNING nova.compute.manager [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-59275472-b18f-4e4b-922f-475dd553833c for instance with vm_state active and task_state deleting.
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-unplugged-ff33d225-ef5e-4565-9278-4763c5b7ff6c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-unplugged-ff33d225-ef5e-4565-9278-4763c5b7ff6c {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-6040dd45-de89-4a70-a325-8712a21c8941 req-a5609bba-c07b-4a81-928e-5a9b3fb0a83d service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-unplugged-ff33d225-ef5e-4565-9278-4763c5b7ff6c for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:41:12 user nova-compute[73258]: INFO nova.compute.claims [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Claim successful on node user
Aug 27 06:41:12 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Instance destroyed successfully.
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.objects.instance [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lazy-loading 'resources' on Instance uuid 32d3fdfc-82ad-46ee-b673-4e73f43b85e7 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:39:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59275472-b18f-4e4b-922f-475dd553833c", "address": "fa:16:3e:05:21:15", "network": {"id": "5eaba2f5-e1ca-4a9b-8195-bc8798d89753", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-374547766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59275472-b1", "ovs_interfaceid": "59275472-b18f-4e4b-922f-475dd553833c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "59275472-b18f-4e4b-922f-475dd553833c", "address": "fa:16:3e:05:21:15", "network": {"id": "5eaba2f5-e1ca-4a9b-8195-bc8798d89753", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-374547766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59275472-b1", "ovs_interfaceid": "59275472-b18f-4e4b-922f-475dd553833c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:21:15,bridge_name='br-int',has_traffic_filtering=True,id=59275472-b18f-4e4b-922f-475dd553833c,network=Network(5eaba2f5-e1ca-4a9b-8195-bc8798d89753),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59275472-b1') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG os_vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:21:15,bridge_name='br-int',has_traffic_filtering=True,id=59275472-b18f-4e4b-922f-475dd553833c,network=Network(5eaba2f5-e1ca-4a9b-8195-bc8798d89753),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59275472-b1') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59275472-b1, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:12 user nova-compute[73258]: INFO os_vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:21:15,bridge_name='br-int',has_traffic_filtering=True,id=59275472-b18f-4e4b-922f-475dd553833c,network=Network(5eaba2f5-e1ca-4a9b-8195-bc8798d89753),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59275472-b1')
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:39:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5820add-1974-4f6c-873e-ef179593b46a", "address": "fa:16:3e:b1:35:89", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5820add-19", "ovs_interfaceid": "e5820add-1974-4f6c-873e-ef179593b46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "e5820add-1974-4f6c-873e-ef179593b46a", "address": "fa:16:3e:b1:35:89", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5820add-19", "ovs_interfaceid": "e5820add-1974-4f6c-873e-ef179593b46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:35:89,bridge_name='br-int',has_traffic_filtering=True,id=e5820add-1974-4f6c-873e-ef179593b46a,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape5820add-19') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG os_vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:35:89,bridge_name='br-int',has_traffic_filtering=True,id=e5820add-1974-4f6c-873e-ef179593b46a,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape5820add-19') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5820add-19, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:12 user nova-compute[73258]: INFO os_vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:35:89,bridge_name='br-int',has_traffic_filtering=True,id=e5820add-1974-4f6c-873e-ef179593b46a,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape5820add-19')
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:39:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "address": "fa:16:3e:5a:25:32", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff33d225-ef", "ovs_interfaceid": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "address": "fa:16:3e:5a:25:32", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff33d225-ef", "ovs_interfaceid": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:25:32,bridge_name='br-int',has_traffic_filtering=True,id=ff33d225-ef5e-4565-9278-4763c5b7ff6c,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff33d225-ef') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG os_vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:25:32,bridge_name='br-int',has_traffic_filtering=True,id=ff33d225-ef5e-4565-9278-4763c5b7ff6c,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff33d225-ef') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff33d225-ef, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:12 user nova-compute[73258]: INFO os_vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:25:32,bridge_name='br-int',has_traffic_filtering=True,id=ff33d225-ef5e-4565-9278-4763c5b7ff6c,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff33d225-ef')
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:39:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e481124c-b62d-4fc9-9f02-ba38c027180e", "address": "fa:16:3e:ef:7e:25", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape481124c-b6", "ovs_interfaceid": "e481124c-b62d-4fc9-9f02-ba38c027180e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "e481124c-b62d-4fc9-9f02-ba38c027180e", "address": "fa:16:3e:ef:7e:25", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape481124c-b6", "ovs_interfaceid": "e481124c-b62d-4fc9-9f02-ba38c027180e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:7e:25,bridge_name='br-int',has_traffic_filtering=True,id=e481124c-b62d-4fc9-9f02-ba38c027180e,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape481124c-b6') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG os_vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:7e:25,bridge_name='br-int',has_traffic_filtering=True,id=e481124c-b62d-4fc9-9f02-ba38c027180e,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape481124c-b6') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape481124c-b6, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:12 user nova-compute[73258]: INFO os_vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:7e:25,bridge_name='br-int',has_traffic_filtering=True,id=e481124c-b62d-4fc9-9f02-ba38c027180e,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape481124c-b6')
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:39:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0914d88d-1909-4bcb-a776-37af31e16b9e", "address": "fa:16:3e:a0:a3:84", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914d88d-19", "ovs_interfaceid": "0914d88d-1909-4bcb-a776-37af31e16b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "0914d88d-1909-4bcb-a776-37af31e16b9e", "address": "fa:16:3e:a0:a3:84", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914d88d-19", "ovs_interfaceid": "0914d88d-1909-4bcb-a776-37af31e16b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a3:84,bridge_name='br-int',has_traffic_filtering=True,id=0914d88d-1909-4bcb-a776-37af31e16b9e,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0914d88d-19') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG os_vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a3:84,bridge_name='br-int',has_traffic_filtering=True,id=0914d88d-1909-4bcb-a776-37af31e16b9e,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0914d88d-19') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0914d88d-19, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:12 user nova-compute[73258]: INFO os_vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a3:84,bridge_name='br-int',has_traffic_filtering=True,id=0914d88d-1909-4bcb-a776-37af31e16b9e,network=Network(96d68c6b-6b1b-422f-bc26-cd69e5dcebd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0914d88d-19')
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:39:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e32a9d4d-57df-4765-b5be-12cea8621fce", "address": "fa:16:3e:10:c4:37", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32a9d4d-57", "ovs_interfaceid": "e32a9d4d-57df-4765-b5be-12cea8621fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "e32a9d4d-57df-4765-b5be-12cea8621fce", "address": "fa:16:3e:10:c4:37", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32a9d4d-57", "ovs_interfaceid": "e32a9d4d-57df-4765-b5be-12cea8621fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:c4:37,bridge_name='br-int',has_traffic_filtering=True,id=e32a9d4d-57df-4765-b5be-12cea8621fce,network=Network(d1088fa3-bbf4-4136-b3bd-3014c8cd4254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape32a9d4d-57') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG os_vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:c4:37,bridge_name='br-int',has_traffic_filtering=True,id=e32a9d4d-57df-4765-b5be-12cea8621fce,network=Network(d1088fa3-bbf4-4136-b3bd-3014c8cd4254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape32a9d4d-57') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape32a9d4d-57, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:12 user nova-compute[73258]: INFO os_vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:c4:37,bridge_name='br-int',has_traffic_filtering=True,id=e32a9d4d-57df-4765-b5be-12cea8621fce,network=Network(d1088fa3-bbf4-4136-b3bd-3014c8cd4254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape32a9d4d-57')
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T06:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-781962375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-781962375',id=12,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwclUmF3vm9/m2o7nOkdAr0EI8vUfoVKxpxcNIRSeH1RN787zXZysZPgsqTAGxK9PKc71xY4cvxRsSx6bHSSzu8Zz5IOhDghNJJMBK6lgdDYd8ZPq+y1whXQqdmv3u7yQ==',key_name='tempest-keypair-618826225',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:39:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80e3e1c0feb243a7aeb858041065ffba',ramdisk_id='',reservation_id='r-5iv110c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-913935157',owner_user_name='tempest-TaggedBootDevicesTest-913935157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e08cea7dd1244afb9c29e851e15fa1a0',uuid=32d3fdfc-82ad-46ee-b673-4e73f43b85e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "783f5103-a178-42e0-a3b0-f523ca4c9439", "address": "fa:16:3e:4d:78:05", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap783f5103-a1", "ovs_interfaceid": "783f5103-a178-42e0-a3b0-f523ca4c9439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converting VIF {"id": "783f5103-a178-42e0-a3b0-f523ca4c9439", "address": "fa:16:3e:4d:78:05", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap783f5103-a1", "ovs_interfaceid": "783f5103-a178-42e0-a3b0-f523ca4c9439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:78:05,bridge_name='br-int',has_traffic_filtering=True,id=783f5103-a178-42e0-a3b0-f523ca4c9439,network=Network(d1088fa3-bbf4-4136-b3bd-3014c8cd4254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap783f5103-a1') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG os_vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:78:05,bridge_name='br-int',has_traffic_filtering=True,id=783f5103-a178-42e0-a3b0-f523ca4c9439,network=Network(d1088fa3-bbf4-4136-b3bd-3014c8cd4254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap783f5103-a1') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap783f5103-a1, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:41:12 user nova-compute[73258]: INFO os_vif [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:78:05,bridge_name='br-int',has_traffic_filtering=True,id=783f5103-a178-42e0-a3b0-f523ca4c9439,network=Network(d1088fa3-bbf4-4136-b3bd-3014c8cd4254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap783f5103-a1')
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxRcghvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:41:12 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:41:12 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adcb549-f021-4bd5-be7a-12c348c26ff4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e0bcd6-74b1-4b4e-a55c-f1ad5ccd3d04]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:41:12 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:12 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:12 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:41:12 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:12 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:41:12 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:41:12 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:12 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:12 user nova-compute[73258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd (non-flash)
Aug 27 06:41:12 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:12 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:41:12 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa410526170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd'): ({'sdf'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Removing single pathed devices sdf {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaa966b-9ae0-4ba3-8dc6-42d12ae09d99]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-9e3400b5-938a-4b49-98ae-d25e12a82694 req-c7972c09-84d3-454c-ba7f-70027bd8ee92 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9e3400b5-938a-4b49-98ae-d25e12a82694 req-c7972c09-84d3-454c-ba7f-70027bd8ee92 service nova] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9e3400b5-938a-4b49-98ae-d25e12a82694 req-c7972c09-84d3-454c-ba7f-70027bd8ee92 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9e3400b5-938a-4b49-98ae-d25e12a82694 req-c7972c09-84d3-454c-ba7f-70027bd8ee92 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-9e3400b5-938a-4b49-98ae-d25e12a82694 req-c7972c09-84d3-454c-ba7f-70027bd8ee92 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] No waiting events found dispatching network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:12 user nova-compute[73258]: WARNING nova.compute.manager [req-9e3400b5-938a-4b49-98ae-d25e12a82694 req-c7972c09-84d3-454c-ba7f-70027bd8ee92 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received unexpected event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 for instance with vm_state rescued and task_state None.
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-9e3400b5-938a-4b49-98ae-d25e12a82694 req-c7972c09-84d3-454c-ba7f-70027bd8ee92 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9e3400b5-938a-4b49-98ae-d25e12a82694 req-c7972c09-84d3-454c-ba7f-70027bd8ee92 service nova] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9e3400b5-938a-4b49-98ae-d25e12a82694 req-c7972c09-84d3-454c-ba7f-70027bd8ee92 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9e3400b5-938a-4b49-98ae-d25e12a82694 req-c7972c09-84d3-454c-ba7f-70027bd8ee92 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-9e3400b5-938a-4b49-98ae-d25e12a82694 req-c7972c09-84d3-454c-ba7f-70027bd8ee92 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] No waiting events found dispatching network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:12 user nova-compute[73258]: WARNING nova.compute.manager [req-9e3400b5-938a-4b49-98ae-d25e12a82694 req-c7972c09-84d3-454c-ba7f-70027bd8ee92 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received unexpected event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 for instance with vm_state rescued and task_state None.
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-9e3400b5-938a-4b49-98ae-d25e12a82694 req-c7972c09-84d3-454c-ba7f-70027bd8ee92 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-unplugged-e481124c-b62d-4fc9-9f02-ba38c027180e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9e3400b5-938a-4b49-98ae-d25e12a82694 req-c7972c09-84d3-454c-ba7f-70027bd8ee92 service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9e3400b5-938a-4b49-98ae-d25e12a82694 req-c7972c09-84d3-454c-ba7f-70027bd8ee92 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9e3400b5-938a-4b49-98ae-d25e12a82694 req-c7972c09-84d3-454c-ba7f-70027bd8ee92 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-9e3400b5-938a-4b49-98ae-d25e12a82694 req-c7972c09-84d3-454c-ba7f-70027bd8ee92 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-unplugged-e481124c-b62d-4fc9-9f02-ba38c027180e {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-9e3400b5-938a-4b49-98ae-d25e12a82694 req-c7972c09-84d3-454c-ba7f-70027bd8ee92 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-unplugged-e481124c-b62d-4fc9-9f02-ba38c027180e for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd9f17c-6b48-4b65-b1dd-6775d8f43606]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Flushing IO for device /dev/sdf {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b3dcbd-3742-4bbb-bba0-acc16e06ebbf]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:12 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.862s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.073s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bbea65-0c6c-4ca1-99fb-eaace647859a]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] SCSI volumes sdf have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ab3854-7ca8-437c-9ab0-af2c04436f4a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a6cdf2-1621-4876-8ee8-82891590f1cf]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd, portal: 172.16.0.220,3260]
Aug 27 06:41:13 user nova-compute[73258]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd, portal: 172.16.0.220,3260] successful.
Aug 27 06:41:13 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: INFO nova.network.neutron [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Updating port a345de09-b566-4d5c-8df6-5e706f31bc62 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4341dc1-1685-44f0-b29f-5212dba42abd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[419d82c9-dd54-4981-9256-1f3bfd56446e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] <== disconnect_volume: return (410ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NPfkTEFV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:41:13 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf79a352-ac87-427a-87f3-0611172092e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec00eeb-6871-4821-b628-5f543fcc4510]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:41:13 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:13 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:13 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:13 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:41:13 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:41:13 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:13 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:13 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:13 user nova-compute[73258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d (non-flash)
Aug 27 06:41:13 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa410526170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d'): ({'sdh'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Removing single pathed devices sdh {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bf6ece-86dd-43c1-bfbc-d303d694375f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c04175c-6149-40d6-9b28-f6acd988e614]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Flushing IO for device /dev/sdh {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4377c56-300e-4060-8c33-32a377be1c84]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.056s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[772e8251-bad5-4836-9601-c3c66707139d]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] SCSI volumes sdh have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb0665d-afd2-44f9-aa24-afc98bf712b0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-unplugged-e32a9d4d-57df-4765-b5be-12cea8621fce {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-unplugged-e32a9d4d-57df-4765-b5be-12cea8621fce {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-unplugged-e32a9d4d-57df-4765-b5be-12cea8621fce for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-e32a9d4d-57df-4765-b5be-12cea8621fce {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-e32a9d4d-57df-4765-b5be-12cea8621fce {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:13 user nova-compute[73258]: WARNING nova.compute.manager [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-e32a9d4d-57df-4765-b5be-12cea8621fce for instance with vm_state active and task_state deleting.
Aug 27 06:41:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-unplugged-783f5103-a178-42e0-a3b0-f523ca4c9439 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-unplugged-783f5103-a178-42e0-a3b0-f523ca4c9439 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-unplugged-783f5103-a178-42e0-a3b0-f523ca4c9439 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-783f5103-a178-42e0-a3b0-f523ca4c9439 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-783f5103-a178-42e0-a3b0-f523ca4c9439 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:13 user nova-compute[73258]: WARNING nova.compute.manager [req-caab8674-662b-4a4f-a7f1-b1f85b39fd1e req-c11d8649-03fa-421c-b95e-40d506392438 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-783f5103-a178-42e0-a3b0-f523ca4c9439 for instance with vm_state active and task_state deleting.
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[440ad627-93aa-4b5e-85b6-d2e78bd92870]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d, portal: 172.16.0.220,3260]
Aug 27 06:41:13 user nova-compute[73258]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d, portal: 172.16.0.220,3260] successful.
Aug 27 06:41:13 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfea6f05-84f2-4b48-9460-5da143c24c4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a48ece4-1a92-4ddf-b020-a165900fed60]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] <== disconnect_volume: return (396ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLazsToF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:41:13 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[87246754-0b64-4229-8832-7fead0fd4037]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[485a92a2-decf-4f86-8d91-c5d1e2256be0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:41:13 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:13 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:13 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:13 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 (non-flash)
Aug 27 06:41:13 user nova-compute[73258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:13 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:13 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:13 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4105ca8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53'): ({'sdi'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Removing single pathed devices sdi {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9842a7db-837b-49a7-8a08-64a3fda6b32e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7823f760-1122-478d-89ee-406371b8b497]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Flushing IO for device /dev/sdi {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f946f39d-f39d-4268-b0bb-6fb75d324268]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[01759176-bad4-4f42-b739-b2665ae593a6]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] SCSI volumes sdi have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[52097e12-e4a2-4042-b9ab-97ad25b98b7d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55d9a68-763b-4012-b0f7-fdbb92f65b48]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53, portal: 172.16.0.220,3260]
Aug 27 06:41:13 user nova-compute[73258]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53, portal: 172.16.0.220,3260] successful.
Aug 27 06:41:13 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4212a9b2-2bd0-431f-8257-85a3d0bc9a53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83e96b3-e3f5-4ff6-9e54-a8f80397a9a7]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] <== disconnect_volume: return (400ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:41:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:41:13 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Deleting instance files /opt/stack/data/nova/instances/32d3fdfc-82ad-46ee-b673-4e73f43b85e7_del
Aug 27 06:41:13 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Deletion of /opt/stack/data/nova/instances/32d3fdfc-82ad-46ee-b673-4e73f43b85e7_del complete
Aug 27 06:41:14 user nova-compute[73258]: INFO nova.compute.manager [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Took 4.05 seconds to destroy the instance on the hypervisor.
Aug 27 06:41:14 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:41:14 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:41:14 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:41:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:41:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquired lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:41:14 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:41:14 user nova-compute[73258]: DEBUG nova.compute.manager [req-4eb5ba11-dafa-4562-b701-59cf357ab61c req-9b19b8d2-b753-4725-8e62-09590c028c8f service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-ff33d225-ef5e-4565-9278-4763c5b7ff6c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4eb5ba11-dafa-4562-b701-59cf357ab61c req-9b19b8d2-b753-4725-8e62-09590c028c8f service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4eb5ba11-dafa-4562-b701-59cf357ab61c req-9b19b8d2-b753-4725-8e62-09590c028c8f service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4eb5ba11-dafa-4562-b701-59cf357ab61c req-9b19b8d2-b753-4725-8e62-09590c028c8f service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:14 user nova-compute[73258]: DEBUG nova.compute.manager [req-4eb5ba11-dafa-4562-b701-59cf357ab61c req-9b19b8d2-b753-4725-8e62-09590c028c8f service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-ff33d225-ef5e-4565-9278-4763c5b7ff6c {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:14 user nova-compute[73258]: WARNING nova.compute.manager [req-4eb5ba11-dafa-4562-b701-59cf357ab61c req-9b19b8d2-b753-4725-8e62-09590c028c8f service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-ff33d225-ef5e-4565-9278-4763c5b7ff6c for instance with vm_state active and task_state deleting.
Aug 27 06:41:14 user nova-compute[73258]: DEBUG nova.compute.manager [req-4eb5ba11-dafa-4562-b701-59cf357ab61c req-9b19b8d2-b753-4725-8e62-09590c028c8f service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received event network-changed-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:14 user nova-compute[73258]: DEBUG nova.compute.manager [req-4eb5ba11-dafa-4562-b701-59cf357ab61c req-9b19b8d2-b753-4725-8e62-09590c028c8f service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Refreshing instance network info cache due to event network-changed-a345de09-b566-4d5c-8df6-5e706f31bc62. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:41:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4eb5ba11-dafa-4562-b701-59cf357ab61c req-9b19b8d2-b753-4725-8e62-09590c028c8f service nova] Acquiring lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:41:14 user nova-compute[73258]: DEBUG nova.compute.manager [req-ef5c92d8-d1a9-4a58-b383-00553ea89030 req-d77da130-8633-42a7-8eb6-3e63913d81af service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-e481124c-b62d-4fc9-9f02-ba38c027180e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ef5c92d8-d1a9-4a58-b383-00553ea89030 req-d77da130-8633-42a7-8eb6-3e63913d81af service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ef5c92d8-d1a9-4a58-b383-00553ea89030 req-d77da130-8633-42a7-8eb6-3e63913d81af service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ef5c92d8-d1a9-4a58-b383-00553ea89030 req-d77da130-8633-42a7-8eb6-3e63913d81af service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-ef5c92d8-d1a9-4a58-b383-00553ea89030 req-d77da130-8633-42a7-8eb6-3e63913d81af service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-e481124c-b62d-4fc9-9f02-ba38c027180e {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:15 user nova-compute[73258]: WARNING nova.compute.manager [req-ef5c92d8-d1a9-4a58-b383-00553ea89030 req-d77da130-8633-42a7-8eb6-3e63913d81af service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-e481124c-b62d-4fc9-9f02-ba38c027180e for instance with vm_state active and task_state deleting.
Aug 27 06:41:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-ef5c92d8-d1a9-4a58-b383-00553ea89030 req-d77da130-8633-42a7-8eb6-3e63913d81af service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-unplugged-0914d88d-1909-4bcb-a776-37af31e16b9e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ef5c92d8-d1a9-4a58-b383-00553ea89030 req-d77da130-8633-42a7-8eb6-3e63913d81af service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ef5c92d8-d1a9-4a58-b383-00553ea89030 req-d77da130-8633-42a7-8eb6-3e63913d81af service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ef5c92d8-d1a9-4a58-b383-00553ea89030 req-d77da130-8633-42a7-8eb6-3e63913d81af service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-ef5c92d8-d1a9-4a58-b383-00553ea89030 req-d77da130-8633-42a7-8eb6-3e63913d81af service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-unplugged-0914d88d-1909-4bcb-a776-37af31e16b9e {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-ef5c92d8-d1a9-4a58-b383-00553ea89030 req-d77da130-8633-42a7-8eb6-3e63913d81af service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-unplugged-0914d88d-1909-4bcb-a776-37af31e16b9e for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-ef5c92d8-d1a9-4a58-b383-00553ea89030 req-d77da130-8633-42a7-8eb6-3e63913d81af service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-plugged-0914d88d-1909-4bcb-a776-37af31e16b9e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ef5c92d8-d1a9-4a58-b383-00553ea89030 req-d77da130-8633-42a7-8eb6-3e63913d81af service nova] Acquiring lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ef5c92d8-d1a9-4a58-b383-00553ea89030 req-d77da130-8633-42a7-8eb6-3e63913d81af service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ef5c92d8-d1a9-4a58-b383-00553ea89030 req-d77da130-8633-42a7-8eb6-3e63913d81af service nova] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-ef5c92d8-d1a9-4a58-b383-00553ea89030 req-d77da130-8633-42a7-8eb6-3e63913d81af service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] No waiting events found dispatching network-vif-plugged-0914d88d-1909-4bcb-a776-37af31e16b9e {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:15 user nova-compute[73258]: WARNING nova.compute.manager [req-ef5c92d8-d1a9-4a58-b383-00553ea89030 req-d77da130-8633-42a7-8eb6-3e63913d81af service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received unexpected event network-vif-plugged-0914d88d-1909-4bcb-a776-37af31e16b9e for instance with vm_state active and task_state deleting.
Aug 27 06:41:15 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Updating instance_info_cache with network_info: [{"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Releasing lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:41:15 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Creating image(s)
Aug 27 06:41:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "/opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "/opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "/opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'trusted_certs' on Instance uuid 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4eb5ba11-dafa-4562-b701-59cf357ab61c req-9b19b8d2-b753-4725-8e62-09590c028c8f service nova] Acquired lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG nova.network.neutron [req-4eb5ba11-dafa-4562-b701-59cf357ab61c req-9b19b8d2-b753-4725-8e62-09590c028c8f service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Refreshing network info cache for port a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG nova.objects.base [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Object Instance<32ca4a64-5e49-4bbb-bf96-d3f8cf39146e> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "7d0a114b594dd60f887bb29d9d5f38ee9044b6a6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "7d0a114b594dd60f887bb29d9d5f38ee9044b6a6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d0a114b594dd60f887bb29d9d5f38ee9044b6a6.part --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-489c7179-d3dc-4f2f-be58-41bced07aede req-973b269a-cb8a-4472-b6fe-2f8955c0ce65 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-deleted-933454ca-76f3-4f90-aab9-14e915a58487 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:17 user nova-compute[73258]: INFO nova.compute.manager [req-489c7179-d3dc-4f2f-be58-41bced07aede req-973b269a-cb8a-4472-b6fe-2f8955c0ce65 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Neutron deleted interface 933454ca-76f3-4f90-aab9-14e915a58487; detaching it from the instance and deleting it from the info cache
Aug 27 06:41:17 user nova-compute[73258]: DEBUG nova.network.neutron [req-489c7179-d3dc-4f2f-be58-41bced07aede req-973b269a-cb8a-4472-b6fe-2f8955c0ce65 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Updating instance_info_cache with network_info: [{"id": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "address": "fa:16:3e:34:10:b5", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2f38b2-1d", "ovs_interfaceid": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f0370f5d-defe-48bd-b320-47db121211e2", "address": "fa:16:3e:f6:03:41", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0370f5d-de", "ovs_interfaceid": "f0370f5d-defe-48bd-b320-47db121211e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "384e3fbf-506e-42cb-8050-e05c2ee95749", "address": "fa:16:3e:4d:cd:a0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384e3fbf-50", "ovs_interfaceid": "384e3fbf-506e-42cb-8050-e05c2ee95749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e184532a-df10-431e-9ef2-c3a595e56b5d", "address": "fa:16:3e:a6:7a:e0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184532a-df", "ovs_interfaceid": "e184532a-df10-431e-9ef2-c3a595e56b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87427dc4-15ba-4179-999a-217c5eef5fd3", "address": "fa:16:3e:41:44:fc", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87427dc4-15", "ovs_interfaceid": "87427dc4-15ba-4179-999a-217c5eef5fd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "address": "fa:16:3e:ca:07:e5", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9688c75d-c1", "ovs_interfaceid": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d0a114b594dd60f887bb29d9d5f38ee9044b6a6.part --force-share --output=json" returned: 0 in 0.240s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG nova.virt.images [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] 82376e8d-053f-4d6a-84f9-8200143c7462 was qcow2, converting to raw {{(pid=73258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG nova.privsep.utils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7d0a114b594dd60f887bb29d9d5f38ee9044b6a6.part /opt/stack/data/nova/instances/_base/7d0a114b594dd60f887bb29d9d5f38ee9044b6a6.converted {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-489c7179-d3dc-4f2f-be58-41bced07aede req-973b269a-cb8a-4472-b6fe-2f8955c0ce65 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Detach interface failed, port_id=933454ca-76f3-4f90-aab9-14e915a58487, reason: Instance d7b11762-9244-481b-87dd-757782d68101 could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-489c7179-d3dc-4f2f-be58-41bced07aede req-973b269a-cb8a-4472-b6fe-2f8955c0ce65 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-deleted-87427dc4-15ba-4179-999a-217c5eef5fd3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:17 user nova-compute[73258]: INFO nova.compute.manager [req-489c7179-d3dc-4f2f-be58-41bced07aede req-973b269a-cb8a-4472-b6fe-2f8955c0ce65 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Neutron deleted interface 87427dc4-15ba-4179-999a-217c5eef5fd3; detaching it from the instance and deleting it from the info cache
Aug 27 06:41:17 user nova-compute[73258]: DEBUG nova.network.neutron [req-489c7179-d3dc-4f2f-be58-41bced07aede req-973b269a-cb8a-4472-b6fe-2f8955c0ce65 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Updating instance_info_cache with network_info: [{"id": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "address": "fa:16:3e:34:10:b5", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2f38b2-1d", "ovs_interfaceid": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f0370f5d-defe-48bd-b320-47db121211e2", "address": "fa:16:3e:f6:03:41", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0370f5d-de", "ovs_interfaceid": "f0370f5d-defe-48bd-b320-47db121211e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "384e3fbf-506e-42cb-8050-e05c2ee95749", "address": "fa:16:3e:4d:cd:a0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap384e3fbf-50", "ovs_interfaceid": "384e3fbf-506e-42cb-8050-e05c2ee95749", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e184532a-df10-431e-9ef2-c3a595e56b5d", "address": "fa:16:3e:a6:7a:e0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184532a-df", "ovs_interfaceid": "e184532a-df10-431e-9ef2-c3a595e56b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "address": "fa:16:3e:ca:07:e5", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9688c75d-c1", "ovs_interfaceid": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-489c7179-d3dc-4f2f-be58-41bced07aede req-973b269a-cb8a-4472-b6fe-2f8955c0ce65 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Detach interface failed, port_id=87427dc4-15ba-4179-999a-217c5eef5fd3, reason: Instance d7b11762-9244-481b-87dd-757782d68101 could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-489c7179-d3dc-4f2f-be58-41bced07aede req-973b269a-cb8a-4472-b6fe-2f8955c0ce65 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-deleted-384e3fbf-506e-42cb-8050-e05c2ee95749 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:17 user nova-compute[73258]: INFO nova.compute.manager [req-489c7179-d3dc-4f2f-be58-41bced07aede req-973b269a-cb8a-4472-b6fe-2f8955c0ce65 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Neutron deleted interface 384e3fbf-506e-42cb-8050-e05c2ee95749; detaching it from the instance and deleting it from the info cache
Aug 27 06:41:17 user nova-compute[73258]: DEBUG nova.network.neutron [req-489c7179-d3dc-4f2f-be58-41bced07aede req-973b269a-cb8a-4472-b6fe-2f8955c0ce65 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Updating instance_info_cache with network_info: [{"id": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "address": "fa:16:3e:34:10:b5", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2f38b2-1d", "ovs_interfaceid": "5c2f38b2-1d02-4e50-bc89-a2fa523fc408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f0370f5d-defe-48bd-b320-47db121211e2", "address": "fa:16:3e:f6:03:41", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0370f5d-de", "ovs_interfaceid": "f0370f5d-defe-48bd-b320-47db121211e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e184532a-df10-431e-9ef2-c3a595e56b5d", "address": "fa:16:3e:a6:7a:e0", "network": {"id": "3806278c-f96c-43dd-9a14-e652be482b60", "bridge": "br-int", "label": "tempest-device-tagging-net1-399100089", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape184532a-df", "ovs_interfaceid": "e184532a-df10-431e-9ef2-c3a595e56b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "address": "fa:16:3e:ca:07:e5", "network": {"id": "0e81e535-2163-479d-beb5-a099d4366ec6", "bridge": "br-int", "label": "tempest-device-tagging-net2-393044268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfc65880fbec492095249cbc8765656a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9688c75d-c1", "ovs_interfaceid": "9688c75d-c1a5-4bab-aa92-e1e3eed530bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-489c7179-d3dc-4f2f-be58-41bced07aede req-973b269a-cb8a-4472-b6fe-2f8955c0ce65 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Detach interface failed, port_id=384e3fbf-506e-42cb-8050-e05c2ee95749, reason: Instance d7b11762-9244-481b-87dd-757782d68101 could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7d0a114b594dd60f887bb29d9d5f38ee9044b6a6.part /opt/stack/data/nova/instances/_base/7d0a114b594dd60f887bb29d9d5f38ee9044b6a6.converted" returned: 0 in 0.209s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d0a114b594dd60f887bb29d9d5f38ee9044b6a6.converted --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: d7b11762-9244-481b-87dd-757782d68101] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:41:17 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: d7b11762-9244-481b-87dd-757782d68101] Took 6.27 seconds to deallocate network for instance.
Aug 27 06:41:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d0a114b594dd60f887bb29d9d5f38ee9044b6a6.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "7d0a114b594dd60f887bb29d9d5f38ee9044b6a6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.665s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d0a114b594dd60f887bb29d9d5f38ee9044b6a6 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG nova.network.neutron [req-4eb5ba11-dafa-4562-b701-59cf357ab61c req-9b19b8d2-b753-4725-8e62-09590c028c8f service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Updated VIF entry in instance network info cache for port a345de09-b566-4d5c-8df6-5e706f31bc62. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG nova.network.neutron [req-4eb5ba11-dafa-4562-b701-59cf357ab61c req-9b19b8d2-b753-4725-8e62-09590c028c8f service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Updating instance_info_cache with network_info: [{"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d0a114b594dd60f887bb29d9d5f38ee9044b6a6 --force-share --output=json" returned: 0 in 0.213s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "7d0a114b594dd60f887bb29d9d5f38ee9044b6a6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "7d0a114b594dd60f887bb29d9d5f38ee9044b6a6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d0a114b594dd60f887bb29d9d5f38ee9044b6a6 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4eb5ba11-dafa-4562-b701-59cf357ab61c req-9b19b8d2-b753-4725-8e62-09590c028c8f service nova] Releasing lock "refresh_cache-32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d0a114b594dd60f887bb29d9d5f38ee9044b6a6 --force-share --output=json" returned: 0 in 0.202s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d0a114b594dd60f887bb29d9d5f38ee9044b6a6,backing_fmt=raw /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d0a114b594dd60f887bb29d9d5f38ee9044b6a6,backing_fmt=raw /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk 1073741824" returned: 0 in 0.063s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "7d0a114b594dd60f887bb29d9d5f38ee9044b6a6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d0a114b594dd60f887bb29d9d5f38ee9044b6a6 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d0a114b594dd60f887bb29d9d5f38ee9044b6a6 --force-share --output=json" returned: 0 in 0.209s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:18 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'migration_context' on Instance uuid 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:41:18 user nova-compute[73258]: DEBUG nova.objects.base [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Object Instance<32ca4a64-5e49-4bbb-bf96-d3f8cf39146e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:41:18 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Rebasing disk image.
Aug 27 06:41:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.178s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 -F raw /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-c503efde-642e-48b5-b2dd-cfa66f7b1d34 req-2f8501af-f03f-46d0-a4d3-41155e5bf400 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-deleted-59275472-b18f-4e4b-922f-475dd553833c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:18 user nova-compute[73258]: INFO nova.compute.manager [req-c503efde-642e-48b5-b2dd-cfa66f7b1d34 req-2f8501af-f03f-46d0-a4d3-41155e5bf400 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Neutron deleted interface 59275472-b18f-4e4b-922f-475dd553833c; detaching it from the instance and deleting it from the info cache
Aug 27 06:41:18 user nova-compute[73258]: DEBUG nova.network.neutron [req-c503efde-642e-48b5-b2dd-cfa66f7b1d34 req-2f8501af-f03f-46d0-a4d3-41155e5bf400 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updating instance_info_cache with network_info: [{"id": "e5820add-1974-4f6c-873e-ef179593b46a", "address": "fa:16:3e:b1:35:89", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5820add-19", "ovs_interfaceid": "e5820add-1974-4f6c-873e-ef179593b46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "address": "fa:16:3e:5a:25:32", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff33d225-ef", "ovs_interfaceid": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e481124c-b62d-4fc9-9f02-ba38c027180e", "address": "fa:16:3e:ef:7e:25", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape481124c-b6", "ovs_interfaceid": "e481124c-b62d-4fc9-9f02-ba38c027180e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0914d88d-1909-4bcb-a776-37af31e16b9e", "address": "fa:16:3e:a0:a3:84", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914d88d-19", "ovs_interfaceid": "0914d88d-1909-4bcb-a776-37af31e16b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e32a9d4d-57df-4765-b5be-12cea8621fce", "address": "fa:16:3e:10:c4:37", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32a9d4d-57", "ovs_interfaceid": "e32a9d4d-57df-4765-b5be-12cea8621fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "783f5103-a178-42e0-a3b0-f523ca4c9439", "address": "fa:16:3e:4d:78:05", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap783f5103-a1", "ovs_interfaceid": "783f5103-a178-42e0-a3b0-f523ca4c9439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:41:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-c503efde-642e-48b5-b2dd-cfa66f7b1d34 req-2f8501af-f03f-46d0-a4d3-41155e5bf400 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Detach interface failed, port_id=59275472-b18f-4e4b-922f-475dd553833c, reason: Instance 32d3fdfc-82ad-46ee-b673-4e73f43b85e7 could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:41:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-59e17aa4-60f4-4505-bfc8-38f5a5d2ef91 req-7a020b24-bfdb-4286-8703-0c57e9298d21 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-deleted-e184532a-df10-431e-9ef2-c3a595e56b5d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-59e17aa4-60f4-4505-bfc8-38f5a5d2ef91 req-7a020b24-bfdb-4286-8703-0c57e9298d21 service nova] [instance: d7b11762-9244-481b-87dd-757782d68101] Received event network-vif-deleted-9688c75d-c1a5-4bab-aa92-e1e3eed530bd {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:20 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:41:20 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Took 6.63 seconds to deallocate network for instance.
Aug 27 06:41:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-7c25a3a0-d92a-4eed-b933-3337331e8e42 req-8f20ed11-04de-4557-9b79-dab6e0dbe4f7 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-deleted-e481124c-b62d-4fc9-9f02-ba38c027180e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:20 user nova-compute[73258]: INFO nova.compute.manager [req-7c25a3a0-d92a-4eed-b933-3337331e8e42 req-8f20ed11-04de-4557-9b79-dab6e0dbe4f7 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Neutron deleted interface e481124c-b62d-4fc9-9f02-ba38c027180e; detaching it from the instance and deleting it from the info cache
Aug 27 06:41:20 user nova-compute[73258]: DEBUG nova.network.neutron [req-7c25a3a0-d92a-4eed-b933-3337331e8e42 req-8f20ed11-04de-4557-9b79-dab6e0dbe4f7 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updating instance_info_cache with network_info: [{"id": "e5820add-1974-4f6c-873e-ef179593b46a", "address": "fa:16:3e:b1:35:89", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5820add-19", "ovs_interfaceid": "e5820add-1974-4f6c-873e-ef179593b46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "address": "fa:16:3e:5a:25:32", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff33d225-ef", "ovs_interfaceid": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0914d88d-1909-4bcb-a776-37af31e16b9e", "address": "fa:16:3e:a0:a3:84", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914d88d-19", "ovs_interfaceid": "0914d88d-1909-4bcb-a776-37af31e16b9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e32a9d4d-57df-4765-b5be-12cea8621fce", "address": "fa:16:3e:10:c4:37", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32a9d4d-57", "ovs_interfaceid": "e32a9d4d-57df-4765-b5be-12cea8621fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "783f5103-a178-42e0-a3b0-f523ca4c9439", "address": "fa:16:3e:4d:78:05", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap783f5103-a1", "ovs_interfaceid": "783f5103-a178-42e0-a3b0-f523ca4c9439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:41:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-7c25a3a0-d92a-4eed-b933-3337331e8e42 req-8f20ed11-04de-4557-9b79-dab6e0dbe4f7 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Detach interface failed, port_id=e481124c-b62d-4fc9-9f02-ba38c027180e, reason: Instance 32d3fdfc-82ad-46ee-b673-4e73f43b85e7 could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:41:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-7c25a3a0-d92a-4eed-b933-3337331e8e42 req-8f20ed11-04de-4557-9b79-dab6e0dbe4f7 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-deleted-0914d88d-1909-4bcb-a776-37af31e16b9e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:20 user nova-compute[73258]: INFO nova.compute.manager [req-7c25a3a0-d92a-4eed-b933-3337331e8e42 req-8f20ed11-04de-4557-9b79-dab6e0dbe4f7 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Neutron deleted interface 0914d88d-1909-4bcb-a776-37af31e16b9e; detaching it from the instance and deleting it from the info cache
Aug 27 06:41:20 user nova-compute[73258]: DEBUG nova.network.neutron [req-7c25a3a0-d92a-4eed-b933-3337331e8e42 req-8f20ed11-04de-4557-9b79-dab6e0dbe4f7 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updating instance_info_cache with network_info: [{"id": "e5820add-1974-4f6c-873e-ef179593b46a", "address": "fa:16:3e:b1:35:89", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5820add-19", "ovs_interfaceid": "e5820add-1974-4f6c-873e-ef179593b46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "address": "fa:16:3e:5a:25:32", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff33d225-ef", "ovs_interfaceid": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e32a9d4d-57df-4765-b5be-12cea8621fce", "address": "fa:16:3e:10:c4:37", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32a9d4d-57", "ovs_interfaceid": "e32a9d4d-57df-4765-b5be-12cea8621fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "783f5103-a178-42e0-a3b0-f523ca4c9439", "address": "fa:16:3e:4d:78:05", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap783f5103-a1", "ovs_interfaceid": "783f5103-a178-42e0-a3b0-f523ca4c9439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:41:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-7c25a3a0-d92a-4eed-b933-3337331e8e42 req-8f20ed11-04de-4557-9b79-dab6e0dbe4f7 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Detach interface failed, port_id=0914d88d-1909-4bcb-a776-37af31e16b9e, reason: Instance 32d3fdfc-82ad-46ee-b673-4e73f43b85e7 could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:41:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-7c25a3a0-d92a-4eed-b933-3337331e8e42 req-8f20ed11-04de-4557-9b79-dab6e0dbe4f7 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-deleted-783f5103-a178-42e0-a3b0-f523ca4c9439 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:20 user nova-compute[73258]: INFO nova.compute.manager [req-7c25a3a0-d92a-4eed-b933-3337331e8e42 req-8f20ed11-04de-4557-9b79-dab6e0dbe4f7 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Neutron deleted interface 783f5103-a178-42e0-a3b0-f523ca4c9439; detaching it from the instance and deleting it from the info cache
Aug 27 06:41:20 user nova-compute[73258]: DEBUG nova.network.neutron [req-7c25a3a0-d92a-4eed-b933-3337331e8e42 req-8f20ed11-04de-4557-9b79-dab6e0dbe4f7 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updating instance_info_cache with network_info: [{"id": "e5820add-1974-4f6c-873e-ef179593b46a", "address": "fa:16:3e:b1:35:89", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5820add-19", "ovs_interfaceid": "e5820add-1974-4f6c-873e-ef179593b46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "address": "fa:16:3e:5a:25:32", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff33d225-ef", "ovs_interfaceid": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e32a9d4d-57df-4765-b5be-12cea8621fce", "address": "fa:16:3e:10:c4:37", "network": {"id": "d1088fa3-bbf4-4136-b3bd-3014c8cd4254", "bridge": "br-int", "label": "tempest-device-tagging-net2-1552381766", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32a9d4d-57", "ovs_interfaceid": "e32a9d4d-57df-4765-b5be-12cea8621fce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:41:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-7c25a3a0-d92a-4eed-b933-3337331e8e42 req-8f20ed11-04de-4557-9b79-dab6e0dbe4f7 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Detach interface failed, port_id=783f5103-a178-42e0-a3b0-f523ca4c9439, reason: Instance 32d3fdfc-82ad-46ee-b673-4e73f43b85e7 could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:41:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-7c25a3a0-d92a-4eed-b933-3337331e8e42 req-8f20ed11-04de-4557-9b79-dab6e0dbe4f7 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Received event network-vif-deleted-e32a9d4d-57df-4765-b5be-12cea8621fce {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:20 user nova-compute[73258]: INFO nova.compute.manager [req-7c25a3a0-d92a-4eed-b933-3337331e8e42 req-8f20ed11-04de-4557-9b79-dab6e0dbe4f7 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Neutron deleted interface e32a9d4d-57df-4765-b5be-12cea8621fce; detaching it from the instance and deleting it from the info cache
Aug 27 06:41:20 user nova-compute[73258]: DEBUG nova.network.neutron [req-7c25a3a0-d92a-4eed-b933-3337331e8e42 req-8f20ed11-04de-4557-9b79-dab6e0dbe4f7 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Updating instance_info_cache with network_info: [{"id": "e5820add-1974-4f6c-873e-ef179593b46a", "address": "fa:16:3e:b1:35:89", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5820add-19", "ovs_interfaceid": "e5820add-1974-4f6c-873e-ef179593b46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "address": "fa:16:3e:5a:25:32", "network": {"id": "96d68c6b-6b1b-422f-bc26-cd69e5dcebd4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1720458077", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "80e3e1c0feb243a7aeb858041065ffba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff33d225-ef", "ovs_interfaceid": "ff33d225-ef5e-4565-9278-4763c5b7ff6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:41:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-7c25a3a0-d92a-4eed-b933-3337331e8e42 req-8f20ed11-04de-4557-9b79-dab6e0dbe4f7 service nova] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Detach interface failed, port_id=e32a9d4d-57df-4765-b5be-12cea8621fce, reason: Instance 32d3fdfc-82ad-46ee-b673-4e73f43b85e7 could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:41:20 user nova-compute[73258]: INFO nova.compute.manager [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] [instance: d7b11762-9244-481b-87dd-757782d68101] Took 3.53 seconds to detach 3 volumes for instance.
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 -F raw /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk" returned: 0 in 2.631s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Ensure instance console log exists: /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Start _get_guest_xml network_info=[{"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='a443a956189254a0a85e20b2a361815b',container_format='bare',created_at=2023-08-27T06:39:02Z,direct_url=<?>,disk_format='qcow2',id=82376e8d-053f-4d6a-84f9-8200143c7462,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1601086860-shelved',owner='235a4f958e494352aaa119a4d44a52c5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T06:39:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLFKbvjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '32ca4a64-5e49-4bbb-bf96-d3f8cf39146e', 'attached_at': '', 'detached_at': '', 'volume_id': '46a83178-b67e-4624-896c-79871e2c4b15', 'serial': '46a83178-b67e-4624-896c-79871e2c4b15'}, 'attachment_id': 'c68ac0ba-d34b-4274-9485-ee05e7a001e2', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:41:21 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:41:21 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a443a956189254a0a85e20b2a361815b',container_format='bare',created_at=2023-08-27T06:39:02Z,direct_url=<?>,disk_format='qcow2',id=82376e8d-053f-4d6a-84f9-8200143c7462,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1601086860-shelved',owner='235a4f958e494352aaa119a4d44a52c5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T06:39:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'vcpu_model' on Instance uuid 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.objects.base [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Object Instance<32ca4a64-5e49-4bbb-bf96-d3f8cf39146e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLFKbvjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:41:21 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:41:21 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:41:21 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260" returned: 21 in 0.074s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f630e85-6604-455b-9565-dbd6244a5d43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:41:21 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7575b7-9793-4c17-b0dc-0f7d9e5d7279]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15] added
Aug 27 06:41:21 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf1bd5c-91cb-4079-a91c-7a39066513e8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[646b2a89-ec10-4c60-874c-d8385a2c2b58]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uLFKbvjf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uLFKbvjf" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[88347850-6956-425e-bb41-c45fed2585b0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uLFKbvjf'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4175ab7-5832-4d75-9b82-a70f94c2d0fc]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec61adb-eec1-4b4a-a04a-42a7e06ff7ef]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:21 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:21 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:21 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:21 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:21 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:21 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6cabfc-e213-42f2-beb7-080a68f4ca40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15, portal: 172.16.0.220,3260]
Aug 27 06:41:21 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15, portal: 172.16.0.220,3260] successful.
Aug 27 06:41:21 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa1b417-6352-47dc-b2ae-1611151246f5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6828ed0a-10d3-4763-a854-ca5c13579957]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:21 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:21 user nova-compute[73258]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 (non-flash)
Aug 27 06:41:21 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:21 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:21 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:21 user nova-compute[73258]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 (non-flash)
Aug 27 06:41:21 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:21 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.541s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a842abca-8f63-4495-b3f2-4b6210cfdde6]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLFKbvjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:41:21 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Deleted allocations for instance d7b11762-9244-481b-87dd-757782d68101
Aug 27 06:41:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-28bfc1d7-adf3-4560-afa4-0f85741ddad7 tempest-TaggedBootDevicesTest_v242-1736258197 tempest-TaggedBootDevicesTest_v242-1736258197-project-member] Lock "d7b11762-9244-481b-87dd-757782d68101" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.186s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118466.960868, 3ad98f0c-e26f-4913-bf49-755cd63ece60 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:41:21 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] VM Stopped (Lifecycle Event)
Aug 27 06:41:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-59a9dda7-f183-477e-bc64-9ba6b64e536e None None] [instance: 3ad98f0c-e26f-4913-bf49-755cd63ece60] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] <== connect_volume: return (1459ms) {'type': 'block', 'scsi_wwn': '23962373034376331', 'path': '/dev/sdc'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962373034376331', 'path': '/dev/sdc'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T06:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1601086860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1601086860',id=4,image_ref='82376e8d-053f-4d6a-84f9-8200143c7462',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1616777814',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:37:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='235a4f958e494352aaa119a4d44a52c5',ramdisk_id='',reservation_id='r-v9phxkt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1261077306',owner_user_name='tempest-AttachVolumeShelveTestJSON-1261077306-project-member',shelved_at='2023-08-27T06:39:07.258029',shelved_host='user',shelved_image_id='82376e8d-053f-4d6a-84f9-8200143c7462'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:40:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff1f51bb7163499c94ebbc93a051b4df',uuid=32ca4a64-5e49-4bbb-bf96-d3f8cf39146e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converting VIF {"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9f:3e,bridge_name='br-int',has_traffic_filtering=True,id=a345de09-b566-4d5c-8df6-5e706f31bc62,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa345de09-b5') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'pci_devices' on Instance uuid 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG nova.objects.base [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Object Instance<32ca4a64-5e49-4bbb-bf96-d3f8cf39146e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:41:22 user nova-compute[73258]:   <uuid>32ca4a64-5e49-4bbb-bf96-d3f8cf39146e</uuid>
Aug 27 06:41:22 user nova-compute[73258]:   <name>instance-00000004</name>
Aug 27 06:41:22 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:41:22 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:41:22 user nova-compute[73258]:   <metadata>
Aug 27 06:41:22 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:41:22 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:41:22 user nova-compute[73258]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1601086860</nova:name>
Aug 27 06:41:22 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:41:21</nova:creationTime>
Aug 27 06:41:22 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:41:22 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:41:22 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:41:22 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:41:22 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:41:22 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:41:22 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:41:22 user nova-compute[73258]:       <nova:owner>
Aug 27 06:41:22 user nova-compute[73258]:         <nova:user uuid="ff1f51bb7163499c94ebbc93a051b4df">tempest-AttachVolumeShelveTestJSON-1261077306-project-member</nova:user>
Aug 27 06:41:22 user nova-compute[73258]:         <nova:project uuid="235a4f958e494352aaa119a4d44a52c5">tempest-AttachVolumeShelveTestJSON-1261077306</nova:project>
Aug 27 06:41:22 user nova-compute[73258]:       </nova:owner>
Aug 27 06:41:22 user nova-compute[73258]:       <nova:root type="image" uuid="82376e8d-053f-4d6a-84f9-8200143c7462"/>
Aug 27 06:41:22 user nova-compute[73258]:       <nova:ports>
Aug 27 06:41:22 user nova-compute[73258]:         <nova:port uuid="a345de09-b566-4d5c-8df6-5e706f31bc62">
Aug 27 06:41:22 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 06:41:22 user nova-compute[73258]:         </nova:port>
Aug 27 06:41:22 user nova-compute[73258]:       </nova:ports>
Aug 27 06:41:22 user nova-compute[73258]:     </nova:instance>
Aug 27 06:41:22 user nova-compute[73258]:   </metadata>
Aug 27 06:41:22 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:41:22 user nova-compute[73258]:     <system>
Aug 27 06:41:22 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:41:22 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:41:22 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:41:22 user nova-compute[73258]:       <entry name="serial">32ca4a64-5e49-4bbb-bf96-d3f8cf39146e</entry>
Aug 27 06:41:22 user nova-compute[73258]:       <entry name="uuid">32ca4a64-5e49-4bbb-bf96-d3f8cf39146e</entry>
Aug 27 06:41:22 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:41:22 user nova-compute[73258]:     </system>
Aug 27 06:41:22 user nova-compute[73258]:   </sysinfo>
Aug 27 06:41:22 user nova-compute[73258]:   <os>
Aug 27 06:41:22 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:41:22 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:41:22 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:41:22 user nova-compute[73258]:   </os>
Aug 27 06:41:22 user nova-compute[73258]:   <features>
Aug 27 06:41:22 user nova-compute[73258]:     <acpi/>
Aug 27 06:41:22 user nova-compute[73258]:     <apic/>
Aug 27 06:41:22 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:41:22 user nova-compute[73258]:   </features>
Aug 27 06:41:22 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:41:22 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:41:22 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:41:22 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:41:22 user nova-compute[73258]:   </clock>
Aug 27 06:41:22 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:41:22 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:41:22 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:41:22 user nova-compute[73258]:   </cpu>
Aug 27 06:41:22 user nova-compute[73258]:   <devices>
Aug 27 06:41:22 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:41:22 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:41:22 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk"/>
Aug 27 06:41:22 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:41:22 user nova-compute[73258]:     </disk>
Aug 27 06:41:22 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:41:22 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:41:22 user nova-compute[73258]:       <source dev="/dev/sdc"/>
Aug 27 06:41:22 user nova-compute[73258]:       <target dev="vdc" bus="virtio"/>
Aug 27 06:41:22 user nova-compute[73258]:       <serial>46a83178-b67e-4624-896c-79871e2c4b15</serial>
Aug 27 06:41:22 user nova-compute[73258]:     </disk>
Aug 27 06:41:22 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:41:22 user nova-compute[73258]:       <mac address="fa:16:3e:e0:9f:3e"/>
Aug 27 06:41:22 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:41:22 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:41:22 user nova-compute[73258]:       <target dev="tapa345de09-b5"/>
Aug 27 06:41:22 user nova-compute[73258]:     </interface>
Aug 27 06:41:22 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:41:22 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/console.log" append="off"/>
Aug 27 06:41:22 user nova-compute[73258]:     </serial>
Aug 27 06:41:22 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:41:22 user nova-compute[73258]:     <video>
Aug 27 06:41:22 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:41:22 user nova-compute[73258]:     </video>
Aug 27 06:41:22 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:41:22 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:41:22 user nova-compute[73258]:     </rng>
Aug 27 06:41:22 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:41:22 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:41:22 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:41:22 user nova-compute[73258]:     </memballoon>
Aug 27 06:41:22 user nova-compute[73258]:   </devices>
Aug 27 06:41:22 user nova-compute[73258]: </domain>
Aug 27 06:41:22 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T06:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1601086860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1601086860',id=4,image_ref='82376e8d-053f-4d6a-84f9-8200143c7462',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1616777814',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:37:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='235a4f958e494352aaa119a4d44a52c5',ramdisk_id='',reservation_id='r-v9phxkt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1261077306',owner_user_name='tempest-AttachVolumeShelveTestJSON-1261077306-project-member',shelved_at='2023-08-27T06:39:07.258029',shelved_host='user',shelved_image_id='82376e8d-053f-4d6a-84f9-8200143c7462'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:40:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff1f51bb7163499c94ebbc93a051b4df',uuid=32ca4a64-5e49-4bbb-bf96-d3f8cf39146e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converting VIF {"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9f:3e,bridge_name='br-int',has_traffic_filtering=True,id=a345de09-b566-4d5c-8df6-5e706f31bc62,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa345de09-b5') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG os_vif [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9f:3e,bridge_name='br-int',has_traffic_filtering=True,id=a345de09-b566-4d5c-8df6-5e706f31bc62,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa345de09-b5') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa345de09-b5, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa345de09-b5, col_values=(('external_ids', {'iface-id': 'a345de09-b566-4d5c-8df6-5e706f31bc62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:9f:3e', 'vm-uuid': '32ca4a64-5e49-4bbb-bf96-d3f8cf39146e'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:22 user nova-compute[73258]: INFO os_vif [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9f:3e,bridge_name='br-int',has_traffic_filtering=True,id=a345de09-b566-4d5c-8df6-5e706f31bc62,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa345de09-b5')
Aug 27 06:41:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:41:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] No VIF found with MAC fa:16:3e:e0:9f:3e, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:41:23 user nova-compute[73258]: INFO nova.compute.manager [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Took 2.65 seconds to detach 3 volumes for instance.
Aug 27 06:41:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:23 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118468.6992772, d7b11762-9244-481b-87dd-757782d68101 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:41:23 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: d7b11762-9244-481b-87dd-757782d68101] VM Stopped (Lifecycle Event)
Aug 27 06:41:23 user nova-compute[73258]: DEBUG nova.compute.manager [None req-b2e8c6a5-97b3-4444-a96a-8988f1154275 None None] [instance: d7b11762-9244-481b-87dd-757782d68101] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:41:23 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:41:23 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:41:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:23 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Deleted allocations for instance 32d3fdfc-82ad-46ee-b673-4e73f43b85e7
Aug 27 06:41:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d443366f-e714-431e-9579-f9594b830516 tempest-TaggedBootDevicesTest-913935157 tempest-TaggedBootDevicesTest-913935157-project-member] Lock "32d3fdfc-82ad-46ee-b673-4e73f43b85e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.930s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-be00753c-e9bd-41d8-b1a7-31f133041785 req-12efa4e8-f996-4441-9943-8abc63aad156 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received event network-vif-plugged-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-be00753c-e9bd-41d8-b1a7-31f133041785 req-12efa4e8-f996-4441-9943-8abc63aad156 service nova] Acquiring lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-be00753c-e9bd-41d8-b1a7-31f133041785 req-12efa4e8-f996-4441-9943-8abc63aad156 service nova] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-be00753c-e9bd-41d8-b1a7-31f133041785 req-12efa4e8-f996-4441-9943-8abc63aad156 service nova] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-be00753c-e9bd-41d8-b1a7-31f133041785 req-12efa4e8-f996-4441-9943-8abc63aad156 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] No waiting events found dispatching network-vif-plugged-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:24 user nova-compute[73258]: WARNING nova.compute.manager [req-be00753c-e9bd-41d8-b1a7-31f133041785 req-12efa4e8-f996-4441-9943-8abc63aad156 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received unexpected event network-vif-plugged-a345de09-b566-4d5c-8df6-5e706f31bc62 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 06:41:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:26 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118486.5257957, 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:41:26 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] VM Resumed (Lifecycle Event)
Aug 27 06:41:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:41:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:41:26 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Instance spawned successfully.
Aug 27 06:41:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:41:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:41:26 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:41:26 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118486.526894, 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:41:26 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] VM Started (Lifecycle Event)
Aug 27 06:41:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:41:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-0facb3bf-040b-4350-a289-3289f59a40c5 req-20260906-8a42-49e8-821b-ef262deabdf8 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received event network-vif-plugged-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0facb3bf-040b-4350-a289-3289f59a40c5 req-20260906-8a42-49e8-821b-ef262deabdf8 service nova] Acquiring lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0facb3bf-040b-4350-a289-3289f59a40c5 req-20260906-8a42-49e8-821b-ef262deabdf8 service nova] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0facb3bf-040b-4350-a289-3289f59a40c5 req-20260906-8a42-49e8-821b-ef262deabdf8 service nova] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-0facb3bf-040b-4350-a289-3289f59a40c5 req-20260906-8a42-49e8-821b-ef262deabdf8 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] No waiting events found dispatching network-vif-plugged-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:26 user nova-compute[73258]: WARNING nova.compute.manager [req-0facb3bf-040b-4350-a289-3289f59a40c5 req-20260906-8a42-49e8-821b-ef262deabdf8 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received unexpected event network-vif-plugged-a345de09-b566-4d5c-8df6-5e706f31bc62 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 06:41:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:41:26 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:41:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:41:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a89625fe-fd98-4479-bbf9-128b5e6e111a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 31.980s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:27 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118472.2507925, 32d3fdfc-82ad-46ee-b673-4e73f43b85e7 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:41:27 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] VM Stopped (Lifecycle Event)
Aug 27 06:41:27 user nova-compute[73258]: DEBUG nova.compute.manager [None req-ffa03b56-bbd5-46df-9e8f-64b71b8289c9 None None] [instance: 32d3fdfc-82ad-46ee-b673-4e73f43b85e7] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:41:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Acquiring lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Acquiring lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:36 user nova-compute[73258]: INFO nova.compute.manager [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Terminating instance
Aug 27 06:41:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:41:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG nova.compute.manager [req-b9cdaf8f-b000-4471-a741-0bab1292abe6 req-4d4e7e40-c829-4eff-907a-b3fd4c9ea40c service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received event network-vif-unplugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b9cdaf8f-b000-4471-a741-0bab1292abe6 req-4d4e7e40-c829-4eff-907a-b3fd4c9ea40c service nova] Acquiring lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b9cdaf8f-b000-4471-a741-0bab1292abe6 req-4d4e7e40-c829-4eff-907a-b3fd4c9ea40c service nova] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b9cdaf8f-b000-4471-a741-0bab1292abe6 req-4d4e7e40-c829-4eff-907a-b3fd4c9ea40c service nova] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG nova.compute.manager [req-b9cdaf8f-b000-4471-a741-0bab1292abe6 req-4d4e7e40-c829-4eff-907a-b3fd4c9ea40c service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] No waiting events found dispatching network-vif-unplugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG nova.compute.manager [req-b9cdaf8f-b000-4471-a741-0bab1292abe6 req-4d4e7e40-c829-4eff-907a-b3fd4c9ea40c service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received event network-vif-unplugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:37 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Instance destroyed successfully.
Aug 27 06:41:37 user nova-compute[73258]: DEBUG nova.objects.instance [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lazy-loading 'resources' on Instance uuid b1b1b0cd-cd43-459f-aaaa-73ae805f9984 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T06:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2113859215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-365915423',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXC+TqgbsZa3q6c5XtC1rMSZD6ezy7FUZNfIQqoaxgbog95i8n8Q42gJYkXEfdMM0sUAvXFMvuFpDd9ZOnMo/2eGVlV1fH/AwaBhBltragdNT3zavkJFQGky/A1N5DJmA==',key_name='tempest-keypair-1590337091',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:40:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ff4b3482c19440abf8930632fdedf2a',ramdisk_id='',reservation_id='r-i6gcfele',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-611468989',owner_user_name='tempest-ServerActionsV293TestJSON-611468989-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:40:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba84ad5267474566aaad7bfbef1eb327',uuid=b1b1b0cd-cd43-459f-aaaa-73ae805f9984,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "address": "fa:16:3e:3b:e8:5d", "network": {"id": "99da6780-8423-4561-85a7-9cddac555ead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1622528656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff4b3482c19440abf8930632fdedf2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cdcd84-44", "ovs_interfaceid": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Converting VIF {"id": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "address": "fa:16:3e:3b:e8:5d", "network": {"id": "99da6780-8423-4561-85a7-9cddac555ead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1622528656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff4b3482c19440abf8930632fdedf2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cdcd84-44", "ovs_interfaceid": "d1cdcd84-44c1-4385-8671-6481d8a17e57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e8:5d,bridge_name='br-int',has_traffic_filtering=True,id=d1cdcd84-44c1-4385-8671-6481d8a17e57,network=Network(99da6780-8423-4561-85a7-9cddac555ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cdcd84-44') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG os_vif [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e8:5d,bridge_name='br-int',has_traffic_filtering=True,id=d1cdcd84-44c1-4385-8671-6481d8a17e57,network=Network(99da6780-8423-4561-85a7-9cddac555ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cdcd84-44') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1cdcd84-44, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:37 user nova-compute[73258]: INFO os_vif [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e8:5d,bridge_name='br-int',has_traffic_filtering=True,id=d1cdcd84-44c1-4385-8671-6481d8a17e57,network=Network(99da6780-8423-4561-85a7-9cddac555ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cdcd84-44')
Aug 27 06:41:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLanNYcx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:41:37 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:41:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[637cc7bd-3913-4dde-b952-0817e5b2cc2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3624f2-1d7e-48e2-aafc-bd06d1ab51cc]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:37 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:37 user nova-compute[73258]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 (non-flash)
Aug 27 06:41:37 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:37 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f (non-flash)
Aug 27 06:41:37 user nova-compute[73258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:37 user nova-compute[73258]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 (non-flash)
Aug 27 06:41:37 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:37 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa410717b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df21eec-48fa-42fd-bb90-f06e3b9aa03b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb80d4fb-23be-432f-b7d8-c44377a38fc9]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea0179b-391d-48fa-beb7-51db5c606fab]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[696a0138-cd03-435e-8828-6a8a19de414a]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5a0bfa77', '/dev/disk/by-id/scsi-1SCST_BIO5a0bfa77-f7dedc92a0ee4735', '/dev/disk/by-id/scsi-26637646564633932') {{(pid=84389) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f52589-1615-4b9a-91f7-9015625b838b]: (4, None) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[85540cde-2dfe-430c-b9e9-a401dbc8b2de]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fefe41-3203-4299-acd6-436c007dfaa8]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f, portal: 172.16.0.220,3260]
Aug 27 06:41:38 user nova-compute[73258]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f, portal: 172.16.0.220,3260] successful.
Aug 27 06:41:38 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09b45154-77cc-47a2-8ced-c072a9acc75f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c81bfd-9792-4c3f-8fce-111515c9d53e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:41:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] <== disconnect_volume: return (348ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:41:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:41:38 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Deleting instance files /opt/stack/data/nova/instances/b1b1b0cd-cd43-459f-aaaa-73ae805f9984_del
Aug 27 06:41:38 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Deletion of /opt/stack/data/nova/instances/b1b1b0cd-cd43-459f-aaaa-73ae805f9984_del complete
Aug 27 06:41:38 user nova-compute[73258]: INFO nova.compute.manager [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 27 06:41:38 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:41:38 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:41:38 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:41:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:39 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:41:39 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Took 0.88 seconds to deallocate network for instance.
Aug 27 06:41:39 user nova-compute[73258]: DEBUG nova.compute.manager [req-ca6a11c2-d299-48ed-99cc-2e126b694b81 req-c6c45bfd-7a30-4b74-9a95-fce8455ac64e service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received event network-vif-deleted-d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:39 user nova-compute[73258]: DEBUG nova.compute.manager [req-f2014077-7daa-4268-81ff-7a1d8b160d18 req-ea17fe8b-d453-4b11-9e1f-e01ee9ed68d1 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received event network-vif-plugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:41:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f2014077-7daa-4268-81ff-7a1d8b160d18 req-ea17fe8b-d453-4b11-9e1f-e01ee9ed68d1 service nova] Acquiring lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f2014077-7daa-4268-81ff-7a1d8b160d18 req-ea17fe8b-d453-4b11-9e1f-e01ee9ed68d1 service nova] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f2014077-7daa-4268-81ff-7a1d8b160d18 req-ea17fe8b-d453-4b11-9e1f-e01ee9ed68d1 service nova] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:39 user nova-compute[73258]: DEBUG nova.compute.manager [req-f2014077-7daa-4268-81ff-7a1d8b160d18 req-ea17fe8b-d453-4b11-9e1f-e01ee9ed68d1 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] No waiting events found dispatching network-vif-plugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:41:39 user nova-compute[73258]: WARNING nova.compute.manager [req-f2014077-7daa-4268-81ff-7a1d8b160d18 req-ea17fe8b-d453-4b11-9e1f-e01ee9ed68d1 service nova] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Received unexpected event network-vif-plugged-d1cdcd84-44c1-4385-8671-6481d8a17e57 for instance with vm_state active and task_state deleting.
Aug 27 06:41:39 user nova-compute[73258]: INFO nova.compute.manager [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Took 0.95 seconds to detach 1 volumes for instance.
Aug 27 06:41:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Deleting volume: 09b45154-77cc-47a2-8ced-c072a9acc75f {{(pid=73258) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 06:41:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:40 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:41:40 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:41:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:40 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Deleted allocations for instance b1b1b0cd-cd43-459f-aaaa-73ae805f9984
Aug 27 06:41:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-706cc991-c51f-42a7-9e9b-0ed8f71c2209 tempest-ServerActionsV293TestJSON-611468989 tempest-ServerActionsV293TestJSON-611468989-project-member] Lock "b1b1b0cd-cd43-459f-aaaa-73ae805f9984" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.694s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:41 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:41:41 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:41:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:41:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 06:41:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:41:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:41:41 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:41:41 user nova-compute[73258]: DEBUG nova.objects.instance [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lazy-loading 'info_cache' on Instance uuid e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:41:42 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Updating instance_info_cache with network_info: [{"id": "22202aee-0bda-40c0-9441-f014a5f99131", "address": "fa:16:3e:4a:cd:08", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22202aee-0b", "ovs_interfaceid": "22202aee-0bda-40c0-9441-f014a5f99131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:41:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:41:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:41:42 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:41:42 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:41:42 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:41:42 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:41:42 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:41:42 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:41:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:41:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:42 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:41:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:42 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:41:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:41:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:41:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:41:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:47 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:41:47 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:41:47 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=7148MB free_disk=24.206859588623047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 33b995be-307d-4491-a1b4-fb75ececea1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1672aa9f-be6f-4357-877f-a48f62119df4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance de8b1f89-9b89-439a-ab73-21e24e299460 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 4a2970a3-2a05-4462-bf0b-1595743222fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:41:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:41:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:52 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118497.6720304, b1b1b0cd-cd43-459f-aaaa-73ae805f9984 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:41:52 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] VM Stopped (Lifecycle Event)
Aug 27 06:41:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8c558479-ef15-4a69-98aa-c5212c5f1cc8 None None] [instance: b1b1b0cd-cd43-459f-aaaa-73ae805f9984] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:41:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:41:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:41:57 user nova-compute[73258]: INFO nova.compute.manager [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Detaching volume ade6b05b-3bdd-4a39-8413-91c6e4394127
Aug 27 06:41:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:58 user nova-compute[73258]: INFO nova.virt.block_device [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Attempting to driver detach volume ade6b05b-3bdd-4a39-8413-91c6e4394127 from mountpoint /dev/vdb
Aug 27 06:41:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Attempting to detach device vdb from instance e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:41:58 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:41:58 user nova-compute[73258]:   <source dev="/dev/sdg"/>
Aug 27 06:41:58 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:41:58 user nova-compute[73258]:   <serial>ade6b05b-3bdd-4a39-8413-91c6e4394127</serial>
Aug 27 06:41:58 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:41:58 user nova-compute[73258]: </disk>
Aug 27 06:41:58 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:41:58 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Successfully detached device vdb from instance e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 from the persistent domain config.
Aug 27 06:41:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:41:58 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:41:58 user nova-compute[73258]:   <source dev="/dev/sdg"/>
Aug 27 06:41:58 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:41:58 user nova-compute[73258]:   <serial>ade6b05b-3bdd-4a39-8413-91c6e4394127</serial>
Aug 27 06:41:58 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:41:58 user nova-compute[73258]: </disk>
Aug 27 06:41:58 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693118518.5251517, e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:41:58 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Successfully detached device vdb from instance e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 from the live domain config.
Aug 27 06:41:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCIbhQjv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:41:58 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:41:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cb8ba5-f8c5-49cd-b63b-c0b29cf71ca7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c829e2-9a1d-4224-9e22-c6ad707f4167]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:58 user nova-compute[73258]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 (non-flash)
Aug 27 06:41:58 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:58 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:41:58 user nova-compute[73258]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 (non-flash)
Aug 27 06:41:58 user nova-compute[73258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 (non-flash)
Aug 27 06:41:58 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa44d3d7a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127'): ({'sdg'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Removing single pathed devices sdg {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9164b9be-8e45-4aa7-b4ac-ecfcea4f966c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0df33f8-26c4-4578-9d86-67f9cf5617bb]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Flushing IO for device /dev/sdg {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd564bb-32cb-4a1a-9491-1b4f779c1814]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.059s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4774095-a22f-472c-8a2b-ec6eba410bf6]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] SCSI volumes sdg have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5da43ed-dd91-4c85-a2fb-6ba6e402af47]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bab290-f57b-4f1c-971e-6437cceb339f]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127, portal: 172.16.0.220,3260]
Aug 27 06:41:58 user nova-compute[73258]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127, portal: 172.16.0.220,3260] successful.
Aug 27 06:41:58 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade6b05b-3bdd-4a39-8413-91c6e4394127 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f692ea99-0134-4719-8c6d-7dfb95b37cd4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] <== disconnect_volume: return (341ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:41:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:42:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "a836678e-240d-4ead-b0b5-64d146910a23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "a836678e-240d-4ead-b0b5-64d146910a23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:42:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:42:04 user nova-compute[73258]: INFO nova.compute.claims [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Claim successful on node user
Aug 27 06:42:05 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.584s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:42:05 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:42:05 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:42:05 user nova-compute[73258]: INFO nova.compute.manager [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Rescuing
Aug 27 06:42:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "refresh_cache-9acc81d9-12bc-46d6-8af9-2fc3106de2b2" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquired lock "refresh_cache-9acc81d9-12bc-46d6-8af9-2fc3106de2b2" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG nova.network.neutron [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:42:05 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Creating image(s)
Aug 27 06:42:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "/opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "/opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "/opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.200s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG nova.policy [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36c0faed29a446aa9fa6ff8692581aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cf34590d8d4b8b89b9626c6e150df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.204s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk 1073741824" returned: 0 in 0.055s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.235s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:06 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:42:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:06 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Cannot resize image /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:42:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:42:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Ensure instance console log exists: /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:42:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:07 user nova-compute[73258]: DEBUG nova.network.neutron [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Updating instance_info_cache with network_info: [{"id": "f177246f-1def-438b-8ac0-08f4e9cfed50", "address": "fa:16:3e:76:c0:d7", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf177246f-1d", "ovs_interfaceid": "f177246f-1def-438b-8ac0-08f4e9cfed50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:42:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Releasing lock "refresh_cache-9acc81d9-12bc-46d6-8af9-2fc3106de2b2" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Successfully created port: 0eae0f1e-d6c2-48bd-ad15-dba679a91a9f {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-636beeb7-ce42-4c64-a22c-ea14f6300d6d req-57b2d48c-d3de-4efe-8f13-7305356c7c97 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received event network-vif-unplugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-636beeb7-ce42-4c64-a22c-ea14f6300d6d req-57b2d48c-d3de-4efe-8f13-7305356c7c97 service nova] Acquiring lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-636beeb7-ce42-4c64-a22c-ea14f6300d6d req-57b2d48c-d3de-4efe-8f13-7305356c7c97 service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-636beeb7-ce42-4c64-a22c-ea14f6300d6d req-57b2d48c-d3de-4efe-8f13-7305356c7c97 service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-636beeb7-ce42-4c64-a22c-ea14f6300d6d req-57b2d48c-d3de-4efe-8f13-7305356c7c97 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] No waiting events found dispatching network-vif-unplugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:08 user nova-compute[73258]: WARNING nova.compute.manager [req-636beeb7-ce42-4c64-a22c-ea14f6300d6d req-57b2d48c-d3de-4efe-8f13-7305356c7c97 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received unexpected event network-vif-unplugged-f177246f-1def-438b-8ac0-08f4e9cfed50 for instance with vm_state active and task_state rescuing.
Aug 27 06:42:08 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Instance destroyed successfully.
Aug 27 06:42:08 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Attempting rescue
Aug 27 06:42:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73258) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Instance directory exists: not creating {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 06:42:08 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Creating image(s)
Aug 27 06:42:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "/opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "/opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "/opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG nova.objects.instance [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.214s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue" returned: 0 in 0.047s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG nova.objects.instance [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'migration_context' on Instance uuid 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG nova.objects.base [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Object Instance<9acc81d9-12bc-46d6-8af9-2fc3106de2b2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Start _get_guest_xml network_info=[{"id": "f177246f-1def-438b-8ac0-08f4e9cfed50", "address": "fa:16:3e:76:c0:d7", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "vif_mac": "fa:16:3e:76:c0:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf177246f-1d", "ovs_interfaceid": "f177246f-1def-438b-8ac0-08f4e9cfed50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG nova.objects.instance [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'resources' on Instance uuid 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG nova.objects.base [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Object Instance<9acc81d9-12bc-46d6-8af9-2fc3106de2b2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:42:08 user nova-compute[73258]: DEBUG nova.objects.instance [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'numa_topology' on Instance uuid 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.objects.base [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Object Instance<9acc81d9-12bc-46d6-8af9-2fc3106de2b2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:42:09 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:42:09 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.objects.instance [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.objects.base [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Object Instance<9acc81d9-12bc-46d6-8af9-2fc3106de2b2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:40:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-934566362',display_name='tempest-ServerRescueNegativeTestJSON-server-934566362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-934566362',id=15,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:40:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6efa67b959a473da5a06f9e0aa8795f',ramdisk_id='',reservation_id='r-iad7yyth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1025141277',owner_user_name='tempest-ServerRescueNegativeTestJSON-1025141277-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:40:22Z,user_data=None,user_id='685859ec81944e3398853037c24673a4',uuid=9acc81d9-12bc-46d6-8af9-2fc3106de2b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f177246f-1def-438b-8ac0-08f4e9cfed50", "address": "fa:16:3e:76:c0:d7", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "vif_mac": "fa:16:3e:76:c0:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf177246f-1d", "ovs_interfaceid": "f177246f-1def-438b-8ac0-08f4e9cfed50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converting VIF {"id": "f177246f-1def-438b-8ac0-08f4e9cfed50", "address": "fa:16:3e:76:c0:d7", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "vif_mac": "fa:16:3e:76:c0:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf177246f-1d", "ovs_interfaceid": "f177246f-1def-438b-8ac0-08f4e9cfed50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=f177246f-1def-438b-8ac0-08f4e9cfed50,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf177246f-1d') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.objects.instance [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'pci_devices' on Instance uuid 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.objects.base [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Object Instance<9acc81d9-12bc-46d6-8af9-2fc3106de2b2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:42:09 user nova-compute[73258]:   <uuid>9acc81d9-12bc-46d6-8af9-2fc3106de2b2</uuid>
Aug 27 06:42:09 user nova-compute[73258]:   <name>instance-0000000f</name>
Aug 27 06:42:09 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:42:09 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:42:09 user nova-compute[73258]:   <metadata>
Aug 27 06:42:09 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:42:09 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:42:09 user nova-compute[73258]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-934566362</nova:name>
Aug 27 06:42:09 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:42:09</nova:creationTime>
Aug 27 06:42:09 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:42:09 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:42:09 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:42:09 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:42:09 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:42:09 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:42:09 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:42:09 user nova-compute[73258]:       <nova:owner>
Aug 27 06:42:09 user nova-compute[73258]:         <nova:user uuid="685859ec81944e3398853037c24673a4">tempest-ServerRescueNegativeTestJSON-1025141277-project-member</nova:user>
Aug 27 06:42:09 user nova-compute[73258]:         <nova:project uuid="f6efa67b959a473da5a06f9e0aa8795f">tempest-ServerRescueNegativeTestJSON-1025141277</nova:project>
Aug 27 06:42:09 user nova-compute[73258]:       </nova:owner>
Aug 27 06:42:09 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:42:09 user nova-compute[73258]:       <nova:ports>
Aug 27 06:42:09 user nova-compute[73258]:         <nova:port uuid="f177246f-1def-438b-8ac0-08f4e9cfed50">
Aug 27 06:42:09 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 06:42:09 user nova-compute[73258]:         </nova:port>
Aug 27 06:42:09 user nova-compute[73258]:       </nova:ports>
Aug 27 06:42:09 user nova-compute[73258]:     </nova:instance>
Aug 27 06:42:09 user nova-compute[73258]:   </metadata>
Aug 27 06:42:09 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:42:09 user nova-compute[73258]:     <system>
Aug 27 06:42:09 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:42:09 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:42:09 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:42:09 user nova-compute[73258]:       <entry name="serial">9acc81d9-12bc-46d6-8af9-2fc3106de2b2</entry>
Aug 27 06:42:09 user nova-compute[73258]:       <entry name="uuid">9acc81d9-12bc-46d6-8af9-2fc3106de2b2</entry>
Aug 27 06:42:09 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:42:09 user nova-compute[73258]:     </system>
Aug 27 06:42:09 user nova-compute[73258]:   </sysinfo>
Aug 27 06:42:09 user nova-compute[73258]:   <os>
Aug 27 06:42:09 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:42:09 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:42:09 user nova-compute[73258]:   </os>
Aug 27 06:42:09 user nova-compute[73258]:   <features>
Aug 27 06:42:09 user nova-compute[73258]:     <acpi/>
Aug 27 06:42:09 user nova-compute[73258]:     <apic/>
Aug 27 06:42:09 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:42:09 user nova-compute[73258]:   </features>
Aug 27 06:42:09 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:42:09 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:42:09 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:42:09 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:42:09 user nova-compute[73258]:   </clock>
Aug 27 06:42:09 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:42:09 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:42:09 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:42:09 user nova-compute[73258]:   </cpu>
Aug 27 06:42:09 user nova-compute[73258]:   <devices>
Aug 27 06:42:09 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:42:09 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:42:09 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue"/>
Aug 27 06:42:09 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:42:09 user nova-compute[73258]:     </disk>
Aug 27 06:42:09 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:42:09 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:42:09 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk"/>
Aug 27 06:42:09 user nova-compute[73258]:       <target dev="vdb" bus="virtio"/>
Aug 27 06:42:09 user nova-compute[73258]:     </disk>
Aug 27 06:42:09 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:42:09 user nova-compute[73258]:       <mac address="fa:16:3e:76:c0:d7"/>
Aug 27 06:42:09 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:42:09 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:42:09 user nova-compute[73258]:       <target dev="tapf177246f-1d"/>
Aug 27 06:42:09 user nova-compute[73258]:     </interface>
Aug 27 06:42:09 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:42:09 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/console.log" append="off"/>
Aug 27 06:42:09 user nova-compute[73258]:     </serial>
Aug 27 06:42:09 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:42:09 user nova-compute[73258]:     <video>
Aug 27 06:42:09 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:42:09 user nova-compute[73258]:     </video>
Aug 27 06:42:09 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:42:09 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:42:09 user nova-compute[73258]:     </rng>
Aug 27 06:42:09 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:42:09 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:42:09 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:42:09 user nova-compute[73258]:     </memballoon>
Aug 27 06:42:09 user nova-compute[73258]:   </devices>
Aug 27 06:42:09 user nova-compute[73258]: </domain>
Aug 27 06:42:09 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:42:09 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Instance destroyed successfully.
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:42:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] No VIF found with MAC fa:16:3e:76:c0:d7, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:42:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:10 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Successfully updated port: 0eae0f1e-d6c2-48bd-ad15-dba679a91a9f {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:42:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "refresh_cache-a836678e-240d-4ead-b0b5-64d146910a23" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:42:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquired lock "refresh_cache-a836678e-240d-4ead-b0b5-64d146910a23" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:42:10 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:42:10 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:42:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-eb47080a-1f15-41d8-8efc-f2f1259b9575 req-0e35eaa7-7642-4461-8af4-72d0b828f8b7 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received event network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-eb47080a-1f15-41d8-8efc-f2f1259b9575 req-0e35eaa7-7642-4461-8af4-72d0b828f8b7 service nova] Acquiring lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-eb47080a-1f15-41d8-8efc-f2f1259b9575 req-0e35eaa7-7642-4461-8af4-72d0b828f8b7 service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-eb47080a-1f15-41d8-8efc-f2f1259b9575 req-0e35eaa7-7642-4461-8af4-72d0b828f8b7 service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-eb47080a-1f15-41d8-8efc-f2f1259b9575 req-0e35eaa7-7642-4461-8af4-72d0b828f8b7 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] No waiting events found dispatching network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:10 user nova-compute[73258]: WARNING nova.compute.manager [req-eb47080a-1f15-41d8-8efc-f2f1259b9575 req-0e35eaa7-7642-4461-8af4-72d0b828f8b7 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received unexpected event network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 for instance with vm_state active and task_state rescuing.
Aug 27 06:42:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-eb47080a-1f15-41d8-8efc-f2f1259b9575 req-0e35eaa7-7642-4461-8af4-72d0b828f8b7 service nova] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Received event network-changed-0eae0f1e-d6c2-48bd-ad15-dba679a91a9f {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-eb47080a-1f15-41d8-8efc-f2f1259b9575 req-0e35eaa7-7642-4461-8af4-72d0b828f8b7 service nova] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Refreshing instance network info cache due to event network-changed-0eae0f1e-d6c2-48bd-ad15-dba679a91a9f. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:42:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-eb47080a-1f15-41d8-8efc-f2f1259b9575 req-0e35eaa7-7642-4461-8af4-72d0b828f8b7 service nova] Acquiring lock "refresh_cache-a836678e-240d-4ead-b0b5-64d146910a23" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:42:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Updating instance_info_cache with network_info: [{"id": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "address": "fa:16:3e:00:0b:2b", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eae0f1e-d6", "ovs_interfaceid": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Releasing lock "refresh_cache-a836678e-240d-4ead-b0b5-64d146910a23" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Instance network_info: |[{"id": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "address": "fa:16:3e:00:0b:2b", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eae0f1e-d6", "ovs_interfaceid": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-eb47080a-1f15-41d8-8efc-f2f1259b9575 req-0e35eaa7-7642-4461-8af4-72d0b828f8b7 service nova] Acquired lock "refresh_cache-a836678e-240d-4ead-b0b5-64d146910a23" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.network.neutron [req-eb47080a-1f15-41d8-8efc-f2f1259b9575 req-0e35eaa7-7642-4461-8af4-72d0b828f8b7 service nova] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Refreshing network info cache for port 0eae0f1e-d6c2-48bd-ad15-dba679a91a9f {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Start _get_guest_xml network_info=[{"id": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "address": "fa:16:3e:00:0b:2b", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eae0f1e-d6", "ovs_interfaceid": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:42:11 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:42:11 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:42:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-858882651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-858882651',id=18,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81cf34590d8d4b8b89b9626c6e150df6',ramdisk_id='',reservation_id='r-cksx805o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:42:05Z,user_data=None,user_id='36c0faed29a446aa9fa6ff8692581aba',uuid=a836678e-240d-4ead-b0b5-64d146910a23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "address": "fa:16:3e:00:0b:2b", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eae0f1e-d6", "ovs_interfaceid": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converting VIF {"id": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "address": "fa:16:3e:00:0b:2b", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eae0f1e-d6", "ovs_interfaceid": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:0b:2b,bridge_name='br-int',has_traffic_filtering=True,id=0eae0f1e-d6c2-48bd-ad15-dba679a91a9f,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eae0f1e-d6') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'pci_devices' on Instance uuid a836678e-240d-4ead-b0b5-64d146910a23 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:42:11 user nova-compute[73258]:   <uuid>a836678e-240d-4ead-b0b5-64d146910a23</uuid>
Aug 27 06:42:11 user nova-compute[73258]:   <name>instance-00000012</name>
Aug 27 06:42:11 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:42:11 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:42:11 user nova-compute[73258]:   <metadata>
Aug 27 06:42:11 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:42:11 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:42:11 user nova-compute[73258]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-858882651</nova:name>
Aug 27 06:42:11 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:42:11</nova:creationTime>
Aug 27 06:42:11 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:42:11 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:42:11 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:42:11 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:42:11 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:42:11 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:42:11 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:42:11 user nova-compute[73258]:       <nova:owner>
Aug 27 06:42:11 user nova-compute[73258]:         <nova:user uuid="36c0faed29a446aa9fa6ff8692581aba">tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member</nova:user>
Aug 27 06:42:11 user nova-compute[73258]:         <nova:project uuid="81cf34590d8d4b8b89b9626c6e150df6">tempest-ServerBootFromVolumeStableRescueTest-1306655557</nova:project>
Aug 27 06:42:11 user nova-compute[73258]:       </nova:owner>
Aug 27 06:42:11 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:42:11 user nova-compute[73258]:       <nova:ports>
Aug 27 06:42:11 user nova-compute[73258]:         <nova:port uuid="0eae0f1e-d6c2-48bd-ad15-dba679a91a9f">
Aug 27 06:42:11 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 06:42:11 user nova-compute[73258]:         </nova:port>
Aug 27 06:42:11 user nova-compute[73258]:       </nova:ports>
Aug 27 06:42:11 user nova-compute[73258]:     </nova:instance>
Aug 27 06:42:11 user nova-compute[73258]:   </metadata>
Aug 27 06:42:11 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:42:11 user nova-compute[73258]:     <system>
Aug 27 06:42:11 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:42:11 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:42:11 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:42:11 user nova-compute[73258]:       <entry name="serial">a836678e-240d-4ead-b0b5-64d146910a23</entry>
Aug 27 06:42:11 user nova-compute[73258]:       <entry name="uuid">a836678e-240d-4ead-b0b5-64d146910a23</entry>
Aug 27 06:42:11 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:42:11 user nova-compute[73258]:     </system>
Aug 27 06:42:11 user nova-compute[73258]:   </sysinfo>
Aug 27 06:42:11 user nova-compute[73258]:   <os>
Aug 27 06:42:11 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:42:11 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:42:11 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:42:11 user nova-compute[73258]:   </os>
Aug 27 06:42:11 user nova-compute[73258]:   <features>
Aug 27 06:42:11 user nova-compute[73258]:     <acpi/>
Aug 27 06:42:11 user nova-compute[73258]:     <apic/>
Aug 27 06:42:11 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:42:11 user nova-compute[73258]:   </features>
Aug 27 06:42:11 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:42:11 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:42:11 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:42:11 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:42:11 user nova-compute[73258]:   </clock>
Aug 27 06:42:11 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:42:11 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:42:11 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:42:11 user nova-compute[73258]:   </cpu>
Aug 27 06:42:11 user nova-compute[73258]:   <devices>
Aug 27 06:42:11 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:42:11 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:42:11 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk"/>
Aug 27 06:42:11 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:42:11 user nova-compute[73258]:     </disk>
Aug 27 06:42:11 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:42:11 user nova-compute[73258]:       <mac address="fa:16:3e:00:0b:2b"/>
Aug 27 06:42:11 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:42:11 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:42:11 user nova-compute[73258]:       <target dev="tap0eae0f1e-d6"/>
Aug 27 06:42:11 user nova-compute[73258]:     </interface>
Aug 27 06:42:11 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:42:11 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/console.log" append="off"/>
Aug 27 06:42:11 user nova-compute[73258]:     </serial>
Aug 27 06:42:11 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:42:11 user nova-compute[73258]:     <video>
Aug 27 06:42:11 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:42:11 user nova-compute[73258]:     </video>
Aug 27 06:42:11 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:42:11 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:42:11 user nova-compute[73258]:     </rng>
Aug 27 06:42:11 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:42:11 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:42:11 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:42:11 user nova-compute[73258]:     </memballoon>
Aug 27 06:42:11 user nova-compute[73258]:   </devices>
Aug 27 06:42:11 user nova-compute[73258]: </domain>
Aug 27 06:42:11 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:42:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-858882651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-858882651',id=18,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81cf34590d8d4b8b89b9626c6e150df6',ramdisk_id='',reservation_id='r-cksx805o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:42:05Z,user_data=None,user_id='36c0faed29a446aa9fa6ff8692581aba',uuid=a836678e-240d-4ead-b0b5-64d146910a23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "address": "fa:16:3e:00:0b:2b", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eae0f1e-d6", "ovs_interfaceid": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converting VIF {"id": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "address": "fa:16:3e:00:0b:2b", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eae0f1e-d6", "ovs_interfaceid": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:0b:2b,bridge_name='br-int',has_traffic_filtering=True,id=0eae0f1e-d6c2-48bd-ad15-dba679a91a9f,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eae0f1e-d6') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG os_vif [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:0b:2b,bridge_name='br-int',has_traffic_filtering=True,id=0eae0f1e-d6c2-48bd-ad15-dba679a91a9f,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eae0f1e-d6') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0eae0f1e-d6, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0eae0f1e-d6, col_values=(('external_ids', {'iface-id': '0eae0f1e-d6c2-48bd-ad15-dba679a91a9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:0b:2b', 'vm-uuid': 'a836678e-240d-4ead-b0b5-64d146910a23'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:11 user nova-compute[73258]: INFO os_vif [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:0b:2b,bridge_name='br-int',has_traffic_filtering=True,id=0eae0f1e-d6c2-48bd-ad15-dba679a91a9f,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eae0f1e-d6')
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:42:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] No VIF found with MAC fa:16:3e:00:0b:2b, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:42:12 user nova-compute[73258]: DEBUG nova.network.neutron [req-eb47080a-1f15-41d8-8efc-f2f1259b9575 req-0e35eaa7-7642-4461-8af4-72d0b828f8b7 service nova] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Updated VIF entry in instance network info cache for port 0eae0f1e-d6c2-48bd-ad15-dba679a91a9f. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:42:12 user nova-compute[73258]: DEBUG nova.network.neutron [req-eb47080a-1f15-41d8-8efc-f2f1259b9575 req-0e35eaa7-7642-4461-8af4-72d0b828f8b7 service nova] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Updating instance_info_cache with network_info: [{"id": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "address": "fa:16:3e:00:0b:2b", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eae0f1e-d6", "ovs_interfaceid": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:42:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-eb47080a-1f15-41d8-8efc-f2f1259b9575 req-0e35eaa7-7642-4461-8af4-72d0b828f8b7 service nova] Releasing lock "refresh_cache-a836678e-240d-4ead-b0b5-64d146910a23" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:42:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-1babb17a-0774-421d-8ff0-c30adc36b949 req-1a1c4d04-1a13-4acb-bb7d-a942a5f7749e service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received event network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1babb17a-0774-421d-8ff0-c30adc36b949 req-1a1c4d04-1a13-4acb-bb7d-a942a5f7749e service nova] Acquiring lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1babb17a-0774-421d-8ff0-c30adc36b949 req-1a1c4d04-1a13-4acb-bb7d-a942a5f7749e service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1babb17a-0774-421d-8ff0-c30adc36b949 req-1a1c4d04-1a13-4acb-bb7d-a942a5f7749e service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-1babb17a-0774-421d-8ff0-c30adc36b949 req-1a1c4d04-1a13-4acb-bb7d-a942a5f7749e service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] No waiting events found dispatching network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:12 user nova-compute[73258]: WARNING nova.compute.manager [req-1babb17a-0774-421d-8ff0-c30adc36b949 req-1a1c4d04-1a13-4acb-bb7d-a942a5f7749e service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received unexpected event network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 for instance with vm_state active and task_state rescuing.
Aug 27 06:42:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-1babb17a-0774-421d-8ff0-c30adc36b949 req-1a1c4d04-1a13-4acb-bb7d-a942a5f7749e service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received event network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1babb17a-0774-421d-8ff0-c30adc36b949 req-1a1c4d04-1a13-4acb-bb7d-a942a5f7749e service nova] Acquiring lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1babb17a-0774-421d-8ff0-c30adc36b949 req-1a1c4d04-1a13-4acb-bb7d-a942a5f7749e service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1babb17a-0774-421d-8ff0-c30adc36b949 req-1a1c4d04-1a13-4acb-bb7d-a942a5f7749e service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-1babb17a-0774-421d-8ff0-c30adc36b949 req-1a1c4d04-1a13-4acb-bb7d-a942a5f7749e service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] No waiting events found dispatching network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:12 user nova-compute[73258]: WARNING nova.compute.manager [req-1babb17a-0774-421d-8ff0-c30adc36b949 req-1a1c4d04-1a13-4acb-bb7d-a942a5f7749e service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received unexpected event network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 for instance with vm_state active and task_state rescuing.
Aug 27 06:42:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Removed pending event for 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 due to event {{(pid=73258) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 06:42:13 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118533.2647843, 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:42:13 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] VM Resumed (Lifecycle Event)
Aug 27 06:42:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-b2ed2abb-d007-46f2-ae33-2c012452e6b6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:42:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:42:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:42:13 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 06:42:13 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118533.2746093, 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:42:13 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] VM Started (Lifecycle Event)
Aug 27 06:42:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:42:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:42:13 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 06:42:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-6886c984-0166-4ac8-bc69-c655bb2f0a8c req-4eee18ab-f14b-413e-99e3-a987dc45e7a8 service nova] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Received event network-vif-plugged-0eae0f1e-d6c2-48bd-ad15-dba679a91a9f {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6886c984-0166-4ac8-bc69-c655bb2f0a8c req-4eee18ab-f14b-413e-99e3-a987dc45e7a8 service nova] Acquiring lock "a836678e-240d-4ead-b0b5-64d146910a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6886c984-0166-4ac8-bc69-c655bb2f0a8c req-4eee18ab-f14b-413e-99e3-a987dc45e7a8 service nova] Lock "a836678e-240d-4ead-b0b5-64d146910a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6886c984-0166-4ac8-bc69-c655bb2f0a8c req-4eee18ab-f14b-413e-99e3-a987dc45e7a8 service nova] Lock "a836678e-240d-4ead-b0b5-64d146910a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-6886c984-0166-4ac8-bc69-c655bb2f0a8c req-4eee18ab-f14b-413e-99e3-a987dc45e7a8 service nova] [instance: a836678e-240d-4ead-b0b5-64d146910a23] No waiting events found dispatching network-vif-plugged-0eae0f1e-d6c2-48bd-ad15-dba679a91a9f {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:13 user nova-compute[73258]: WARNING nova.compute.manager [req-6886c984-0166-4ac8-bc69-c655bb2f0a8c req-4eee18ab-f14b-413e-99e3-a987dc45e7a8 service nova] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Received unexpected event network-vif-plugged-0eae0f1e-d6c2-48bd-ad15-dba679a91a9f for instance with vm_state building and task_state spawning.
Aug 27 06:42:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:15 user nova-compute[73258]: DEBUG nova.objects.instance [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lazy-loading 'flavor' on Instance uuid e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:42:15 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118535.7185116, a836678e-240d-4ead-b0b5-64d146910a23 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:42:15 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a836678e-240d-4ead-b0b5-64d146910a23] VM Resumed (Lifecycle Event)
Aug 27 06:42:15 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:42:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:42:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5079e57-bbf0-4b3c-8950-a3bd12207ea5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 18.226s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:15 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Instance spawned successfully.
Aug 27 06:42:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:42:15 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:42:15 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:42:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:42:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:42:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:42:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:42:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:42:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:42:15 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a836678e-240d-4ead-b0b5-64d146910a23] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:42:15 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118535.7310848, a836678e-240d-4ead-b0b5-64d146910a23 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:42:15 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a836678e-240d-4ead-b0b5-64d146910a23] VM Started (Lifecycle Event)
Aug 27 06:42:15 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:42:15 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:42:15 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a836678e-240d-4ead-b0b5-64d146910a23] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:42:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-66771617-d5d5-4b1b-a2db-e0e2513c95d9 req-a9911fc9-1c85-4b02-9d63-8c98be0cd243 service nova] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Received event network-vif-plugged-0eae0f1e-d6c2-48bd-ad15-dba679a91a9f {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-66771617-d5d5-4b1b-a2db-e0e2513c95d9 req-a9911fc9-1c85-4b02-9d63-8c98be0cd243 service nova] Acquiring lock "a836678e-240d-4ead-b0b5-64d146910a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-66771617-d5d5-4b1b-a2db-e0e2513c95d9 req-a9911fc9-1c85-4b02-9d63-8c98be0cd243 service nova] Lock "a836678e-240d-4ead-b0b5-64d146910a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-66771617-d5d5-4b1b-a2db-e0e2513c95d9 req-a9911fc9-1c85-4b02-9d63-8c98be0cd243 service nova] Lock "a836678e-240d-4ead-b0b5-64d146910a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-66771617-d5d5-4b1b-a2db-e0e2513c95d9 req-a9911fc9-1c85-4b02-9d63-8c98be0cd243 service nova] [instance: a836678e-240d-4ead-b0b5-64d146910a23] No waiting events found dispatching network-vif-plugged-0eae0f1e-d6c2-48bd-ad15-dba679a91a9f {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:15 user nova-compute[73258]: WARNING nova.compute.manager [req-66771617-d5d5-4b1b-a2db-e0e2513c95d9 req-a9911fc9-1c85-4b02-9d63-8c98be0cd243 service nova] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Received unexpected event network-vif-plugged-0eae0f1e-d6c2-48bd-ad15-dba679a91a9f for instance with vm_state building and task_state spawning.
Aug 27 06:42:15 user nova-compute[73258]: INFO nova.compute.manager [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Took 10.47 seconds to spawn the instance on the hypervisor.
Aug 27 06:42:15 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:42:16 user nova-compute[73258]: INFO nova.compute.manager [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Took 11.49 seconds to build instance.
Aug 27 06:42:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98c48da-cc21-4fa1-8c74-e106060b8c9d tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "a836678e-240d-4ead-b0b5-64d146910a23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.629s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:28 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:42:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 06:42:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] There are 0 instances to clean {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 06:42:29 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:42:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "de8b1f89-9b89-439a-ab73-21e24e299460" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "de8b1f89-9b89-439a-ab73-21e24e299460" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "de8b1f89-9b89-439a-ab73-21e24e299460-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "de8b1f89-9b89-439a-ab73-21e24e299460-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "de8b1f89-9b89-439a-ab73-21e24e299460-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:30 user nova-compute[73258]: INFO nova.compute.manager [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Terminating instance
Aug 27 06:42:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-057fa4da-a8a2-4525-86ff-196a9807ade5 req-e51c2d33-f55d-4a3b-8bd1-998d874e2255 service nova] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Received event network-vif-unplugged-bf9fda41-86e3-4e71-a329-d07b03ec63e6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-057fa4da-a8a2-4525-86ff-196a9807ade5 req-e51c2d33-f55d-4a3b-8bd1-998d874e2255 service nova] Acquiring lock "de8b1f89-9b89-439a-ab73-21e24e299460-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-057fa4da-a8a2-4525-86ff-196a9807ade5 req-e51c2d33-f55d-4a3b-8bd1-998d874e2255 service nova] Lock "de8b1f89-9b89-439a-ab73-21e24e299460-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-057fa4da-a8a2-4525-86ff-196a9807ade5 req-e51c2d33-f55d-4a3b-8bd1-998d874e2255 service nova] Lock "de8b1f89-9b89-439a-ab73-21e24e299460-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-057fa4da-a8a2-4525-86ff-196a9807ade5 req-e51c2d33-f55d-4a3b-8bd1-998d874e2255 service nova] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] No waiting events found dispatching network-vif-unplugged-bf9fda41-86e3-4e71-a329-d07b03ec63e6 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-057fa4da-a8a2-4525-86ff-196a9807ade5 req-e51c2d33-f55d-4a3b-8bd1-998d874e2255 service nova] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Received event network-vif-unplugged-bf9fda41-86e3-4e71-a329-d07b03ec63e6 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:30 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Instance destroyed successfully.
Aug 27 06:42:30 user nova-compute[73258]: DEBUG nova.objects.instance [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lazy-loading 'resources' on Instance uuid de8b1f89-9b89-439a-ab73-21e24e299460 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-918449526',display_name='tempest-VolumesAdminNegativeTest-server-918449526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-918449526',id=16,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:40:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28d8e2938a0a4a97ac0b3f381626e880',ramdisk_id='',reservation_id='r-avy19eqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2002818274',owner_user_name='tempest-VolumesAdminNegativeTest-2002818274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:40:34Z,user_data=None,user_id='ff56e21976b246b297b6d15c9ba81c89',uuid=de8b1f89-9b89-439a-ab73-21e24e299460,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "address": "fa:16:3e:d9:7a:b3", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fda41-86", "ovs_interfaceid": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Converting VIF {"id": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "address": "fa:16:3e:d9:7a:b3", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fda41-86", "ovs_interfaceid": "bf9fda41-86e3-4e71-a329-d07b03ec63e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:7a:b3,bridge_name='br-int',has_traffic_filtering=True,id=bf9fda41-86e3-4e71-a329-d07b03ec63e6,network=Network(41b0df8b-c615-470d-85ba-7289905946cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fda41-86') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG os_vif [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:7a:b3,bridge_name='br-int',has_traffic_filtering=True,id=bf9fda41-86e3-4e71-a329-d07b03ec63e6,network=Network(41b0df8b-c615-470d-85ba-7289905946cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fda41-86') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf9fda41-86, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:42:30 user nova-compute[73258]: INFO os_vif [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:7a:b3,bridge_name='br-int',has_traffic_filtering=True,id=bf9fda41-86e3-4e71-a329-d07b03ec63e6,network=Network(41b0df8b-c615-470d-85ba-7289905946cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fda41-86')
Aug 27 06:42:30 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Deleting instance files /opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460_del
Aug 27 06:42:30 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Deletion of /opt/stack/data/nova/instances/de8b1f89-9b89-439a-ab73-21e24e299460_del complete
Aug 27 06:42:31 user nova-compute[73258]: INFO nova.compute.manager [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 27 06:42:31 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:42:31 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:42:31 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:42:31 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:42:31 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Took 0.82 seconds to deallocate network for instance.
Aug 27 06:42:31 user nova-compute[73258]: DEBUG nova.compute.manager [req-357d2716-8efe-4b45-af3e-ace93240e542 req-f8c79ca5-3a62-426d-8101-ace110225e82 service nova] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Received event network-vif-deleted-bf9fda41-86e3-4e71-a329-d07b03ec63e6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:32 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:42:32 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:42:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:32 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Deleted allocations for instance de8b1f89-9b89-439a-ab73-21e24e299460
Aug 27 06:42:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-edcd22b4-43d1-4619-bf3d-78a32a77e63b tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "de8b1f89-9b89-439a-ab73-21e24e299460" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.294s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-3da3723a-8023-496a-ad9d-27b81756ea3a req-12b81c05-9387-403d-bde1-0b1e31128bb9 service nova] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Received event network-vif-plugged-bf9fda41-86e3-4e71-a329-d07b03ec63e6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3da3723a-8023-496a-ad9d-27b81756ea3a req-12b81c05-9387-403d-bde1-0b1e31128bb9 service nova] Acquiring lock "de8b1f89-9b89-439a-ab73-21e24e299460-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3da3723a-8023-496a-ad9d-27b81756ea3a req-12b81c05-9387-403d-bde1-0b1e31128bb9 service nova] Lock "de8b1f89-9b89-439a-ab73-21e24e299460-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3da3723a-8023-496a-ad9d-27b81756ea3a req-12b81c05-9387-403d-bde1-0b1e31128bb9 service nova] Lock "de8b1f89-9b89-439a-ab73-21e24e299460-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-3da3723a-8023-496a-ad9d-27b81756ea3a req-12b81c05-9387-403d-bde1-0b1e31128bb9 service nova] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] No waiting events found dispatching network-vif-plugged-bf9fda41-86e3-4e71-a329-d07b03ec63e6 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:32 user nova-compute[73258]: WARNING nova.compute.manager [req-3da3723a-8023-496a-ad9d-27b81756ea3a req-12b81c05-9387-403d-bde1-0b1e31128bb9 service nova] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Received unexpected event network-vif-plugged-bf9fda41-86e3-4e71-a329-d07b03ec63e6 for instance with vm_state deleted and task_state None.
Aug 27 06:42:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-3da3723a-8023-496a-ad9d-27b81756ea3a req-12b81c05-9387-403d-bde1-0b1e31128bb9 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Received event network-changed-85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-3da3723a-8023-496a-ad9d-27b81756ea3a req-12b81c05-9387-403d-bde1-0b1e31128bb9 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Refreshing instance network info cache due to event network-changed-85410bb9-dbd6-481c-a090-46d04e0d54b6. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:42:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3da3723a-8023-496a-ad9d-27b81756ea3a req-12b81c05-9387-403d-bde1-0b1e31128bb9 service nova] Acquiring lock "refresh_cache-4a2970a3-2a05-4462-bf0b-1595743222fb" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:42:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3da3723a-8023-496a-ad9d-27b81756ea3a req-12b81c05-9387-403d-bde1-0b1e31128bb9 service nova] Acquired lock "refresh_cache-4a2970a3-2a05-4462-bf0b-1595743222fb" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:42:32 user nova-compute[73258]: DEBUG nova.network.neutron [req-3da3723a-8023-496a-ad9d-27b81756ea3a req-12b81c05-9387-403d-bde1-0b1e31128bb9 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Refreshing network info cache for port 85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:42:32 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:42:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "4a2970a3-2a05-4462-bf0b-1595743222fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lazy-loading 'flavor' on Instance uuid 4a2970a3-2a05-4462-bf0b-1595743222fb {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "4a2970a3-2a05-4462-bf0b-1595743222fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:33 user nova-compute[73258]: INFO nova.compute.manager [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Attaching volume 15319228-580b-4a94-aa25-32c646a7c19c to /dev/vdb
Aug 27 06:42:33 user nova-compute[73258]: DEBUG os_brick.utils [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1da0e53-a252-4ecf-b76d-37074d535737]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[963350fe-c361-46ab-b99c-784567fdd59c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.044s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5dc3ae-6210-4a83-8fd1-58448f9c9088]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebca41b-f2d8-4903-83b0-42a65568e187]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG nova.network.neutron [req-3da3723a-8023-496a-ad9d-27b81756ea3a req-12b81c05-9387-403d-bde1-0b1e31128bb9 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Updated VIF entry in instance network info cache for port 85410bb9-dbd6-481c-a090-46d04e0d54b6. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG nova.network.neutron [req-3da3723a-8023-496a-ad9d-27b81756ea3a req-12b81c05-9387-403d-bde1-0b1e31128bb9 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Updating instance_info_cache with network_info: [{"id": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "address": "fa:16:3e:d3:c2:3b", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85410bb9-db", "ovs_interfaceid": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3da3723a-8023-496a-ad9d-27b81756ea3a req-12b81c05-9387-403d-bde1-0b1e31128bb9 service nova] Releasing lock "refresh_cache-4a2970a3-2a05-4462-bf0b-1595743222fb" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:42:33 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcce18a7-c4be-465a-8cf2-01b97180c6e7]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG os_brick.utils [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Updating existing volume attachment record: 8c1e2f86-2a76-40aa-af93-a9c1c1e8c5d1 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:42:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:42:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:42:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:42:34 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:42:34 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Updating instance_info_cache with network_info: [{"id": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "address": "fa:16:3e:82:0b:22", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f7670e-c9", "ovs_interfaceid": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:42:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:42:34 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:42:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:35 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:42:35 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:42:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:36 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:42:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:38 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:42:38 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:42:38 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:42:38 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:42:39 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:42:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:42:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:42:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:43 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:42:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.319s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Acquiring lock "21e7abcc-86a6-4315-9a84-9efcc907156f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:42:45 user nova-compute[73258]: INFO nova.compute.claims [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Claim successful on node user
Aug 27 06:42:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:45 user nova-compute[73258]: INFO nova.compute.manager [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Detaching volume 46a83178-b67e-4624-896c-79871e2c4b15
Aug 27 06:42:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:45 user nova-compute[73258]: INFO nova.virt.block_device [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Attempting to driver detach volume 46a83178-b67e-4624-896c-79871e2c4b15 from mountpoint /dev/vdc
Aug 27 06:42:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Attempting to detach device vdc from instance 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:42:45 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:42:45 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 06:42:45 user nova-compute[73258]:   <target dev="vdc" bus="virtio"/>
Aug 27 06:42:45 user nova-compute[73258]:   <serial>46a83178-b67e-4624-896c-79871e2c4b15</serial>
Aug 27 06:42:45 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 06:42:45 user nova-compute[73258]: </disk>
Aug 27 06:42:45 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:42:45 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Successfully detached device vdc from instance 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e from the persistent domain config.
Aug 27 06:42:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:42:45 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:42:45 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 06:42:45 user nova-compute[73258]:   <target dev="vdc" bus="virtio"/>
Aug 27 06:42:45 user nova-compute[73258]:   <serial>46a83178-b67e-4624-896c-79871e2c4b15</serial>
Aug 27 06:42:45 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 06:42:45 user nova-compute[73258]: </disk>
Aug 27 06:42:45 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Refreshing inventories for resource provider 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Updating ProviderTree inventory for provider 13f05024-5078-4590-94a5-110d29d864c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Updating inventory in ProviderTree for provider 13f05024-5078-4590-94a5-110d29d864c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Refreshing aggregate associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, aggregates: None {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Refreshing trait associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118550.8248844, de8b1f89-9b89-439a-ab73-21e24e299460 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:42:45 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] VM Stopped (Lifecycle Event)
Aug 27 06:42:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-70ab7cc4-c001-488d-8cb8-458a4f4cb72d None None] [instance: de8b1f89-9b89-439a-ab73-21e24e299460] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693118566.181046, 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:42:46 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Successfully detached device vdc from instance 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e from the live domain config.
Aug 27 06:42:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLFKbvjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:42:46 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:42:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb433e6-ba45-4e43-b240-9a029ab80968]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e503ad4-acb2-47af-b6ba-ac5e36de2d2c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:42:46 user nova-compute[73258]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 (non-flash)
Aug 27 06:42:46 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:42:46 user nova-compute[73258]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 (non-flash)
Aug 27 06:42:46 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa410520310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15'): ({'sdc'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Removing single pathed devices sdc {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8c5b57-8e9e-4529-b9b1-90ad71500669]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ed8496-4464-43b5-ae06-5565eb57c2f8]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Flushing IO for device /dev/sdc {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.946s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG nova.compute.manager [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab52caf-0e17-49e9-a5fb-f3992d0c398c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[37db5124-e545-4e5d-8fe3-922f258308f8]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9232f5-ce5a-4ba3-9a67-467a83dec640]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG nova.compute.manager [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG nova.network.neutron [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:42:46 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:42:46 user nova-compute[73258]: DEBUG nova.compute.manager [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[249f681a-ba7f-4cde-9d88-732bf7f00456]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15, portal: 172.16.0.220,3260]
Aug 27 06:42:46 user nova-compute[73258]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15, portal: 172.16.0.220,3260] successful.
Aug 27 06:42:46 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a83178-b67e-4624-896c-79871e2c4b15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5a404c-15d0-49db-96c6-31d0a495121a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] <== disconnect_volume: return (334ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG nova.policy [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64d0c2655b6c4ea0b9932a62ecc284f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c7973a9a594a5aa6852b10b742c174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG nova.compute.manager [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:42:46 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Creating image(s)
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Acquiring lock "/opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "/opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "/opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.180s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.181s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk 1073741824" returned: 0 in 0.067s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.246s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.190s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TirxAwPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:42:47 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:42:47 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:42:47 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a0bc01-9f42-41a0-8395-ce0e9e20df0f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:42:47 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[af58abc4-0358-442a-aa03-ecc20fe34c6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c] added
Aug 27 06:42:47 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.259s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7c1f42-27f8-436b-81cc-d71a05613694]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[029c398e-6d0b-4e8a-83ea-6aae8dd5bfb1]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Cannot resize image /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Ensure instance console log exists: /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TirxAwPp {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TirxAwPp" returned: 0 in 0.037s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bde7d1-2feb-446e-a8a7-44270795b6d0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TirxAwPp'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53c8b25-5cf2-4184-9321-807b677f4a54]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c981372-fbbf-4a4a-a651-33149723157a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:42:47 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:42:47 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG nova.objects.instance [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'flavor' on Instance uuid 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c91808e-1e64-46a5-9fd6-2b8f2694a874]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c, portal: 172.16.0.220,3260]
Aug 27 06:42:47 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c, portal: 172.16.0.220,3260] successful.
Aug 27 06:42:47 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f75e2bc-f5d2-4ab9-bdc9-7ff110fd2d17]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-af12d190-a50f-4643-983b-98dd185c8e28 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.423s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd08aca-ae85-475a-8634-9538bfeb80b0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:42:47 user nova-compute[73258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:42:47 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:42:47 user nova-compute[73258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:42:47 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.447s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c088caf-0a9e-4f9c-9cb0-b18f9592a921]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:42:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TirxAwPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG nova.network.neutron [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Successfully created port: 1180e78d-2144-45a5-a958-567420edf02a {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:48 user nova-compute[73258]: INFO nova.compute.manager [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Terminating instance
Aug 27 06:42:48 user nova-compute[73258]: DEBUG nova.compute.manager [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk.rescue --force-share --output=json" returned: 0 in 0.252s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG nova.network.neutron [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Successfully updated port: 1180e78d-2144-45a5-a958-567420edf02a {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.501s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] <== connect_volume: return (1504ms) {'type': 'block', 'scsi_wwn': '26662363730616132', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662363730616132', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Acquiring lock "refresh_cache-21e7abcc-86a6-4315-9a84-9efcc907156f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Acquired lock "refresh_cache-21e7abcc-86a6-4315-9a84-9efcc907156f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:42:48 user nova-compute[73258]: DEBUG nova.network.neutron [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-e83c8063-577c-4573-9022-6f5320eb5e94 req-0a5373a6-d7e1-44d6-9100-0fe4619ebc41 service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Received event network-changed-1180e78d-2144-45a5-a958-567420edf02a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-e83c8063-577c-4573-9022-6f5320eb5e94 req-0a5373a6-d7e1-44d6-9100-0fe4619ebc41 service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Refreshing instance network info cache due to event network-changed-1180e78d-2144-45a5-a958-567420edf02a. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e83c8063-577c-4573-9022-6f5320eb5e94 req-0a5373a6-d7e1-44d6-9100-0fe4619ebc41 service nova] Acquiring lock "refresh_cache-21e7abcc-86a6-4315-9a84-9efcc907156f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lazy-loading 'flavor' on Instance uuid 4a2970a3-2a05-4462-bf0b-1595743222fb {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:42:49 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Instance destroyed successfully.
Aug 27 06:42:49 user nova-compute[73258]: DEBUG nova.network.neutron [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG nova.objects.instance [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lazy-loading 'resources' on Instance uuid e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-e52ff1f6-d9df-4af6-846c-d69dddf11a12 req-ca065c6c-b004-43c0-9748-a9bbd5f91d18 service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Received event network-vif-unplugged-22202aee-0bda-40c0-9441-f014a5f99131 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e52ff1f6-d9df-4af6-846c-d69dddf11a12 req-ca065c6c-b004-43c0-9748-a9bbd5f91d18 service nova] Acquiring lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e52ff1f6-d9df-4af6-846c-d69dddf11a12 req-ca065c6c-b004-43c0-9748-a9bbd5f91d18 service nova] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e52ff1f6-d9df-4af6-846c-d69dddf11a12 req-ca065c6c-b004-43c0-9748-a9bbd5f91d18 service nova] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-e52ff1f6-d9df-4af6-846c-d69dddf11a12 req-ca065c6c-b004-43c0-9748-a9bbd5f91d18 service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] No waiting events found dispatching network-vif-unplugged-22202aee-0bda-40c0-9441-f014a5f99131 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-e52ff1f6-d9df-4af6-846c-d69dddf11a12 req-ca065c6c-b004-43c0-9748-a9bbd5f91d18 service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Received event network-vif-unplugged-22202aee-0bda-40c0-9441-f014a5f99131 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:36:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-574338431',display_name='tempest-AttachVolumeNegativeTest-server-574338431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-574338431',id=2,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQ4MFm8WHy6eUHK6twNNCN3DsKMcDcxpwno8VmEqxt7IRP4qn6F+52Hnd0nAImY4EznUiVj7cwrADgXNrJEakaPM3hhsDYZ9AziFA/Bg5hPZpuLfUtLHpi9mIw4WYmNdQ==',key_name='tempest-keypair-381106654',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:37:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f43f32eaadfd4f7eacc418385cc5e474',ramdisk_id='',reservation_id='r-t9yj1jpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-537954646',owner_user_name='tempest-AttachVolumeNegativeTest-537954646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd74559df08d44e298ba6e2ccbaaefae',uuid=e0e28ddd-fdc0-4db2-a4d5-64b9a724f943,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22202aee-0bda-40c0-9441-f014a5f99131", "address": "fa:16:3e:4a:cd:08", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22202aee-0b", "ovs_interfaceid": "22202aee-0bda-40c0-9441-f014a5f99131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converting VIF {"id": "22202aee-0bda-40c0-9441-f014a5f99131", "address": "fa:16:3e:4a:cd:08", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22202aee-0b", "ovs_interfaceid": "22202aee-0bda-40c0-9441-f014a5f99131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:cd:08,bridge_name='br-int',has_traffic_filtering=True,id=22202aee-0bda-40c0-9441-f014a5f99131,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22202aee-0b') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG os_vif [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:cd:08,bridge_name='br-int',has_traffic_filtering=True,id=22202aee-0bda-40c0-9441-f014a5f99131,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22202aee-0b') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22202aee-0b, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:42:49 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:42:49 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:42:49 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:42:49 user nova-compute[73258]:   <serial>15319228-580b-4a94-aa25-32c646a7c19c</serial>
Aug 27 06:42:49 user nova-compute[73258]: </disk>
Aug 27 06:42:49 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:42:49 user nova-compute[73258]: INFO os_vif [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:cd:08,bridge_name='br-int',has_traffic_filtering=True,id=22202aee-0bda-40c0-9441-f014a5f99131,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22202aee-0b')
Aug 27 06:42:49 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Deleting instance files /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943_del
Aug 27 06:42:49 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Deletion of /opt/stack/data/nova/instances/e0e28ddd-fdc0-4db2-a4d5-64b9a724f943_del complete
Aug 27 06:42:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:49 user nova-compute[73258]: INFO nova.compute.manager [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 27 06:42:49 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:42:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.network.neutron [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Updating instance_info_cache with network_info: [{"id": "1180e78d-2144-45a5-a958-567420edf02a", "address": "fa:16:3e:d1:f6:19", "network": {"id": "e690fd29-676c-47ee-88ba-886eea8dcf5f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-65889246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c7973a9a594a5aa6852b10b742c174", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1180e78d-21", "ovs_interfaceid": "1180e78d-2144-45a5-a958-567420edf02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:42:50 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:42:50 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=7273MB free_disk=24.181610107421875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Releasing lock "refresh_cache-21e7abcc-86a6-4315-9a84-9efcc907156f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.compute.manager [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Instance network_info: |[{"id": "1180e78d-2144-45a5-a958-567420edf02a", "address": "fa:16:3e:d1:f6:19", "network": {"id": "e690fd29-676c-47ee-88ba-886eea8dcf5f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-65889246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c7973a9a594a5aa6852b10b742c174", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1180e78d-21", "ovs_interfaceid": "1180e78d-2144-45a5-a958-567420edf02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e83c8063-577c-4573-9022-6f5320eb5e94 req-0a5373a6-d7e1-44d6-9100-0fe4619ebc41 service nova] Acquired lock "refresh_cache-21e7abcc-86a6-4315-9a84-9efcc907156f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.network.neutron [req-e83c8063-577c-4573-9022-6f5320eb5e94 req-0a5373a6-d7e1-44d6-9100-0fe4619ebc41 service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Refreshing network info cache for port 1180e78d-2144-45a5-a958-567420edf02a {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Start _get_guest_xml network_info=[{"id": "1180e78d-2144-45a5-a958-567420edf02a", "address": "fa:16:3e:d1:f6:19", "network": {"id": "e690fd29-676c-47ee-88ba-886eea8dcf5f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-65889246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c7973a9a594a5aa6852b10b742c174", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1180e78d-21", "ovs_interfaceid": "1180e78d-2144-45a5-a958-567420edf02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] No VIF found with MAC fa:16:3e:d3:c2:3b, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:42:50 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:42:50 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:42:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-633508898',display_name='tempest-TestVolumeSwap-server-633508898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-633508898',id=19,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5V1ZIOnUJF87nfN5dwS0iWpp/WVrLWJwbN4Im0Vy4pUOwrL9/ddYL3YyNtNE0LFEojJu2KKXpq3f0aR9cp/yWR1SPnGK0Udv5BvvUNVQkyP9+WrYro5T4NUwMWRXHIxg==',key_name='tempest-keypair-720595720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63c7973a9a594a5aa6852b10b742c174',ramdisk_id='',reservation_id='r-yetsf9t9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1017490211',owner_user_name='tempest-TestVolumeSwap-1017490211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:42:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64d0c2655b6c4ea0b9932a62ecc284f2',uuid=21e7abcc-86a6-4315-9a84-9efcc907156f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1180e78d-2144-45a5-a958-567420edf02a", "address": "fa:16:3e:d1:f6:19", "network": {"id": "e690fd29-676c-47ee-88ba-886eea8dcf5f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-65889246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c7973a9a594a5aa6852b10b742c174", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1180e78d-21", "ovs_interfaceid": "1180e78d-2144-45a5-a958-567420edf02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Converting VIF {"id": "1180e78d-2144-45a5-a958-567420edf02a", "address": "fa:16:3e:d1:f6:19", "network": {"id": "e690fd29-676c-47ee-88ba-886eea8dcf5f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-65889246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c7973a9a594a5aa6852b10b742c174", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1180e78d-21", "ovs_interfaceid": "1180e78d-2144-45a5-a958-567420edf02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:f6:19,bridge_name='br-int',has_traffic_filtering=True,id=1180e78d-2144-45a5-a958-567420edf02a,network=Network(e690fd29-676c-47ee-88ba-886eea8dcf5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1180e78d-21') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.objects.instance [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lazy-loading 'pci_devices' on Instance uuid 21e7abcc-86a6-4315-9a84-9efcc907156f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:42:50 user nova-compute[73258]:   <uuid>21e7abcc-86a6-4315-9a84-9efcc907156f</uuid>
Aug 27 06:42:50 user nova-compute[73258]:   <name>instance-00000013</name>
Aug 27 06:42:50 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:42:50 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:42:50 user nova-compute[73258]:   <metadata>
Aug 27 06:42:50 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:42:50 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:42:50 user nova-compute[73258]:       <nova:name>tempest-TestVolumeSwap-server-633508898</nova:name>
Aug 27 06:42:50 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:42:50</nova:creationTime>
Aug 27 06:42:50 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:42:50 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:42:50 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:42:50 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:42:50 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:42:50 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:42:50 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:42:50 user nova-compute[73258]:       <nova:owner>
Aug 27 06:42:50 user nova-compute[73258]:         <nova:user uuid="64d0c2655b6c4ea0b9932a62ecc284f2">tempest-TestVolumeSwap-1017490211-project-member</nova:user>
Aug 27 06:42:50 user nova-compute[73258]:         <nova:project uuid="63c7973a9a594a5aa6852b10b742c174">tempest-TestVolumeSwap-1017490211</nova:project>
Aug 27 06:42:50 user nova-compute[73258]:       </nova:owner>
Aug 27 06:42:50 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:42:50 user nova-compute[73258]:       <nova:ports>
Aug 27 06:42:50 user nova-compute[73258]:         <nova:port uuid="1180e78d-2144-45a5-a958-567420edf02a">
Aug 27 06:42:50 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 06:42:50 user nova-compute[73258]:         </nova:port>
Aug 27 06:42:50 user nova-compute[73258]:       </nova:ports>
Aug 27 06:42:50 user nova-compute[73258]:     </nova:instance>
Aug 27 06:42:50 user nova-compute[73258]:   </metadata>
Aug 27 06:42:50 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:42:50 user nova-compute[73258]:     <system>
Aug 27 06:42:50 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:42:50 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:42:50 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:42:50 user nova-compute[73258]:       <entry name="serial">21e7abcc-86a6-4315-9a84-9efcc907156f</entry>
Aug 27 06:42:50 user nova-compute[73258]:       <entry name="uuid">21e7abcc-86a6-4315-9a84-9efcc907156f</entry>
Aug 27 06:42:50 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:42:50 user nova-compute[73258]:     </system>
Aug 27 06:42:50 user nova-compute[73258]:   </sysinfo>
Aug 27 06:42:50 user nova-compute[73258]:   <os>
Aug 27 06:42:50 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:42:50 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:42:50 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:42:50 user nova-compute[73258]:   </os>
Aug 27 06:42:50 user nova-compute[73258]:   <features>
Aug 27 06:42:50 user nova-compute[73258]:     <acpi/>
Aug 27 06:42:50 user nova-compute[73258]:     <apic/>
Aug 27 06:42:50 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:42:50 user nova-compute[73258]:   </features>
Aug 27 06:42:50 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:42:50 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:42:50 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:42:50 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:42:50 user nova-compute[73258]:   </clock>
Aug 27 06:42:50 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:42:50 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:42:50 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:42:50 user nova-compute[73258]:   </cpu>
Aug 27 06:42:50 user nova-compute[73258]:   <devices>
Aug 27 06:42:50 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:42:50 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:42:50 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk"/>
Aug 27 06:42:50 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:42:50 user nova-compute[73258]:     </disk>
Aug 27 06:42:50 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:42:50 user nova-compute[73258]:       <mac address="fa:16:3e:d1:f6:19"/>
Aug 27 06:42:50 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:42:50 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:42:50 user nova-compute[73258]:       <target dev="tap1180e78d-21"/>
Aug 27 06:42:50 user nova-compute[73258]:     </interface>
Aug 27 06:42:50 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:42:50 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/console.log" append="off"/>
Aug 27 06:42:50 user nova-compute[73258]:     </serial>
Aug 27 06:42:50 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:42:50 user nova-compute[73258]:     <video>
Aug 27 06:42:50 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:42:50 user nova-compute[73258]:     </video>
Aug 27 06:42:50 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:42:50 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:42:50 user nova-compute[73258]:     </rng>
Aug 27 06:42:50 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:42:50 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:42:50 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:42:50 user nova-compute[73258]:     </memballoon>
Aug 27 06:42:50 user nova-compute[73258]:   </devices>
Aug 27 06:42:50 user nova-compute[73258]: </domain>
Aug 27 06:42:50 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:42:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-633508898',display_name='tempest-TestVolumeSwap-server-633508898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-633508898',id=19,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5V1ZIOnUJF87nfN5dwS0iWpp/WVrLWJwbN4Im0Vy4pUOwrL9/ddYL3YyNtNE0LFEojJu2KKXpq3f0aR9cp/yWR1SPnGK0Udv5BvvUNVQkyP9+WrYro5T4NUwMWRXHIxg==',key_name='tempest-keypair-720595720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63c7973a9a594a5aa6852b10b742c174',ramdisk_id='',reservation_id='r-yetsf9t9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1017490211',owner_user_name='tempest-TestVolumeSwap-1017490211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:42:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64d0c2655b6c4ea0b9932a62ecc284f2',uuid=21e7abcc-86a6-4315-9a84-9efcc907156f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1180e78d-2144-45a5-a958-567420edf02a", "address": "fa:16:3e:d1:f6:19", "network": {"id": "e690fd29-676c-47ee-88ba-886eea8dcf5f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-65889246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c7973a9a594a5aa6852b10b742c174", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1180e78d-21", "ovs_interfaceid": "1180e78d-2144-45a5-a958-567420edf02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Converting VIF {"id": "1180e78d-2144-45a5-a958-567420edf02a", "address": "fa:16:3e:d1:f6:19", "network": {"id": "e690fd29-676c-47ee-88ba-886eea8dcf5f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-65889246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c7973a9a594a5aa6852b10b742c174", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1180e78d-21", "ovs_interfaceid": "1180e78d-2144-45a5-a958-567420edf02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:f6:19,bridge_name='br-int',has_traffic_filtering=True,id=1180e78d-2144-45a5-a958-567420edf02a,network=Network(e690fd29-676c-47ee-88ba-886eea8dcf5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1180e78d-21') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG os_vif [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:f6:19,bridge_name='br-int',has_traffic_filtering=True,id=1180e78d-2144-45a5-a958-567420edf02a,network=Network(e690fd29-676c-47ee-88ba-886eea8dcf5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1180e78d-21') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1180e78d-21, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1180e78d-21, col_values=(('external_ids', {'iface-id': '1180e78d-2144-45a5-a958-567420edf02a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:f6:19', 'vm-uuid': '21e7abcc-86a6-4315-9a84-9efcc907156f'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:50 user nova-compute[73258]: INFO os_vif [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:f6:19,bridge_name='br-int',has_traffic_filtering=True,id=1180e78d-2144-45a5-a958-567420edf02a,network=Network(e690fd29-676c-47ee-88ba-886eea8dcf5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1180e78d-21')
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 33b995be-307d-4491-a1b4-fb75ececea1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1672aa9f-be6f-4357-877f-a48f62119df4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 4a2970a3-2a05-4462-bf0b-1595743222fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a836678e-240d-4ead-b0b5-64d146910a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 21e7abcc-86a6-4315-9a84-9efcc907156f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a5b5b39c-04b8-44c6-ad18-0151f402d23c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.620s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:42:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] No VIF found with MAC fa:16:3e:d1:f6:19, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:42:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:51 user nova-compute[73258]: DEBUG nova.compute.manager [req-83600955-95c5-4aa2-9026-23132c3300af req-75d1f2bb-10b9-46b4-b73d-99d1a8dd5e45 service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Received event network-vif-plugged-22202aee-0bda-40c0-9441-f014a5f99131 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-83600955-95c5-4aa2-9026-23132c3300af req-75d1f2bb-10b9-46b4-b73d-99d1a8dd5e45 service nova] Acquiring lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-83600955-95c5-4aa2-9026-23132c3300af req-75d1f2bb-10b9-46b4-b73d-99d1a8dd5e45 service nova] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-83600955-95c5-4aa2-9026-23132c3300af req-75d1f2bb-10b9-46b4-b73d-99d1a8dd5e45 service nova] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:51 user nova-compute[73258]: DEBUG nova.compute.manager [req-83600955-95c5-4aa2-9026-23132c3300af req-75d1f2bb-10b9-46b4-b73d-99d1a8dd5e45 service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] No waiting events found dispatching network-vif-plugged-22202aee-0bda-40c0-9441-f014a5f99131 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:51 user nova-compute[73258]: WARNING nova.compute.manager [req-83600955-95c5-4aa2-9026-23132c3300af req-75d1f2bb-10b9-46b4-b73d-99d1a8dd5e45 service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Received unexpected event network-vif-plugged-22202aee-0bda-40c0-9441-f014a5f99131 for instance with vm_state active and task_state deleting.
Aug 27 06:42:51 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:42:51 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:42:51 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:42:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.778s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:51 user nova-compute[73258]: INFO nova.compute.manager [None req-785a1fc6-ff48-4a3f-be21-b3b5d7ed0166 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Unrescuing
Aug 27 06:42:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-785a1fc6-ff48-4a3f-be21-b3b5d7ed0166 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:42:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-785a1fc6-ff48-4a3f-be21-b3b5d7ed0166 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquired lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:42:51 user nova-compute[73258]: DEBUG nova.network.neutron [None req-785a1fc6-ff48-4a3f-be21-b3b5d7ed0166 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:42:52 user nova-compute[73258]: DEBUG nova.network.neutron [req-e83c8063-577c-4573-9022-6f5320eb5e94 req-0a5373a6-d7e1-44d6-9100-0fe4619ebc41 service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Updated VIF entry in instance network info cache for port 1180e78d-2144-45a5-a958-567420edf02a. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:42:52 user nova-compute[73258]: DEBUG nova.network.neutron [req-e83c8063-577c-4573-9022-6f5320eb5e94 req-0a5373a6-d7e1-44d6-9100-0fe4619ebc41 service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Updating instance_info_cache with network_info: [{"id": "1180e78d-2144-45a5-a958-567420edf02a", "address": "fa:16:3e:d1:f6:19", "network": {"id": "e690fd29-676c-47ee-88ba-886eea8dcf5f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-65889246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c7973a9a594a5aa6852b10b742c174", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1180e78d-21", "ovs_interfaceid": "1180e78d-2144-45a5-a958-567420edf02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:42:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e83c8063-577c-4573-9022-6f5320eb5e94 req-0a5373a6-d7e1-44d6-9100-0fe4619ebc41 service nova] Releasing lock "refresh_cache-21e7abcc-86a6-4315-9a84-9efcc907156f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:42:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:52 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:42:52 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Took 3.65 seconds to deallocate network for instance.
Aug 27 06:42:53 user nova-compute[73258]: DEBUG nova.compute.manager [req-71fce350-e701-4da7-80a5-afefc7636e7f req-7e123f7a-d612-464c-9359-49eef5187f7a service nova] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Received event network-vif-deleted-22202aee-0bda-40c0-9441-f014a5f99131 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG nova.network.neutron [None req-785a1fc6-ff48-4a3f-be21-b3b5d7ed0166 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Updating instance_info_cache with network_info: [{"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-785a1fc6-ff48-4a3f-be21-b3b5d7ed0166 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Releasing lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG nova.objects.instance [None req-785a1fc6-ff48-4a3f-be21-b3b5d7ed0166 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lazy-loading 'flavor' on Instance uuid 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:42:53 user nova-compute[73258]: INFO nova.compute.manager [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Rebuilding instance
Aug 27 06:42:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.585s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:53 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Deleted allocations for instance e0e28ddd-fdc0-4db2-a4d5-64b9a724f943
Aug 27 06:42:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG nova.compute.manager [req-20e3ac0f-ded5-4eb4-8863-74576af1ac81 req-7250d74b-6497-4ad3-8f4a-bb9a93713006 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-vif-unplugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-20e3ac0f-ded5-4eb4-8863-74576af1ac81 req-7250d74b-6497-4ad3-8f4a-bb9a93713006 service nova] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-20e3ac0f-ded5-4eb4-8863-74576af1ac81 req-7250d74b-6497-4ad3-8f4a-bb9a93713006 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-20e3ac0f-ded5-4eb4-8863-74576af1ac81 req-7250d74b-6497-4ad3-8f4a-bb9a93713006 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:53 user nova-compute[73258]: DEBUG nova.compute.manager [req-20e3ac0f-ded5-4eb4-8863-74576af1ac81 req-7250d74b-6497-4ad3-8f4a-bb9a93713006 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] No waiting events found dispatching network-vif-unplugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:53 user nova-compute[73258]: WARNING nova.compute.manager [req-20e3ac0f-ded5-4eb4-8863-74576af1ac81 req-7250d74b-6497-4ad3-8f4a-bb9a93713006 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received unexpected event network-vif-unplugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:42:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d8651f6f-d0e0-4194-b667-f7d55d09fe0b tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "e0e28ddd-fdc0-4db2-a4d5-64b9a724f943" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.843s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:54 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Instance destroyed successfully.
Aug 27 06:42:54 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Instance destroyed successfully.
Aug 27 06:42:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:54 user nova-compute[73258]: INFO nova.compute.manager [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Detaching volume 15319228-580b-4a94-aa25-32c646a7c19c
Aug 27 06:42:54 user nova-compute[73258]: INFO nova.virt.block_device [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Attempting to driver detach volume 15319228-580b-4a94-aa25-32c646a7c19c from mountpoint /dev/vdb
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Attempting to detach device vdb from instance 4a2970a3-2a05-4462-bf0b-1595743222fb from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:42:55 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:42:55 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:42:55 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:42:55 user nova-compute[73258]:   <serial>15319228-580b-4a94-aa25-32c646a7c19c</serial>
Aug 27 06:42:55 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:42:55 user nova-compute[73258]: </disk>
Aug 27 06:42:55 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:42:55 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Successfully detached device vdb from instance 4a2970a3-2a05-4462-bf0b-1595743222fb from the persistent domain config.
Aug 27 06:42:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TirxAwPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:42:55 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 06:42:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5679c4ef-6569-4769-8447-291e5f7b929c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f7f2a1-13ec-429e-85db-3e47dc015851]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:42:55 user nova-compute[73258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:42:55 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:42:55 user nova-compute[73258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:42:55 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa441f00c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f64b49d-165d-486d-95f0-04be6a690960]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.compute.manager [req-75a870a3-4e54-4f53-8120-e306b2545c3e req-82894d27-4c90-4e35-aaa8-c4f5e155b5f6 service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Received event network-vif-plugged-1180e78d-2144-45a5-a958-567420edf02a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-75a870a3-4e54-4f53-8120-e306b2545c3e req-82894d27-4c90-4e35-aaa8-c4f5e155b5f6 service nova] Acquiring lock "21e7abcc-86a6-4315-9a84-9efcc907156f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-75a870a3-4e54-4f53-8120-e306b2545c3e req-82894d27-4c90-4e35-aaa8-c4f5e155b5f6 service nova] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-75a870a3-4e54-4f53-8120-e306b2545c3e req-82894d27-4c90-4e35-aaa8-c4f5e155b5f6 service nova] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.compute.manager [req-75a870a3-4e54-4f53-8120-e306b2545c3e req-82894d27-4c90-4e35-aaa8-c4f5e155b5f6 service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] No waiting events found dispatching network-vif-plugged-1180e78d-2144-45a5-a958-567420edf02a {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:55 user nova-compute[73258]: WARNING nova.compute.manager [req-75a870a3-4e54-4f53-8120-e306b2545c3e req-82894d27-4c90-4e35-aaa8-c4f5e155b5f6 service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Received unexpected event network-vif-plugged-1180e78d-2144-45a5-a958-567420edf02a for instance with vm_state building and task_state spawning.
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.compute.manager [req-75a870a3-4e54-4f53-8120-e306b2545c3e req-82894d27-4c90-4e35-aaa8-c4f5e155b5f6 service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Received event network-vif-plugged-1180e78d-2144-45a5-a958-567420edf02a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-75a870a3-4e54-4f53-8120-e306b2545c3e req-82894d27-4c90-4e35-aaa8-c4f5e155b5f6 service nova] Acquiring lock "21e7abcc-86a6-4315-9a84-9efcc907156f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-75a870a3-4e54-4f53-8120-e306b2545c3e req-82894d27-4c90-4e35-aaa8-c4f5e155b5f6 service nova] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-75a870a3-4e54-4f53-8120-e306b2545c3e req-82894d27-4c90-4e35-aaa8-c4f5e155b5f6 service nova] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.compute.manager [req-75a870a3-4e54-4f53-8120-e306b2545c3e req-82894d27-4c90-4e35-aaa8-c4f5e155b5f6 service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] No waiting events found dispatching network-vif-plugged-1180e78d-2144-45a5-a958-567420edf02a {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:55 user nova-compute[73258]: WARNING nova.compute.manager [req-75a870a3-4e54-4f53-8120-e306b2545c3e req-82894d27-4c90-4e35-aaa8-c4f5e155b5f6 service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Received unexpected event network-vif-plugged-1180e78d-2144-45a5-a958-567420edf02a for instance with vm_state building and task_state spawning.
Aug 27 06:42:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d166d57f-12b1-4077-8450-2a68fe657175]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.compute.manager [req-13a0037a-cb4c-4208-a950-c5e471cd1d1f req-c485bad3-7e8a-484c-ac55-2bd5b227027e service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Received event network-vif-unplugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-13a0037a-cb4c-4208-a950-c5e471cd1d1f req-c485bad3-7e8a-484c-ac55-2bd5b227027e service nova] Acquiring lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-13a0037a-cb4c-4208-a950-c5e471cd1d1f req-c485bad3-7e8a-484c-ac55-2bd5b227027e service nova] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-13a0037a-cb4c-4208-a950-c5e471cd1d1f req-c485bad3-7e8a-484c-ac55-2bd5b227027e service nova] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.compute.manager [req-13a0037a-cb4c-4208-a950-c5e471cd1d1f req-c485bad3-7e8a-484c-ac55-2bd5b227027e service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] No waiting events found dispatching network-vif-unplugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:55 user nova-compute[73258]: WARNING nova.compute.manager [req-13a0037a-cb4c-4208-a950-c5e471cd1d1f req-c485bad3-7e8a-484c-ac55-2bd5b227027e service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Received unexpected event network-vif-unplugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 for instance with vm_state active and task_state rebuilding.
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f740c5-14f4-4966-8d76-510dd194d337]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118575.220054, 21e7abcc-86a6-4315-9a84-9efcc907156f => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:42:55 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] VM Resumed (Lifecycle Event)
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:42:55 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Instance spawned successfully.
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f3cbac-53a1-416d-aa8e-3fda3df1243f]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:42:55 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118575.220206, 21e7abcc-86a6-4315-9a84-9efcc907156f => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:42:55 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] VM Started (Lifecycle Event)
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee59e57d-8954-42ce-a5f8-a55787cf29c9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:42:55 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:42:55 user nova-compute[73258]: INFO nova.compute.manager [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Took 8.64 seconds to spawn the instance on the hypervisor.
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --logout" returned: 0 in 0.112s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba7e66d-ea0d-48b4-a5d2-27eaaf14a30b]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c, portal: 172.16.0.220,3260]
Aug 27 06:42:55 user nova-compute[73258]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c, portal: 172.16.0.220,3260] successful.
Aug 27 06:42:55 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fc0c2f-3f81-4f31-bf43-9855faca610e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] <== disconnect_volume: return (400ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:42:55 user nova-compute[73258]: INFO nova.compute.manager [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Took 10.38 seconds to build instance.
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-235eab51-d429-4521-9036-cce4fa089b62 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.525s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.compute.manager [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-changed-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.compute.manager [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Refreshing instance network info cache due to event network-changed-a695f0b6-9494-4a0c-9bd1-853631b8d8f4. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] Acquiring lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] Acquired lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:42:55 user nova-compute[73258]: DEBUG nova.network.neutron [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Refreshing network info cache for port a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:56 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Instance destroyed successfully.
Aug 27 06:42:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:40:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-968445551',display_name='tempest-ServerActionsTestOtherA-server-581411342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-968445551',id=17,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdMnm+iJuT1xHxSDO3grlX9YhSVQuwPM7dsQXKJfx/OYDCb58PWILkOo0/JLzQygTw7Q96Wku55I12d7cqqFJX+FkBYpsqqlHI6UIfaBvOqiUrbrpnkTTfTzPPZnAM/+Q==',key_name='tempest-keypair-1720190692',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='57faf7cb6c704c05aba06857a6cdd29f',ramdisk_id='',reservation_id='r-62w17hhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1477462030',owner_user_name='tempest-ServerActionsTestOtherA-1477462030-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:42:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f8a06ab5634f60b6ed2d1d9b2c342e',uuid=4a2970a3-2a05-4462-bf0b-1595743222fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "address": "fa:16:3e:d3:c2:3b", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85410bb9-db", "ovs_interfaceid": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converting VIF {"id": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "address": "fa:16:3e:d3:c2:3b", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85410bb9-db", "ovs_interfaceid": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:c2:3b,bridge_name='br-int',has_traffic_filtering=True,id=85410bb9-dbd6-481c-a090-46d04e0d54b6,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85410bb9-db') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG os_vif [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:c2:3b,bridge_name='br-int',has_traffic_filtering=True,id=85410bb9-dbd6-481c-a090-46d04e0d54b6,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85410bb9-db') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85410bb9-db, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:42:56 user nova-compute[73258]: INFO os_vif [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:c2:3b,bridge_name='br-int',has_traffic_filtering=True,id=85410bb9-dbd6-481c-a090-46d04e0d54b6,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85410bb9-db')
Aug 27 06:42:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TirxAwPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:42:56 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 06:42:56 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c567cc-8802-4fb0-b6da-86ee99098191]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d4153d-0dbe-48cf-950a-07a39204e9c2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:42:56 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:42:56 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa441f00c10>, {}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Disconnecting from: [] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] <== disconnect_volume: return (77ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:42:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:42:56 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Deleting instance files /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb_del
Aug 27 06:42:56 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Deletion of /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb_del complete
Aug 27 06:42:56 user nova-compute[73258]: INFO nova.virt.block_device [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Booting with volume 15319228-580b-4a94-aa25-32c646a7c19c at /dev/vdb
Aug 27 06:42:57 user nova-compute[73258]: DEBUG os_brick.utils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a29488-d9fc-4896-ae43-e2266fe291a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6b878d-04a0-4c3a-88e3-8dc5b355bc6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2f514b-f590-4a0c-947f-e0c6e60a9e98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b797ee-acaf-48aa-aa0f-00f73577d87c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:42:57 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c5ef84-9e8f-461f-896f-96df3683250f]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG os_brick.utils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Updating existing volume attachment record: 22bdb05b-d133-4910-ab67-d65ec5da16ef {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG nova.compute.manager [req-daa78872-7176-4fcd-bfdf-d735718ca78d req-a358481e-7b49-4e46-a800-3967b3d1fa99 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Received event network-vif-plugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-daa78872-7176-4fcd-bfdf-d735718ca78d req-a358481e-7b49-4e46-a800-3967b3d1fa99 service nova] Acquiring lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-daa78872-7176-4fcd-bfdf-d735718ca78d req-a358481e-7b49-4e46-a800-3967b3d1fa99 service nova] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-daa78872-7176-4fcd-bfdf-d735718ca78d req-a358481e-7b49-4e46-a800-3967b3d1fa99 service nova] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG nova.compute.manager [req-daa78872-7176-4fcd-bfdf-d735718ca78d req-a358481e-7b49-4e46-a800-3967b3d1fa99 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] No waiting events found dispatching network-vif-plugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:57 user nova-compute[73258]: WARNING nova.compute.manager [req-daa78872-7176-4fcd-bfdf-d735718ca78d req-a358481e-7b49-4e46-a800-3967b3d1fa99 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Received unexpected event network-vif-plugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 27 06:42:57 user nova-compute[73258]: DEBUG nova.network.neutron [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Updated VIF entry in instance network info cache for port a695f0b6-9494-4a0c-9bd1-853631b8d8f4. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG nova.network.neutron [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Updating instance_info_cache with network_info: [{"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] Releasing lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG nova.compute.manager [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-changed-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG nova.compute.manager [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Refreshing instance network info cache due to event network-changed-a695f0b6-9494-4a0c-9bd1-853631b8d8f4. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] Acquiring lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] Acquired lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:42:57 user nova-compute[73258]: DEBUG nova.network.neutron [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Refreshing network info cache for port a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG nova.compute.manager [req-955848f7-9484-4ad2-bdc8-43aae7bd3b6c req-eda85165-388a-4fbf-a5e3-953202830cb2 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-vif-unplugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-955848f7-9484-4ad2-bdc8-43aae7bd3b6c req-eda85165-388a-4fbf-a5e3-953202830cb2 service nova] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-955848f7-9484-4ad2-bdc8-43aae7bd3b6c req-eda85165-388a-4fbf-a5e3-953202830cb2 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-955848f7-9484-4ad2-bdc8-43aae7bd3b6c req-eda85165-388a-4fbf-a5e3-953202830cb2 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG nova.compute.manager [req-955848f7-9484-4ad2-bdc8-43aae7bd3b6c req-eda85165-388a-4fbf-a5e3-953202830cb2 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] No waiting events found dispatching network-vif-unplugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:58 user nova-compute[73258]: WARNING nova.compute.manager [req-955848f7-9484-4ad2-bdc8-43aae7bd3b6c req-eda85165-388a-4fbf-a5e3-953202830cb2 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received unexpected event network-vif-unplugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:42:58 user nova-compute[73258]: DEBUG nova.compute.manager [req-955848f7-9484-4ad2-bdc8-43aae7bd3b6c req-eda85165-388a-4fbf-a5e3-953202830cb2 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-955848f7-9484-4ad2-bdc8-43aae7bd3b6c req-eda85165-388a-4fbf-a5e3-953202830cb2 service nova] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-955848f7-9484-4ad2-bdc8-43aae7bd3b6c req-eda85165-388a-4fbf-a5e3-953202830cb2 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-955848f7-9484-4ad2-bdc8-43aae7bd3b6c req-eda85165-388a-4fbf-a5e3-953202830cb2 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG nova.compute.manager [req-955848f7-9484-4ad2-bdc8-43aae7bd3b6c req-eda85165-388a-4fbf-a5e3-953202830cb2 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] No waiting events found dispatching network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:58 user nova-compute[73258]: WARNING nova.compute.manager [req-955848f7-9484-4ad2-bdc8-43aae7bd3b6c req-eda85165-388a-4fbf-a5e3-953202830cb2 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received unexpected event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:42:58 user nova-compute[73258]: DEBUG nova.compute.manager [req-955848f7-9484-4ad2-bdc8-43aae7bd3b6c req-eda85165-388a-4fbf-a5e3-953202830cb2 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-955848f7-9484-4ad2-bdc8-43aae7bd3b6c req-eda85165-388a-4fbf-a5e3-953202830cb2 service nova] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-955848f7-9484-4ad2-bdc8-43aae7bd3b6c req-eda85165-388a-4fbf-a5e3-953202830cb2 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-955848f7-9484-4ad2-bdc8-43aae7bd3b6c req-eda85165-388a-4fbf-a5e3-953202830cb2 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG nova.compute.manager [req-955848f7-9484-4ad2-bdc8-43aae7bd3b6c req-eda85165-388a-4fbf-a5e3-953202830cb2 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] No waiting events found dispatching network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:58 user nova-compute[73258]: WARNING nova.compute.manager [req-955848f7-9484-4ad2-bdc8-43aae7bd3b6c req-eda85165-388a-4fbf-a5e3-953202830cb2 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received unexpected event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:42:58 user nova-compute[73258]: DEBUG nova.network.neutron [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Updated VIF entry in instance network info cache for port a695f0b6-9494-4a0c-9bd1-853631b8d8f4. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG nova.network.neutron [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Updating instance_info_cache with network_info: [{"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] Releasing lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG nova.compute.manager [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG nova.compute.manager [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] No waiting events found dispatching network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:58 user nova-compute[73258]: WARNING nova.compute.manager [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received unexpected event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:42:58 user nova-compute[73258]: DEBUG nova.compute.manager [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG nova.compute.manager [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] No waiting events found dispatching network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:58 user nova-compute[73258]: WARNING nova.compute.manager [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received unexpected event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:42:58 user nova-compute[73258]: DEBUG nova.compute.manager [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:42:58 user nova-compute[73258]: DEBUG nova.compute.manager [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] No waiting events found dispatching network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:42:58 user nova-compute[73258]: WARNING nova.compute.manager [req-c8d22d95-c907-437a-a35e-68e356c9ae38 req-d3129232-227c-4efd-933e-f71454e33e0f service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received unexpected event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:42:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:42:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Removed pending event for 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae due to event {{(pid=73258) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 06:42:59 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118579.0482836, 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:42:59 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] VM Resumed (Lifecycle Event)
Aug 27 06:42:59 user nova-compute[73258]: DEBUG nova.compute.manager [None req-785a1fc6-ff48-4a3f-be21-b3b5d7ed0166 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:42:59 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:42:59 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:42:59 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118579.0521336, 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:42:59 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] VM Started (Lifecycle Event)
Aug 27 06:42:59 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:42:59 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:43:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:00 user nova-compute[73258]: DEBUG nova.compute.manager [req-2daac020-bddc-428a-a1a8-97408e78bfd9 req-a5bef4fb-0eb2-457c-a081-565408723f94 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:43:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2daac020-bddc-428a-a1a8-97408e78bfd9 req-a5bef4fb-0eb2-457c-a081-565408723f94 service nova] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2daac020-bddc-428a-a1a8-97408e78bfd9 req-a5bef4fb-0eb2-457c-a081-565408723f94 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2daac020-bddc-428a-a1a8-97408e78bfd9 req-a5bef4fb-0eb2-457c-a081-565408723f94 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:00 user nova-compute[73258]: DEBUG nova.compute.manager [req-2daac020-bddc-428a-a1a8-97408e78bfd9 req-a5bef4fb-0eb2-457c-a081-565408723f94 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] No waiting events found dispatching network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:43:00 user nova-compute[73258]: WARNING nova.compute.manager [req-2daac020-bddc-428a-a1a8-97408e78bfd9 req-a5bef4fb-0eb2-457c-a081-565408723f94 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received unexpected event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 for instance with vm_state active and task_state None.
Aug 27 06:43:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:01 user nova-compute[73258]: DEBUG nova.compute.manager [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:43:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:43:01 user nova-compute[73258]: INFO nova.compute.claims [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Claim successful on node user
Aug 27 06:43:02 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:43:02 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:43:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.770s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:02 user nova-compute[73258]: DEBUG nova.compute.manager [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:43:02 user nova-compute[73258]: DEBUG nova.compute.manager [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:43:02 user nova-compute[73258]: DEBUG nova.network.neutron [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:43:02 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:43:02 user nova-compute[73258]: DEBUG nova.compute.manager [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:43:02 user nova-compute[73258]: DEBUG nova.policy [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e3b8e4e749b4d039b4d5ebdc6469151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191ca81ae335419aa935b1b7576b12ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:43:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:02 user nova-compute[73258]: DEBUG nova.compute.manager [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:43:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:43:02 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Creating image(s)
Aug 27 06:43:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "/opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "/opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "/opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.228s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.267s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk 1073741824" returned: 0 in 0.055s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.216s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Cannot resize image /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Ensure instance console log exists: /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG nova.network.neutron [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Successfully created port: 7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:43:03 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118568.9747596, e0e28ddd-fdc0-4db2-a4d5-64b9a724f943 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:43:03 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] VM Stopped (Lifecycle Event)
Aug 27 06:43:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-5451a41d-0b73-4d00-9d76-5545f551794b None None] [instance: e0e28ddd-fdc0-4db2-a4d5-64b9a724f943] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:43:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquiring lock "8396ca48-c47c-41b1-9872-24dbb0b9f526" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "8396ca48-c47c-41b1-9872-24dbb0b9f526" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:43:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:43:04 user nova-compute[73258]: INFO nova.compute.claims [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Claim successful on node user
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.network.neutron [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Successfully updated port: 7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "refresh_cache-9517c681-ed2b-49c2-94a6-aa2181b4b62f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquired lock "refresh_cache-9517c681-ed2b-49c2-94a6-aa2181b4b62f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.network.neutron [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.compute.manager [req-79085279-2071-4d58-a58d-1d8819329ea2 req-fd2cb126-91bc-40f7-8d4f-c9bc632c08d9 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-changed-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.compute.manager [req-79085279-2071-4d58-a58d-1d8819329ea2 req-fd2cb126-91bc-40f7-8d4f-c9bc632c08d9 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Refreshing instance network info cache due to event network-changed-7b4375ea-f74b-4677-a768-97e96029c237. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-79085279-2071-4d58-a58d-1d8819329ea2 req-fd2cb126-91bc-40f7-8d4f-c9bc632c08d9 service nova] Acquiring lock "refresh_cache-9517c681-ed2b-49c2-94a6-aa2181b4b62f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.network.neutron [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.network.neutron [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Updating instance_info_cache with network_info: [{"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.867s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.compute.manager [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Releasing lock "refresh_cache-9517c681-ed2b-49c2-94a6-aa2181b4b62f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.compute.manager [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Instance network_info: |[{"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-79085279-2071-4d58-a58d-1d8819329ea2 req-fd2cb126-91bc-40f7-8d4f-c9bc632c08d9 service nova] Acquired lock "refresh_cache-9517c681-ed2b-49c2-94a6-aa2181b4b62f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.network.neutron [req-79085279-2071-4d58-a58d-1d8819329ea2 req-fd2cb126-91bc-40f7-8d4f-c9bc632c08d9 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Refreshing network info cache for port 7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Start _get_guest_xml network_info=[{"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:43:05 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:43:05 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:43:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1573525836',display_name='tempest-AttachVolumeTestJSON-server-1573525836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1573525836',id=20,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuhlWzl340MR8vuL4wDTAkmN5hCJUdQIIyuqJCteVnLZ+c/yoSQsUNeq9gc2CsDlviPIALHDhlmzrpmhT0dESkXG7J9YKzWGCIInu7/GNC69QhJ+6s+eSD+zVfJ71qniA==',key_name='tempest-keypair-2145652813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='191ca81ae335419aa935b1b7576b12ff',ramdisk_id='',reservation_id='r-nh0b3aah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1777325696',owner_user_name='tempest-AttachVolumeTestJSON-1777325696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:43:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e3b8e4e749b4d039b4d5ebdc6469151',uuid=9517c681-ed2b-49c2-94a6-aa2181b4b62f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converting VIF {"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.objects.instance [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'pci_devices' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:43:05 user nova-compute[73258]:   <uuid>9517c681-ed2b-49c2-94a6-aa2181b4b62f</uuid>
Aug 27 06:43:05 user nova-compute[73258]:   <name>instance-00000014</name>
Aug 27 06:43:05 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:43:05 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:43:05 user nova-compute[73258]:   <metadata>
Aug 27 06:43:05 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:43:05 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:43:05 user nova-compute[73258]:       <nova:name>tempest-AttachVolumeTestJSON-server-1573525836</nova:name>
Aug 27 06:43:05 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:43:05</nova:creationTime>
Aug 27 06:43:05 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:43:05 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:43:05 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:43:05 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:43:05 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:43:05 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:43:05 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:43:05 user nova-compute[73258]:       <nova:owner>
Aug 27 06:43:05 user nova-compute[73258]:         <nova:user uuid="9e3b8e4e749b4d039b4d5ebdc6469151">tempest-AttachVolumeTestJSON-1777325696-project-member</nova:user>
Aug 27 06:43:05 user nova-compute[73258]:         <nova:project uuid="191ca81ae335419aa935b1b7576b12ff">tempest-AttachVolumeTestJSON-1777325696</nova:project>
Aug 27 06:43:05 user nova-compute[73258]:       </nova:owner>
Aug 27 06:43:05 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:43:05 user nova-compute[73258]:       <nova:ports>
Aug 27 06:43:05 user nova-compute[73258]:         <nova:port uuid="7b4375ea-f74b-4677-a768-97e96029c237">
Aug 27 06:43:05 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 06:43:05 user nova-compute[73258]:         </nova:port>
Aug 27 06:43:05 user nova-compute[73258]:       </nova:ports>
Aug 27 06:43:05 user nova-compute[73258]:     </nova:instance>
Aug 27 06:43:05 user nova-compute[73258]:   </metadata>
Aug 27 06:43:05 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:43:05 user nova-compute[73258]:     <system>
Aug 27 06:43:05 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:43:05 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:43:05 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:43:05 user nova-compute[73258]:       <entry name="serial">9517c681-ed2b-49c2-94a6-aa2181b4b62f</entry>
Aug 27 06:43:05 user nova-compute[73258]:       <entry name="uuid">9517c681-ed2b-49c2-94a6-aa2181b4b62f</entry>
Aug 27 06:43:05 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:43:05 user nova-compute[73258]:     </system>
Aug 27 06:43:05 user nova-compute[73258]:   </sysinfo>
Aug 27 06:43:05 user nova-compute[73258]:   <os>
Aug 27 06:43:05 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:43:05 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:43:05 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:43:05 user nova-compute[73258]:   </os>
Aug 27 06:43:05 user nova-compute[73258]:   <features>
Aug 27 06:43:05 user nova-compute[73258]:     <acpi/>
Aug 27 06:43:05 user nova-compute[73258]:     <apic/>
Aug 27 06:43:05 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:43:05 user nova-compute[73258]:   </features>
Aug 27 06:43:05 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:43:05 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:43:05 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:43:05 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:43:05 user nova-compute[73258]:   </clock>
Aug 27 06:43:05 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:43:05 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:43:05 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:43:05 user nova-compute[73258]:   </cpu>
Aug 27 06:43:05 user nova-compute[73258]:   <devices>
Aug 27 06:43:05 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:43:05 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:43:05 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk"/>
Aug 27 06:43:05 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:43:05 user nova-compute[73258]:     </disk>
Aug 27 06:43:05 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:43:05 user nova-compute[73258]:       <mac address="fa:16:3e:f5:fe:36"/>
Aug 27 06:43:05 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:43:05 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:43:05 user nova-compute[73258]:       <target dev="tap7b4375ea-f7"/>
Aug 27 06:43:05 user nova-compute[73258]:     </interface>
Aug 27 06:43:05 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:43:05 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/console.log" append="off"/>
Aug 27 06:43:05 user nova-compute[73258]:     </serial>
Aug 27 06:43:05 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:43:05 user nova-compute[73258]:     <video>
Aug 27 06:43:05 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:43:05 user nova-compute[73258]:     </video>
Aug 27 06:43:05 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:43:05 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:43:05 user nova-compute[73258]:     </rng>
Aug 27 06:43:05 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:43:05 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:43:05 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:43:05 user nova-compute[73258]:     </memballoon>
Aug 27 06:43:05 user nova-compute[73258]:   </devices>
Aug 27 06:43:05 user nova-compute[73258]: </domain>
Aug 27 06:43:05 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:43:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1573525836',display_name='tempest-AttachVolumeTestJSON-server-1573525836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1573525836',id=20,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuhlWzl340MR8vuL4wDTAkmN5hCJUdQIIyuqJCteVnLZ+c/yoSQsUNeq9gc2CsDlviPIALHDhlmzrpmhT0dESkXG7J9YKzWGCIInu7/GNC69QhJ+6s+eSD+zVfJ71qniA==',key_name='tempest-keypair-2145652813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='191ca81ae335419aa935b1b7576b12ff',ramdisk_id='',reservation_id='r-nh0b3aah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1777325696',owner_user_name='tempest-AttachVolumeTestJSON-1777325696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:43:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e3b8e4e749b4d039b4d5ebdc6469151',uuid=9517c681-ed2b-49c2-94a6-aa2181b4b62f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converting VIF {"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG os_vif [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.compute.manager [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.network.neutron [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:43:05 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:43:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b4375ea-f7, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7b4375ea-f7, col_values=(('external_ids', {'iface-id': '7b4375ea-f74b-4677-a768-97e96029c237', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:fe:36', 'vm-uuid': '9517c681-ed2b-49c2-94a6-aa2181b4b62f'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:43:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:05 user nova-compute[73258]: INFO os_vif [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7')
Aug 27 06:43:05 user nova-compute[73258]: DEBUG nova.compute.manager [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] No VIF found with MAC fa:16:3e:f5:fe:36, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:43:06 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Creating image(s)
Aug 27 06:43:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquiring lock "/opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "/opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "/opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG nova.policy [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bd578ee905a49e88abe9c72668bc1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b4cd365934e568225156ab305cda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.296s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG nova.network.neutron [req-79085279-2071-4d58-a58d-1d8819329ea2 req-fd2cb126-91bc-40f7-8d4f-c9bc632c08d9 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Updated VIF entry in instance network info cache for port 7b4375ea-f74b-4677-a768-97e96029c237. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG nova.network.neutron [req-79085279-2071-4d58-a58d-1d8819329ea2 req-fd2cb126-91bc-40f7-8d4f-c9bc632c08d9 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Updating instance_info_cache with network_info: [{"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-79085279-2071-4d58-a58d-1d8819329ea2 req-fd2cb126-91bc-40f7-8d4f-c9bc632c08d9 service nova] Releasing lock "refresh_cache-9517c681-ed2b-49c2-94a6-aa2181b4b62f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.270s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk 1073741824" returned: 0 in 0.070s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.347s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.226s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:07 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:43:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:07 user nova-compute[73258]: DEBUG nova.network.neutron [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Successfully created port: 88db4c6e-c521-4efa-8311-ba38294ef3fe {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:43:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json" returned: 0 in 0.420s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:07 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Cannot resize image /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:43:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:43:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Ensure instance console log exists: /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:43:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-ab1ea772-f99a-4d42-8862-16e78577c4ab req-6d3abda9-ad67-4d4c-b5b2-e2336727a89f service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:43:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ab1ea772-f99a-4d42-8862-16e78577c4ab req-6d3abda9-ad67-4d4c-b5b2-e2336727a89f service nova] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ab1ea772-f99a-4d42-8862-16e78577c4ab req-6d3abda9-ad67-4d4c-b5b2-e2336727a89f service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ab1ea772-f99a-4d42-8862-16e78577c4ab req-6d3abda9-ad67-4d4c-b5b2-e2336727a89f service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-ab1ea772-f99a-4d42-8862-16e78577c4ab req-6d3abda9-ad67-4d4c-b5b2-e2336727a89f service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] No waiting events found dispatching network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:43:08 user nova-compute[73258]: WARNING nova.compute.manager [req-ab1ea772-f99a-4d42-8862-16e78577c4ab req-6d3abda9-ad67-4d4c-b5b2-e2336727a89f service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received unexpected event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 for instance with vm_state building and task_state spawning.
Aug 27 06:43:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:08 user nova-compute[73258]: DEBUG nova.network.neutron [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Successfully updated port: 88db4c6e-c521-4efa-8311-ba38294ef3fe {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:43:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquiring lock "refresh_cache-8396ca48-c47c-41b1-9872-24dbb0b9f526" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:43:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquired lock "refresh_cache-8396ca48-c47c-41b1-9872-24dbb0b9f526" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:43:08 user nova-compute[73258]: DEBUG nova.network.neutron [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:43:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-942e72ad-7779-4a55-89af-d67da0125727 req-79ecea91-32fc-4403-a21a-e3a3cf73e964 service nova] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Received event network-changed-88db4c6e-c521-4efa-8311-ba38294ef3fe {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:43:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-942e72ad-7779-4a55-89af-d67da0125727 req-79ecea91-32fc-4403-a21a-e3a3cf73e964 service nova] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Refreshing instance network info cache due to event network-changed-88db4c6e-c521-4efa-8311-ba38294ef3fe. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:43:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-942e72ad-7779-4a55-89af-d67da0125727 req-79ecea91-32fc-4403-a21a-e3a3cf73e964 service nova] Acquiring lock "refresh_cache-8396ca48-c47c-41b1-9872-24dbb0b9f526" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:43:08 user nova-compute[73258]: DEBUG nova.network.neutron [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:43:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.network.neutron [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Updating instance_info_cache with network_info: [{"id": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "address": "fa:16:3e:c0:6e:7e", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db4c6e-c5", "ovs_interfaceid": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Releasing lock "refresh_cache-8396ca48-c47c-41b1-9872-24dbb0b9f526" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.compute.manager [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Instance network_info: |[{"id": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "address": "fa:16:3e:c0:6e:7e", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db4c6e-c5", "ovs_interfaceid": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-942e72ad-7779-4a55-89af-d67da0125727 req-79ecea91-32fc-4403-a21a-e3a3cf73e964 service nova] Acquired lock "refresh_cache-8396ca48-c47c-41b1-9872-24dbb0b9f526" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.network.neutron [req-942e72ad-7779-4a55-89af-d67da0125727 req-79ecea91-32fc-4403-a21a-e3a3cf73e964 service nova] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Refreshing network info cache for port 88db4c6e-c521-4efa-8311-ba38294ef3fe {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Start _get_guest_xml network_info=[{"id": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "address": "fa:16:3e:c0:6e:7e", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db4c6e-c5", "ovs_interfaceid": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:43:09 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:43:09 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-976425331',display_name='tempest-ServersNegativeTestJSON-server-976425331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-976425331',id=21,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11b4cd365934e568225156ab305cda2',ramdisk_id='',reservation_id='r-48ic0eo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1353100795',owner_user_name='tempest-ServersNegativeTestJSON-1353100795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:43:06Z,user_data=None,user_id='7bd578ee905a49e88abe9c72668bc1dd',uuid=8396ca48-c47c-41b1-9872-24dbb0b9f526,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "address": "fa:16:3e:c0:6e:7e", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db4c6e-c5", "ovs_interfaceid": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Converting VIF {"id": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "address": "fa:16:3e:c0:6e:7e", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db4c6e-c5", "ovs_interfaceid": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6e:7e,bridge_name='br-int',has_traffic_filtering=True,id=88db4c6e-c521-4efa-8311-ba38294ef3fe,network=Network(baf86837-de09-4d7d-a6a1-36fb8bf7bf68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88db4c6e-c5') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.objects.instance [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lazy-loading 'pci_devices' on Instance uuid 8396ca48-c47c-41b1-9872-24dbb0b9f526 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:43:09 user nova-compute[73258]:   <uuid>8396ca48-c47c-41b1-9872-24dbb0b9f526</uuid>
Aug 27 06:43:09 user nova-compute[73258]:   <name>instance-00000015</name>
Aug 27 06:43:09 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:43:09 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:43:09 user nova-compute[73258]:   <metadata>
Aug 27 06:43:09 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:43:09 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:43:09 user nova-compute[73258]:       <nova:name>tempest-ServersNegativeTestJSON-server-976425331</nova:name>
Aug 27 06:43:09 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:43:09</nova:creationTime>
Aug 27 06:43:09 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:43:09 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:43:09 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:43:09 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:43:09 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:43:09 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:43:09 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:43:09 user nova-compute[73258]:       <nova:owner>
Aug 27 06:43:09 user nova-compute[73258]:         <nova:user uuid="7bd578ee905a49e88abe9c72668bc1dd">tempest-ServersNegativeTestJSON-1353100795-project-member</nova:user>
Aug 27 06:43:09 user nova-compute[73258]:         <nova:project uuid="e11b4cd365934e568225156ab305cda2">tempest-ServersNegativeTestJSON-1353100795</nova:project>
Aug 27 06:43:09 user nova-compute[73258]:       </nova:owner>
Aug 27 06:43:09 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:43:09 user nova-compute[73258]:       <nova:ports>
Aug 27 06:43:09 user nova-compute[73258]:         <nova:port uuid="88db4c6e-c521-4efa-8311-ba38294ef3fe">
Aug 27 06:43:09 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 06:43:09 user nova-compute[73258]:         </nova:port>
Aug 27 06:43:09 user nova-compute[73258]:       </nova:ports>
Aug 27 06:43:09 user nova-compute[73258]:     </nova:instance>
Aug 27 06:43:09 user nova-compute[73258]:   </metadata>
Aug 27 06:43:09 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:43:09 user nova-compute[73258]:     <system>
Aug 27 06:43:09 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:43:09 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:43:09 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:43:09 user nova-compute[73258]:       <entry name="serial">8396ca48-c47c-41b1-9872-24dbb0b9f526</entry>
Aug 27 06:43:09 user nova-compute[73258]:       <entry name="uuid">8396ca48-c47c-41b1-9872-24dbb0b9f526</entry>
Aug 27 06:43:09 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:43:09 user nova-compute[73258]:     </system>
Aug 27 06:43:09 user nova-compute[73258]:   </sysinfo>
Aug 27 06:43:09 user nova-compute[73258]:   <os>
Aug 27 06:43:09 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:43:09 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:43:09 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:43:09 user nova-compute[73258]:   </os>
Aug 27 06:43:09 user nova-compute[73258]:   <features>
Aug 27 06:43:09 user nova-compute[73258]:     <acpi/>
Aug 27 06:43:09 user nova-compute[73258]:     <apic/>
Aug 27 06:43:09 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:43:09 user nova-compute[73258]:   </features>
Aug 27 06:43:09 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:43:09 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:43:09 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:43:09 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:43:09 user nova-compute[73258]:   </clock>
Aug 27 06:43:09 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:43:09 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:43:09 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:43:09 user nova-compute[73258]:   </cpu>
Aug 27 06:43:09 user nova-compute[73258]:   <devices>
Aug 27 06:43:09 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:43:09 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:43:09 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk"/>
Aug 27 06:43:09 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:43:09 user nova-compute[73258]:     </disk>
Aug 27 06:43:09 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:43:09 user nova-compute[73258]:       <mac address="fa:16:3e:c0:6e:7e"/>
Aug 27 06:43:09 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:43:09 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:43:09 user nova-compute[73258]:       <target dev="tap88db4c6e-c5"/>
Aug 27 06:43:09 user nova-compute[73258]:     </interface>
Aug 27 06:43:09 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:43:09 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/console.log" append="off"/>
Aug 27 06:43:09 user nova-compute[73258]:     </serial>
Aug 27 06:43:09 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:43:09 user nova-compute[73258]:     <video>
Aug 27 06:43:09 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:43:09 user nova-compute[73258]:     </video>
Aug 27 06:43:09 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:43:09 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:43:09 user nova-compute[73258]:     </rng>
Aug 27 06:43:09 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:43:09 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:43:09 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:43:09 user nova-compute[73258]:     </memballoon>
Aug 27 06:43:09 user nova-compute[73258]:   </devices>
Aug 27 06:43:09 user nova-compute[73258]: </domain>
Aug 27 06:43:09 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-976425331',display_name='tempest-ServersNegativeTestJSON-server-976425331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-976425331',id=21,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11b4cd365934e568225156ab305cda2',ramdisk_id='',reservation_id='r-48ic0eo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1353100795',owner_user_name='tempest-ServersNegativeTestJSON-1353100795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:43:06Z,user_data=None,user_id='7bd578ee905a49e88abe9c72668bc1dd',uuid=8396ca48-c47c-41b1-9872-24dbb0b9f526,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "address": "fa:16:3e:c0:6e:7e", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db4c6e-c5", "ovs_interfaceid": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Converting VIF {"id": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "address": "fa:16:3e:c0:6e:7e", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db4c6e-c5", "ovs_interfaceid": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6e:7e,bridge_name='br-int',has_traffic_filtering=True,id=88db4c6e-c521-4efa-8311-ba38294ef3fe,network=Network(baf86837-de09-4d7d-a6a1-36fb8bf7bf68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88db4c6e-c5') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG os_vif [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6e:7e,bridge_name='br-int',has_traffic_filtering=True,id=88db4c6e-c521-4efa-8311-ba38294ef3fe,network=Network(baf86837-de09-4d7d-a6a1-36fb8bf7bf68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88db4c6e-c5') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88db4c6e-c5, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap88db4c6e-c5, col_values=(('external_ids', {'iface-id': '88db4c6e-c521-4efa-8311-ba38294ef3fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:6e:7e', 'vm-uuid': '8396ca48-c47c-41b1-9872-24dbb0b9f526'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:09 user nova-compute[73258]: INFO os_vif [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6e:7e,bridge_name='br-int',has_traffic_filtering=True,id=88db4c6e-c521-4efa-8311-ba38294ef3fe,network=Network(baf86837-de09-4d7d-a6a1-36fb8bf7bf68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88db4c6e-c5')
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] No VIF found with MAC fa:16:3e:c0:6e:7e, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118574.633316, 4a2970a3-2a05-4462-bf0b-1595743222fb => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:43:09 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] VM Stopped (Lifecycle Event)
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.compute.manager [None req-1813ad5b-dd7a-44dd-ae26-9fca3ba30348 None None] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.network.neutron [req-942e72ad-7779-4a55-89af-d67da0125727 req-79ecea91-32fc-4403-a21a-e3a3cf73e964 service nova] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Updated VIF entry in instance network info cache for port 88db4c6e-c521-4efa-8311-ba38294ef3fe. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG nova.network.neutron [req-942e72ad-7779-4a55-89af-d67da0125727 req-79ecea91-32fc-4403-a21a-e3a3cf73e964 service nova] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Updating instance_info_cache with network_info: [{"id": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "address": "fa:16:3e:c0:6e:7e", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db4c6e-c5", "ovs_interfaceid": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:43:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-942e72ad-7779-4a55-89af-d67da0125727 req-79ecea91-32fc-4403-a21a-e3a3cf73e964 service nova] Releasing lock "refresh_cache-8396ca48-c47c-41b1-9872-24dbb0b9f526" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:43:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-d7a25133-0ab6-4737-8d5f-1ea05d7dc8ee req-5c0ed2ea-b3f8-4c15-b7ff-af43ecda63ee service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:43:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d7a25133-0ab6-4737-8d5f-1ea05d7dc8ee req-5c0ed2ea-b3f8-4c15-b7ff-af43ecda63ee service nova] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d7a25133-0ab6-4737-8d5f-1ea05d7dc8ee req-5c0ed2ea-b3f8-4c15-b7ff-af43ecda63ee service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d7a25133-0ab6-4737-8d5f-1ea05d7dc8ee req-5c0ed2ea-b3f8-4c15-b7ff-af43ecda63ee service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-d7a25133-0ab6-4737-8d5f-1ea05d7dc8ee req-5c0ed2ea-b3f8-4c15-b7ff-af43ecda63ee service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] No waiting events found dispatching network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:43:10 user nova-compute[73258]: WARNING nova.compute.manager [req-d7a25133-0ab6-4737-8d5f-1ea05d7dc8ee req-5c0ed2ea-b3f8-4c15-b7ff-af43ecda63ee service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received unexpected event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 for instance with vm_state building and task_state spawning.
Aug 27 06:43:10 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118590.750678, 9517c681-ed2b-49c2-94a6-aa2181b4b62f => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:43:10 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] VM Resumed (Lifecycle Event)
Aug 27 06:43:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:43:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:43:10 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Instance spawned successfully.
Aug 27 06:43:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:43:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:43:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:43:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:10 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:43:10 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118590.7523928, 9517c681-ed2b-49c2-94a6-aa2181b4b62f => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:43:10 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] VM Started (Lifecycle Event)
Aug 27 06:43:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:43:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:43:10 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:43:10 user nova-compute[73258]: INFO nova.compute.manager [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Took 8.10 seconds to spawn the instance on the hypervisor.
Aug 27 06:43:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:43:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:11 user nova-compute[73258]: INFO nova.compute.manager [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Took 9.52 seconds to build instance.
Aug 27 06:43:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-35002298-874c-4999-865c-4cbcd8756fcf tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.660s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:11 user nova-compute[73258]: DEBUG nova.compute.manager [req-947277ab-b2bd-4f7a-a10a-050e9b0f4e49 req-0440beaa-e235-470e-94be-b09cfc7b5305 service nova] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Received event network-vif-plugged-88db4c6e-c521-4efa-8311-ba38294ef3fe {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:43:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-947277ab-b2bd-4f7a-a10a-050e9b0f4e49 req-0440beaa-e235-470e-94be-b09cfc7b5305 service nova] Acquiring lock "8396ca48-c47c-41b1-9872-24dbb0b9f526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-947277ab-b2bd-4f7a-a10a-050e9b0f4e49 req-0440beaa-e235-470e-94be-b09cfc7b5305 service nova] Lock "8396ca48-c47c-41b1-9872-24dbb0b9f526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-947277ab-b2bd-4f7a-a10a-050e9b0f4e49 req-0440beaa-e235-470e-94be-b09cfc7b5305 service nova] Lock "8396ca48-c47c-41b1-9872-24dbb0b9f526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:11 user nova-compute[73258]: DEBUG nova.compute.manager [req-947277ab-b2bd-4f7a-a10a-050e9b0f4e49 req-0440beaa-e235-470e-94be-b09cfc7b5305 service nova] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] No waiting events found dispatching network-vif-plugged-88db4c6e-c521-4efa-8311-ba38294ef3fe {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:43:11 user nova-compute[73258]: WARNING nova.compute.manager [req-947277ab-b2bd-4f7a-a10a-050e9b0f4e49 req-0440beaa-e235-470e-94be-b09cfc7b5305 service nova] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Received unexpected event network-vif-plugged-88db4c6e-c521-4efa-8311-ba38294ef3fe for instance with vm_state building and task_state spawning.
Aug 27 06:43:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:43:12 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Creating image(s)
Aug 27 06:43:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "/opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "/opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.230s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.248s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk 1073741824" returned: 0 in 0.065s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.196s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:12 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:43:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Cannot resize image /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Ensure instance console log exists: /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Start _get_guest_xml network_info=[{"id": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "address": "fa:16:3e:d3:c2:3b", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85410bb9-db", "ovs_interfaceid": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TirxAwPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4a2970a3-2a05-4462-bf0b-1595743222fb', 'attached_at': '', 'detached_at': '', 'volume_id': '15319228-580b-4a94-aa25-32c646a7c19c', 'serial': '15319228-580b-4a94-aa25-32c646a7c19c'}, 'attachment_id': '22bdb05b-d133-4910-ab67-d65ec5da16ef', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:43:13 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 06:43:13 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.objects.instance [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4a2970a3-2a05-4462-bf0b-1595743222fb {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TirxAwPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:43:13 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:43:13 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:43:13 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-f5241100-a6c2-4fc9-8230-e8e5df53ab45 req-2385d567-de14-49de-935c-ad205bdc617e service nova] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Received event network-vif-plugged-88db4c6e-c521-4efa-8311-ba38294ef3fe {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f5241100-a6c2-4fc9-8230-e8e5df53ab45 req-2385d567-de14-49de-935c-ad205bdc617e service nova] Acquiring lock "8396ca48-c47c-41b1-9872-24dbb0b9f526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f5241100-a6c2-4fc9-8230-e8e5df53ab45 req-2385d567-de14-49de-935c-ad205bdc617e service nova] Lock "8396ca48-c47c-41b1-9872-24dbb0b9f526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f5241100-a6c2-4fc9-8230-e8e5df53ab45 req-2385d567-de14-49de-935c-ad205bdc617e service nova] Lock "8396ca48-c47c-41b1-9872-24dbb0b9f526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-f5241100-a6c2-4fc9-8230-e8e5df53ab45 req-2385d567-de14-49de-935c-ad205bdc617e service nova] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] No waiting events found dispatching network-vif-plugged-88db4c6e-c521-4efa-8311-ba38294ef3fe {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:43:13 user nova-compute[73258]: WARNING nova.compute.manager [req-f5241100-a6c2-4fc9-8230-e8e5df53ab45 req-2385d567-de14-49de-935c-ad205bdc617e service nova] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Received unexpected event network-vif-plugged-88db4c6e-c521-4efa-8311-ba38294ef3fe for instance with vm_state building and task_state spawning.
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[94458608-13c4-45f2-b15b-322e62f75684]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:43:13 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaa8c72-8b92-47e6-8e10-2121ef4e83ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c] added
Aug 27 06:43:13 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[992f6ef5-5d29-4fb4-8a3c-d54a1c936dc6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1018579e-8018-4947-8a93-71305e659a93]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TirxAwPp {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TirxAwPp" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[072fb29e-37ab-45d6-85b8-092c6f1e1cd2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TirxAwPp'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c4b154-9ff2-4ae5-8221-a33022361abe]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c30bc8b-aa14-49c9-81b8-96be28160bfb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:43:13 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:43:13 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118593.6073234, 8396ca48-c47c-41b1-9872-24dbb0b9f526 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:43:13 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] VM Resumed (Lifecycle Event)
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91d1eed-4461-4777-97b1-0e6470e01533]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c, portal: 172.16.0.220,3260]
Aug 27 06:43:13 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c, portal: 172.16.0.220,3260] successful.
Aug 27 06:43:13 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:13 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Instance spawned successfully.
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[715a4cf1-67ba-4fa1-b8ad-317d6c5e5905]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a900b9-ceae-442f-8b99-98ae752b7a61]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:43:13 user nova-compute[73258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:43:13 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:43:13 user nova-compute[73258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:43:13 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[89eff5c2-efe2-4de8-ba65-b223b01bdf13]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TirxAwPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:43:13 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118593.612685, 8396ca48-c47c-41b1-9872-24dbb0b9f526 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:43:13 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] VM Started (Lifecycle Event)
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:43:13 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:43:13 user nova-compute[73258]: INFO nova.compute.manager [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Took 7.80 seconds to spawn the instance on the hypervisor.
Aug 27 06:43:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:43:14 user nova-compute[73258]: INFO nova.compute.manager [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Took 9.23 seconds to build instance.
Aug 27 06:43:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-61d98e5c-c3e1-482a-9933-d3f98ee15fe6 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "8396ca48-c47c-41b1-9872-24dbb0b9f526" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.378s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26662363730616132', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662363730616132', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T06:40:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-968445551',display_name='tempest-ServerActionsTestOtherA-server-581411342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-968445551',id=17,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdMnm+iJuT1xHxSDO3grlX9YhSVQuwPM7dsQXKJfx/OYDCb58PWILkOo0/JLzQygTw7Q96Wku55I12d7cqqFJX+FkBYpsqqlHI6UIfaBvOqiUrbrpnkTTfTzPPZnAM/+Q==',key_name='tempest-keypair-1720190692',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='57faf7cb6c704c05aba06857a6cdd29f',ramdisk_id='',reservation_id='r-62w17hhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1477462030',owner_user_name='tempest-ServerActionsTestOtherA-1477462030-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:42:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f8a06ab5634f60b6ed2d1d9b2c342e',uuid=4a2970a3-2a05-4462-bf0b-1595743222fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "address": "fa:16:3e:d3:c2:3b", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85410bb9-db", "ovs_interfaceid": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converting VIF {"id": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "address": "fa:16:3e:d3:c2:3b", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85410bb9-db", "ovs_interfaceid": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:c2:3b,bridge_name='br-int',has_traffic_filtering=True,id=85410bb9-dbd6-481c-a090-46d04e0d54b6,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85410bb9-db') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:43:14 user nova-compute[73258]:   <uuid>4a2970a3-2a05-4462-bf0b-1595743222fb</uuid>
Aug 27 06:43:14 user nova-compute[73258]:   <name>instance-00000011</name>
Aug 27 06:43:14 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:43:14 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:43:14 user nova-compute[73258]:   <metadata>
Aug 27 06:43:14 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:43:14 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:43:14 user nova-compute[73258]:       <nova:name>tempest-ServerActionsTestOtherA-server-581411342</nova:name>
Aug 27 06:43:14 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:43:13</nova:creationTime>
Aug 27 06:43:14 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:43:14 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:43:14 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:43:14 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:43:14 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:43:14 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:43:14 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:43:14 user nova-compute[73258]:       <nova:owner>
Aug 27 06:43:14 user nova-compute[73258]:         <nova:user uuid="67f8a06ab5634f60b6ed2d1d9b2c342e">tempest-ServerActionsTestOtherA-1477462030-project-member</nova:user>
Aug 27 06:43:14 user nova-compute[73258]:         <nova:project uuid="57faf7cb6c704c05aba06857a6cdd29f">tempest-ServerActionsTestOtherA-1477462030</nova:project>
Aug 27 06:43:14 user nova-compute[73258]:       </nova:owner>
Aug 27 06:43:14 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:43:14 user nova-compute[73258]:       <nova:ports>
Aug 27 06:43:14 user nova-compute[73258]:         <nova:port uuid="85410bb9-dbd6-481c-a090-46d04e0d54b6">
Aug 27 06:43:14 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 06:43:14 user nova-compute[73258]:         </nova:port>
Aug 27 06:43:14 user nova-compute[73258]:       </nova:ports>
Aug 27 06:43:14 user nova-compute[73258]:     </nova:instance>
Aug 27 06:43:14 user nova-compute[73258]:   </metadata>
Aug 27 06:43:14 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:43:14 user nova-compute[73258]:     <system>
Aug 27 06:43:14 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:43:14 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:43:14 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:43:14 user nova-compute[73258]:       <entry name="serial">4a2970a3-2a05-4462-bf0b-1595743222fb</entry>
Aug 27 06:43:14 user nova-compute[73258]:       <entry name="uuid">4a2970a3-2a05-4462-bf0b-1595743222fb</entry>
Aug 27 06:43:14 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:43:14 user nova-compute[73258]:     </system>
Aug 27 06:43:14 user nova-compute[73258]:   </sysinfo>
Aug 27 06:43:14 user nova-compute[73258]:   <os>
Aug 27 06:43:14 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:43:14 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:43:14 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:43:14 user nova-compute[73258]:   </os>
Aug 27 06:43:14 user nova-compute[73258]:   <features>
Aug 27 06:43:14 user nova-compute[73258]:     <acpi/>
Aug 27 06:43:14 user nova-compute[73258]:     <apic/>
Aug 27 06:43:14 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:43:14 user nova-compute[73258]:   </features>
Aug 27 06:43:14 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:43:14 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:43:14 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:43:14 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:43:14 user nova-compute[73258]:   </clock>
Aug 27 06:43:14 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:43:14 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:43:14 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:43:14 user nova-compute[73258]:   </cpu>
Aug 27 06:43:14 user nova-compute[73258]:   <devices>
Aug 27 06:43:14 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:43:14 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:43:14 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk"/>
Aug 27 06:43:14 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:43:14 user nova-compute[73258]:     </disk>
Aug 27 06:43:14 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:43:14 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:43:14 user nova-compute[73258]:       <source dev="/dev/sdb"/>
Aug 27 06:43:14 user nova-compute[73258]:       <target dev="vdb" bus="virtio"/>
Aug 27 06:43:14 user nova-compute[73258]:       <serial>15319228-580b-4a94-aa25-32c646a7c19c</serial>
Aug 27 06:43:14 user nova-compute[73258]:     </disk>
Aug 27 06:43:14 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:43:14 user nova-compute[73258]:       <mac address="fa:16:3e:d3:c2:3b"/>
Aug 27 06:43:14 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:43:14 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:43:14 user nova-compute[73258]:       <target dev="tap85410bb9-db"/>
Aug 27 06:43:14 user nova-compute[73258]:     </interface>
Aug 27 06:43:14 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:43:14 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/console.log" append="off"/>
Aug 27 06:43:14 user nova-compute[73258]:     </serial>
Aug 27 06:43:14 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:43:14 user nova-compute[73258]:     <video>
Aug 27 06:43:14 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:43:14 user nova-compute[73258]:     </video>
Aug 27 06:43:14 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:43:14 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:43:14 user nova-compute[73258]:     </rng>
Aug 27 06:43:14 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:43:14 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:43:14 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:43:14 user nova-compute[73258]:     </memballoon>
Aug 27 06:43:14 user nova-compute[73258]:   </devices>
Aug 27 06:43:14 user nova-compute[73258]: </domain>
Aug 27 06:43:14 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T06:40:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-968445551',display_name='tempest-ServerActionsTestOtherA-server-581411342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-968445551',id=17,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdMnm+iJuT1xHxSDO3grlX9YhSVQuwPM7dsQXKJfx/OYDCb58PWILkOo0/JLzQygTw7Q96Wku55I12d7cqqFJX+FkBYpsqqlHI6UIfaBvOqiUrbrpnkTTfTzPPZnAM/+Q==',key_name='tempest-keypair-1720190692',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='57faf7cb6c704c05aba06857a6cdd29f',ramdisk_id='',reservation_id='r-62w17hhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1477462030',owner_user_name='tempest-ServerActionsTestOtherA-1477462030-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:42:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f8a06ab5634f60b6ed2d1d9b2c342e',uuid=4a2970a3-2a05-4462-bf0b-1595743222fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "address": "fa:16:3e:d3:c2:3b", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85410bb9-db", "ovs_interfaceid": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converting VIF {"id": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "address": "fa:16:3e:d3:c2:3b", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85410bb9-db", "ovs_interfaceid": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:c2:3b,bridge_name='br-int',has_traffic_filtering=True,id=85410bb9-dbd6-481c-a090-46d04e0d54b6,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85410bb9-db') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG os_vif [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:c2:3b,bridge_name='br-int',has_traffic_filtering=True,id=85410bb9-dbd6-481c-a090-46d04e0d54b6,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85410bb9-db') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85410bb9-db, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85410bb9-db, col_values=(('external_ids', {'iface-id': '85410bb9-dbd6-481c-a090-46d04e0d54b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:c2:3b', 'vm-uuid': '4a2970a3-2a05-4462-bf0b-1595743222fb'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:14 user nova-compute[73258]: INFO os_vif [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:c2:3b,bridge_name='br-int',has_traffic_filtering=True,id=85410bb9-dbd6-481c-a090-46d04e0d54b6,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85410bb9-db')
Aug 27 06:43:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:43:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] No VIF found with MAC fa:16:3e:d3:c2:3b, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:43:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:16 user nova-compute[73258]: DEBUG nova.compute.manager [req-af2a2982-d1af-4c5a-bebc-5881586f45b5 req-737f7dbf-1a17-4d95-9d33-b7432fab4092 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Received event network-vif-plugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:43:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-af2a2982-d1af-4c5a-bebc-5881586f45b5 req-737f7dbf-1a17-4d95-9d33-b7432fab4092 service nova] Acquiring lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-af2a2982-d1af-4c5a-bebc-5881586f45b5 req-737f7dbf-1a17-4d95-9d33-b7432fab4092 service nova] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-af2a2982-d1af-4c5a-bebc-5881586f45b5 req-737f7dbf-1a17-4d95-9d33-b7432fab4092 service nova] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:16 user nova-compute[73258]: DEBUG nova.compute.manager [req-af2a2982-d1af-4c5a-bebc-5881586f45b5 req-737f7dbf-1a17-4d95-9d33-b7432fab4092 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] No waiting events found dispatching network-vif-plugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:43:16 user nova-compute[73258]: WARNING nova.compute.manager [req-af2a2982-d1af-4c5a-bebc-5881586f45b5 req-737f7dbf-1a17-4d95-9d33-b7432fab4092 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Received unexpected event network-vif-plugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 for instance with vm_state active and task_state rebuild_spawning.
Aug 27 06:43:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-9a522562-1d46-44f0-9272-e0b206e59f79 req-832450f4-003d-49e1-a716-0843520db32c service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Received event network-vif-plugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:43:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9a522562-1d46-44f0-9272-e0b206e59f79 req-832450f4-003d-49e1-a716-0843520db32c service nova] Acquiring lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9a522562-1d46-44f0-9272-e0b206e59f79 req-832450f4-003d-49e1-a716-0843520db32c service nova] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9a522562-1d46-44f0-9272-e0b206e59f79 req-832450f4-003d-49e1-a716-0843520db32c service nova] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-9a522562-1d46-44f0-9272-e0b206e59f79 req-832450f4-003d-49e1-a716-0843520db32c service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] No waiting events found dispatching network-vif-plugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:43:18 user nova-compute[73258]: WARNING nova.compute.manager [req-9a522562-1d46-44f0-9272-e0b206e59f79 req-832450f4-003d-49e1-a716-0843520db32c service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Received unexpected event network-vif-plugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 for instance with vm_state active and task_state rebuild_spawning.
Aug 27 06:43:19 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118599.0264995, 4a2970a3-2a05-4462-bf0b-1595743222fb => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:43:19 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] VM Resumed (Lifecycle Event)
Aug 27 06:43:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:43:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:43:19 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Instance spawned successfully.
Aug 27 06:43:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:43:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:43:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:43:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:19 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 06:43:19 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118599.02897, 4a2970a3-2a05-4462-bf0b-1595743222fb => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:43:19 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] VM Started (Lifecycle Event)
Aug 27 06:43:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:43:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:43:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:43:19 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 06:43:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:19 user nova-compute[73258]: DEBUG nova.objects.instance [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73258) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 27 06:43:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-699dc349-fa7f-44a5-8200-a834e2c7503f tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.070s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:27 user nova-compute[73258]: INFO nova.compute.manager [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Detaching volume 9cd5d71a-02b4-444b-9f79-09f9c5ea5109
Aug 27 06:43:27 user nova-compute[73258]: INFO nova.virt.block_device [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Attempting to driver detach volume 9cd5d71a-02b4-444b-9f79-09f9c5ea5109 from mountpoint /dev/vdb
Aug 27 06:43:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Attempting to detach device vdb from instance 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:43:27 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:43:27 user nova-compute[73258]:   <source dev="/dev/sdj"/>
Aug 27 06:43:27 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:43:27 user nova-compute[73258]:   <serial>9cd5d71a-02b4-444b-9f79-09f9c5ea5109</serial>
Aug 27 06:43:27 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:43:27 user nova-compute[73258]: </disk>
Aug 27 06:43:27 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:43:27 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Successfully detached device vdb from instance 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae from the persistent domain config.
Aug 27 06:43:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:43:27 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:43:27 user nova-compute[73258]:   <source dev="/dev/sdj"/>
Aug 27 06:43:27 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:43:27 user nova-compute[73258]:   <serial>9cd5d71a-02b4-444b-9f79-09f9c5ea5109</serial>
Aug 27 06:43:27 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:43:27 user nova-compute[73258]: </disk>
Aug 27 06:43:27 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693118607.511455, 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:43:27 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Successfully detached device vdb from instance 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae from the live domain config.
Aug 27 06:43:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmQkHaRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:43:27 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:43:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab53a39-ba61-4c52-b3b5-8c8539b6e726]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc46224e-e1db-40c9-83a7-21b1344b2eb9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:43:27 user nova-compute[73258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:43:27 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 (non-flash)
Aug 27 06:43:27 user nova-compute[73258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:43:27 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa430510430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109'): ({'sdj'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Removing single pathed devices sdj {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff8754e-0bbe-4339-ab80-6dc59d673fb3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2685a84a-fae5-4c69-9669-a3296c076140]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Flushing IO for device /dev/sdj {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c176e925-12e7-4a86-b278-ed7926c06520]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.051s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cee3e74-e8e1-49e6-9b74-abdcf685dbcd]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] SCSI volumes sdj have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4a3e66-4f1f-4d58-8795-548385f6f905]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[65732c9f-66be-4ff3-a4b9-9b3630c460cb]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109, portal: 172.16.0.220,3260]
Aug 27 06:43:27 user nova-compute[73258]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109, portal: 172.16.0.220,3260] successful.
Aug 27 06:43:27 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd5d71a-02b4-444b-9f79-09f9c5ea5109 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f830e71b-6633-4bfa-a43b-3da74c1c417f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] <== disconnect_volume: return (259ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:43:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:43:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "33b995be-307d-4491-a1b4-fb75ececea1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "33b995be-307d-4491-a1b4-fb75ececea1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "33b995be-307d-4491-a1b4-fb75ececea1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "33b995be-307d-4491-a1b4-fb75ececea1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "33b995be-307d-4491-a1b4-fb75ececea1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:28 user nova-compute[73258]: INFO nova.compute.manager [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Terminating instance
Aug 27 06:43:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:43:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:28 user nova-compute[73258]: DEBUG nova.objects.instance [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lazy-loading 'flavor' on Instance uuid 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:43:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-72e303be-a1ed-46b6-afce-6efe84b4d6de tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.849s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-10e83fb4-8781-451f-a6c9-a3095f89148b req-dec76ae5-7f0b-4023-8c0a-21806a632b8b service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Received event network-vif-unplugged-5d69f70a-cd94-4b7b-abc9-652fc681c98b {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:43:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-10e83fb4-8781-451f-a6c9-a3095f89148b req-dec76ae5-7f0b-4023-8c0a-21806a632b8b service nova] Acquiring lock "33b995be-307d-4491-a1b4-fb75ececea1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-10e83fb4-8781-451f-a6c9-a3095f89148b req-dec76ae5-7f0b-4023-8c0a-21806a632b8b service nova] Lock "33b995be-307d-4491-a1b4-fb75ececea1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-10e83fb4-8781-451f-a6c9-a3095f89148b req-dec76ae5-7f0b-4023-8c0a-21806a632b8b service nova] Lock "33b995be-307d-4491-a1b4-fb75ececea1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-10e83fb4-8781-451f-a6c9-a3095f89148b req-dec76ae5-7f0b-4023-8c0a-21806a632b8b service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] No waiting events found dispatching network-vif-unplugged-5d69f70a-cd94-4b7b-abc9-652fc681c98b {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:43:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-10e83fb4-8781-451f-a6c9-a3095f89148b req-dec76ae5-7f0b-4023-8c0a-21806a632b8b service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Received event network-vif-unplugged-5d69f70a-cd94-4b7b-abc9-652fc681c98b for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:43:29 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Instance destroyed successfully.
Aug 27 06:43:29 user nova-compute[73258]: DEBUG nova.objects.instance [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lazy-loading 'resources' on Instance uuid 33b995be-307d-4491-a1b4-fb75ececea1d {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:43:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1980093024',display_name='tempest-VolumesAdminNegativeTest-server-1980093024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1980093024',id=6,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZHAkF/Lu+qiN956dpQA65duHWT+dM/ZXNXETta93wJ/H3S0k3uCPx5xA8R40iyX3F9zMVo6ZKT6aRubY5LxQED0n8983C4Yb0TY65apY3yAim2BsL6va4Fs+TVMpH2ZQ==',key_name='tempest-keypair-169130833',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:37:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28d8e2938a0a4a97ac0b3f381626e880',ramdisk_id='',reservation_id='r-j5rjmr8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2002818274',owner_user_name='tempest-VolumesAdminNegativeTest-2002818274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:37:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff56e21976b246b297b6d15c9ba81c89',uuid=33b995be-307d-4491-a1b4-fb75ececea1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "address": "fa:16:3e:f1:e9:0f", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d69f70a-cd", "ovs_interfaceid": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:43:29 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Converting VIF {"id": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "address": "fa:16:3e:f1:e9:0f", "network": {"id": "41b0df8b-c615-470d-85ba-7289905946cf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1036119737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d8e2938a0a4a97ac0b3f381626e880", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d69f70a-cd", "ovs_interfaceid": "5d69f70a-cd94-4b7b-abc9-652fc681c98b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:43:29 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:e9:0f,bridge_name='br-int',has_traffic_filtering=True,id=5d69f70a-cd94-4b7b-abc9-652fc681c98b,network=Network(41b0df8b-c615-470d-85ba-7289905946cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d69f70a-cd') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:43:29 user nova-compute[73258]: DEBUG os_vif [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:e9:0f,bridge_name='br-int',has_traffic_filtering=True,id=5d69f70a-cd94-4b7b-abc9-652fc681c98b,network=Network(41b0df8b-c615-470d-85ba-7289905946cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d69f70a-cd') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:43:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d69f70a-cd, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:43:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:29 user nova-compute[73258]: INFO os_vif [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:e9:0f,bridge_name='br-int',has_traffic_filtering=True,id=5d69f70a-cd94-4b7b-abc9-652fc681c98b,network=Network(41b0df8b-c615-470d-85ba-7289905946cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d69f70a-cd')
Aug 27 06:43:29 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Deleting instance files /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d_del
Aug 27 06:43:29 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Deletion of /opt/stack/data/nova/instances/33b995be-307d-4491-a1b4-fb75ececea1d_del complete
Aug 27 06:43:29 user nova-compute[73258]: INFO nova.compute.manager [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 27 06:43:29 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:43:29 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:43:29 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:43:30 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:43:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-5fca3693-1bad-4a44-b74f-82c78fe81fb8 req-ec358e7b-ff93-48d2-8347-859b72582849 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Received event network-vif-deleted-5d69f70a-cd94-4b7b-abc9-652fc681c98b {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:43:30 user nova-compute[73258]: INFO nova.compute.manager [req-5fca3693-1bad-4a44-b74f-82c78fe81fb8 req-ec358e7b-ff93-48d2-8347-859b72582849 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Neutron deleted interface 5d69f70a-cd94-4b7b-abc9-652fc681c98b; detaching it from the instance and deleting it from the info cache
Aug 27 06:43:30 user nova-compute[73258]: DEBUG nova.network.neutron [req-5fca3693-1bad-4a44-b74f-82c78fe81fb8 req-ec358e7b-ff93-48d2-8347-859b72582849 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:43:30 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Took 0.74 seconds to deallocate network for instance.
Aug 27 06:43:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-5fca3693-1bad-4a44-b74f-82c78fe81fb8 req-ec358e7b-ff93-48d2-8347-859b72582849 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Detach interface failed, port_id=5d69f70a-cd94-4b7b-abc9-652fc681c98b, reason: Instance 33b995be-307d-4491-a1b4-fb75ececea1d could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:43:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:30 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:43:30 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:43:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:30 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Deleted allocations for instance 33b995be-307d-4491-a1b4-fb75ececea1d
Aug 27 06:43:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-326ce6fd-7a85-427c-adfc-78a0115d0fe5 tempest-VolumesAdminNegativeTest-2002818274 tempest-VolumesAdminNegativeTest-2002818274-project-member] Lock "33b995be-307d-4491-a1b4-fb75ececea1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.520s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:31 user nova-compute[73258]: DEBUG nova.compute.manager [req-e4e4eadc-4ce8-4df3-8ea1-4ee9da135454 req-6da5a646-ffc2-4dc8-9c8c-2fde1afd5547 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Received event network-vif-plugged-5d69f70a-cd94-4b7b-abc9-652fc681c98b {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:43:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e4e4eadc-4ce8-4df3-8ea1-4ee9da135454 req-6da5a646-ffc2-4dc8-9c8c-2fde1afd5547 service nova] Acquiring lock "33b995be-307d-4491-a1b4-fb75ececea1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e4e4eadc-4ce8-4df3-8ea1-4ee9da135454 req-6da5a646-ffc2-4dc8-9c8c-2fde1afd5547 service nova] Lock "33b995be-307d-4491-a1b4-fb75ececea1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e4e4eadc-4ce8-4df3-8ea1-4ee9da135454 req-6da5a646-ffc2-4dc8-9c8c-2fde1afd5547 service nova] Lock "33b995be-307d-4491-a1b4-fb75ececea1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:31 user nova-compute[73258]: DEBUG nova.compute.manager [req-e4e4eadc-4ce8-4df3-8ea1-4ee9da135454 req-6da5a646-ffc2-4dc8-9c8c-2fde1afd5547 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] No waiting events found dispatching network-vif-plugged-5d69f70a-cd94-4b7b-abc9-652fc681c98b {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:43:31 user nova-compute[73258]: WARNING nova.compute.manager [req-e4e4eadc-4ce8-4df3-8ea1-4ee9da135454 req-6da5a646-ffc2-4dc8-9c8c-2fde1afd5547 service nova] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Received unexpected event network-vif-plugged-5d69f70a-cd94-4b7b-abc9-652fc681c98b for instance with vm_state deleted and task_state None.
Aug 27 06:43:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:35 user nova-compute[73258]: INFO nova.compute.manager [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Terminating instance
Aug 27 06:43:35 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:43:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG nova.compute.manager [req-db6ec91e-0bb3-49d4-9658-9637ef4dd8b7 req-6ef2f3a6-c9a6-4dab-afe5-5080995e775b service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received event network-vif-unplugged-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-db6ec91e-0bb3-49d4-9658-9637ef4dd8b7 req-6ef2f3a6-c9a6-4dab-afe5-5080995e775b service nova] Acquiring lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-db6ec91e-0bb3-49d4-9658-9637ef4dd8b7 req-6ef2f3a6-c9a6-4dab-afe5-5080995e775b service nova] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-db6ec91e-0bb3-49d4-9658-9637ef4dd8b7 req-6ef2f3a6-c9a6-4dab-afe5-5080995e775b service nova] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG nova.compute.manager [req-db6ec91e-0bb3-49d4-9658-9637ef4dd8b7 req-6ef2f3a6-c9a6-4dab-afe5-5080995e775b service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] No waiting events found dispatching network-vif-unplugged-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG nova.compute.manager [req-db6ec91e-0bb3-49d4-9658-9637ef4dd8b7 req-6ef2f3a6-c9a6-4dab-afe5-5080995e775b service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received event network-vif-unplugged-a345de09-b566-4d5c-8df6-5e706f31bc62 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:36 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Instance destroyed successfully.
Aug 27 06:43:36 user nova-compute[73258]: DEBUG nova.objects.instance [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'resources' on Instance uuid 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T06:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1601086860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1601086860',id=4,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKN9oL6K1unToy1vBLfJDEhspBZ+6nInEDeFMBSIOkLauRGrGEb7fgBw3l691stm4aY7EPmi5rpZ3MPjWGELc3hQ/yUBUE8pZ2TuVjgtNW/eoGdif/reII4vfSxWa8rL1A==',key_name='tempest-keypair-1616777814',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:41:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='235a4f958e494352aaa119a4d44a52c5',ramdisk_id='',reservation_id='r-v9phxkt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1261077306',owner_user_name='tempest-AttachVolumeShelveTestJSON-1261077306-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff1f51bb7163499c94ebbc93a051b4df',uuid=32ca4a64-5e49-4bbb-bf96-d3f8cf39146e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converting VIF {"id": "a345de09-b566-4d5c-8df6-5e706f31bc62", "address": "fa:16:3e:e0:9f:3e", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa345de09-b5", "ovs_interfaceid": "a345de09-b566-4d5c-8df6-5e706f31bc62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9f:3e,bridge_name='br-int',has_traffic_filtering=True,id=a345de09-b566-4d5c-8df6-5e706f31bc62,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa345de09-b5') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG os_vif [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9f:3e,bridge_name='br-int',has_traffic_filtering=True,id=a345de09-b566-4d5c-8df6-5e706f31bc62,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa345de09-b5') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa345de09-b5, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:43:36 user nova-compute[73258]: INFO os_vif [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9f:3e,bridge_name='br-int',has_traffic_filtering=True,id=a345de09-b566-4d5c-8df6-5e706f31bc62,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa345de09-b5')
Aug 27 06:43:36 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Deleting instance files /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e_del
Aug 27 06:43:36 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Deletion of /opt/stack/data/nova/instances/32ca4a64-5e49-4bbb-bf96-d3f8cf39146e_del complete
Aug 27 06:43:36 user nova-compute[73258]: INFO nova.compute.manager [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 27 06:43:36 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:43:36 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:43:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:37 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:43:37 user nova-compute[73258]: DEBUG nova.compute.manager [req-cf79bcf8-478b-4f7f-afc4-5f2febc999f2 req-80e040c3-28b9-4e72-9ae1-325d5dbbcc38 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received event network-vif-deleted-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:43:37 user nova-compute[73258]: INFO nova.compute.manager [req-cf79bcf8-478b-4f7f-afc4-5f2febc999f2 req-80e040c3-28b9-4e72-9ae1-325d5dbbcc38 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Neutron deleted interface a345de09-b566-4d5c-8df6-5e706f31bc62; detaching it from the instance and deleting it from the info cache
Aug 27 06:43:37 user nova-compute[73258]: DEBUG nova.network.neutron [req-cf79bcf8-478b-4f7f-afc4-5f2febc999f2 req-80e040c3-28b9-4e72-9ae1-325d5dbbcc38 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:43:37 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Took 0.93 seconds to deallocate network for instance.
Aug 27 06:43:37 user nova-compute[73258]: DEBUG nova.compute.manager [req-cf79bcf8-478b-4f7f-afc4-5f2febc999f2 req-80e040c3-28b9-4e72-9ae1-325d5dbbcc38 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Detach interface failed, port_id=a345de09-b566-4d5c-8df6-5e706f31bc62, reason: Instance 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:43:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:38 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:43:38 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:43:38 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:38 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Deleted allocations for instance 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e
Aug 27 06:43:38 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e733ab25-d49e-4fe0-8759-1fb663848e7a tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.492s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:38 user nova-compute[73258]: DEBUG nova.compute.manager [req-04f1276e-c862-4efa-abd1-76d8585f4d14 req-2e6f5cc9-83c9-45b1-9b61-c315e6e6d3e2 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received event network-vif-plugged-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:43:38 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-04f1276e-c862-4efa-abd1-76d8585f4d14 req-2e6f5cc9-83c9-45b1-9b61-c315e6e6d3e2 service nova] Acquiring lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:38 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-04f1276e-c862-4efa-abd1-76d8585f4d14 req-2e6f5cc9-83c9-45b1-9b61-c315e6e6d3e2 service nova] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:38 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-04f1276e-c862-4efa-abd1-76d8585f4d14 req-2e6f5cc9-83c9-45b1-9b61-c315e6e6d3e2 service nova] Lock "32ca4a64-5e49-4bbb-bf96-d3f8cf39146e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:38 user nova-compute[73258]: DEBUG nova.compute.manager [req-04f1276e-c862-4efa-abd1-76d8585f4d14 req-2e6f5cc9-83c9-45b1-9b61-c315e6e6d3e2 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] No waiting events found dispatching network-vif-plugged-a345de09-b566-4d5c-8df6-5e706f31bc62 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:43:38 user nova-compute[73258]: WARNING nova.compute.manager [req-04f1276e-c862-4efa-abd1-76d8585f4d14 req-2e6f5cc9-83c9-45b1-9b61-c315e6e6d3e2 service nova] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Received unexpected event network-vif-plugged-a345de09-b566-4d5c-8df6-5e706f31bc62 for instance with vm_state deleted and task_state None.
Aug 27 06:43:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:40 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:43:40 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:43:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:43:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:43:40 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Updating instance_info_cache with network_info: [{"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_power_states {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid 1672aa9f-be6f-4357-877f-a48f62119df4 {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid a836678e-240d-4ead-b0b5-64d146910a23 {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid 21e7abcc-86a6-4315-9a84-9efcc907156f {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid 8396ca48-c47c-41b1-9872-24dbb0b9f526 {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid 4a2970a3-2a05-4462-bf0b-1595743222fb {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "1672aa9f-be6f-4357-877f-a48f62119df4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "a836678e-240d-4ead-b0b5-64d146910a23" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "a836678e-240d-4ead-b0b5-64d146910a23" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "21e7abcc-86a6-4315-9a84-9efcc907156f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "8396ca48-c47c-41b1-9872-24dbb0b9f526" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "8396ca48-c47c-41b1-9872-24dbb0b9f526" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "4a2970a3-2a05-4462-bf0b-1595743222fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "8396ca48-c47c-41b1-9872-24dbb0b9f526" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "1672aa9f-be6f-4357-877f-a48f62119df4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "a836678e-240d-4ead-b0b5-64d146910a23" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:41 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:43:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "2e89032a-0f74-4116-867e-a3b46fd20a7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "2e89032a-0f74-4116-867e-a3b46fd20a7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:43:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:42 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:43:42 user nova-compute[73258]: INFO nova.compute.claims [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Claim successful on node user
Aug 27 06:43:43 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:43:43 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:43:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:43:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:43:43 user nova-compute[73258]: DEBUG nova.network.neutron [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:43:43 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:43:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:43:43 user nova-compute[73258]: DEBUG nova.policy [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd74559df08d44e298ba6e2ccbaaefae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43f32eaadfd4f7eacc418385cc5e474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:43:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:43:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:43:43 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Creating image(s)
Aug 27 06:43:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "/opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "/opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.187s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.195s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk 1073741824" returned: 0 in 0.048s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.232s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:44 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:43:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:44 user nova-compute[73258]: DEBUG nova.network.neutron [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Successfully created port: fe2e1694-c46e-4a27-99ae-695d0394799a {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:43:44 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118609.4565039, 33b995be-307d-4491-a1b4-fb75ececea1d => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:43:44 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] VM Stopped (Lifecycle Event)
Aug 27 06:43:44 user nova-compute[73258]: DEBUG nova.compute.manager [None req-793d5801-363a-44fb-88de-0848e8ac817d None None] [instance: 33b995be-307d-4491-a1b4-fb75ececea1d] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:43:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:44 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Cannot resize image /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:43:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:43:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Ensure instance console log exists: /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:43:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.network.neutron [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Successfully updated port: fe2e1694-c46e-4a27-99ae-695d0394799a {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "refresh_cache-2e89032a-0f74-4116-867e-a3b46fd20a7a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquired lock "refresh_cache-2e89032a-0f74-4116-867e-a3b46fd20a7a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.network.neutron [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.compute.manager [req-22d1cf28-c8ca-4f4d-95e0-aad975f53831 req-9531a570-41e5-424d-a586-1ea85532718e service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Received event network-changed-fe2e1694-c46e-4a27-99ae-695d0394799a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.compute.manager [req-22d1cf28-c8ca-4f4d-95e0-aad975f53831 req-9531a570-41e5-424d-a586-1ea85532718e service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Refreshing instance network info cache due to event network-changed-fe2e1694-c46e-4a27-99ae-695d0394799a. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-22d1cf28-c8ca-4f4d-95e0-aad975f53831 req-9531a570-41e5-424d-a586-1ea85532718e service nova] Acquiring lock "refresh_cache-2e89032a-0f74-4116-867e-a3b46fd20a7a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.network.neutron [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.network.neutron [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Updating instance_info_cache with network_info: [{"id": "fe2e1694-c46e-4a27-99ae-695d0394799a", "address": "fa:16:3e:0c:40:0b", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e1694-c4", "ovs_interfaceid": "fe2e1694-c46e-4a27-99ae-695d0394799a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Releasing lock "refresh_cache-2e89032a-0f74-4116-867e-a3b46fd20a7a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Instance network_info: |[{"id": "fe2e1694-c46e-4a27-99ae-695d0394799a", "address": "fa:16:3e:0c:40:0b", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e1694-c4", "ovs_interfaceid": "fe2e1694-c46e-4a27-99ae-695d0394799a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-22d1cf28-c8ca-4f4d-95e0-aad975f53831 req-9531a570-41e5-424d-a586-1ea85532718e service nova] Acquired lock "refresh_cache-2e89032a-0f74-4116-867e-a3b46fd20a7a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.network.neutron [req-22d1cf28-c8ca-4f4d-95e0-aad975f53831 req-9531a570-41e5-424d-a586-1ea85532718e service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Refreshing network info cache for port fe2e1694-c46e-4a27-99ae-695d0394799a {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Start _get_guest_xml network_info=[{"id": "fe2e1694-c46e-4a27-99ae-695d0394799a", "address": "fa:16:3e:0c:40:0b", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e1694-c4", "ovs_interfaceid": "fe2e1694-c46e-4a27-99ae-695d0394799a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:43:45 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:43:45 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:43:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-452335647',display_name='tempest-AttachVolumeNegativeTest-server-452335647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-452335647',id=22,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk9DgsKsKYWVyRIZjKwtBXnc9POMzA2TRV4qFM6W5jcvuUbFrmSyN6kvOv/U7Rbp9xzh9P85XoZAarmIxqp9asAscNKgLuc+d5bqhJr40vVNzkBCPjHOgzFNbk5wt0aXg==',key_name='tempest-keypair-1000528364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f43f32eaadfd4f7eacc418385cc5e474',ramdisk_id='',reservation_id='r-ooo7dubj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-537954646',owner_user_name='tempest-AttachVolumeNegativeTest-537954646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:43:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd74559df08d44e298ba6e2ccbaaefae',uuid=2e89032a-0f74-4116-867e-a3b46fd20a7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe2e1694-c46e-4a27-99ae-695d0394799a", "address": "fa:16:3e:0c:40:0b", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e1694-c4", "ovs_interfaceid": "fe2e1694-c46e-4a27-99ae-695d0394799a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converting VIF {"id": "fe2e1694-c46e-4a27-99ae-695d0394799a", "address": "fa:16:3e:0c:40:0b", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e1694-c4", "ovs_interfaceid": "fe2e1694-c46e-4a27-99ae-695d0394799a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:40:0b,bridge_name='br-int',has_traffic_filtering=True,id=fe2e1694-c46e-4a27-99ae-695d0394799a,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2e1694-c4') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.objects.instance [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e89032a-0f74-4116-867e-a3b46fd20a7a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:43:45 user nova-compute[73258]:   <uuid>2e89032a-0f74-4116-867e-a3b46fd20a7a</uuid>
Aug 27 06:43:45 user nova-compute[73258]:   <name>instance-00000016</name>
Aug 27 06:43:45 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:43:45 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:43:45 user nova-compute[73258]:   <metadata>
Aug 27 06:43:45 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:43:45 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:43:45 user nova-compute[73258]:       <nova:name>tempest-AttachVolumeNegativeTest-server-452335647</nova:name>
Aug 27 06:43:45 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:43:45</nova:creationTime>
Aug 27 06:43:45 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:43:45 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:43:45 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:43:45 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:43:45 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:43:45 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:43:45 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:43:45 user nova-compute[73258]:       <nova:owner>
Aug 27 06:43:45 user nova-compute[73258]:         <nova:user uuid="fd74559df08d44e298ba6e2ccbaaefae">tempest-AttachVolumeNegativeTest-537954646-project-member</nova:user>
Aug 27 06:43:45 user nova-compute[73258]:         <nova:project uuid="f43f32eaadfd4f7eacc418385cc5e474">tempest-AttachVolumeNegativeTest-537954646</nova:project>
Aug 27 06:43:45 user nova-compute[73258]:       </nova:owner>
Aug 27 06:43:45 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:43:45 user nova-compute[73258]:       <nova:ports>
Aug 27 06:43:45 user nova-compute[73258]:         <nova:port uuid="fe2e1694-c46e-4a27-99ae-695d0394799a">
Aug 27 06:43:45 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 06:43:45 user nova-compute[73258]:         </nova:port>
Aug 27 06:43:45 user nova-compute[73258]:       </nova:ports>
Aug 27 06:43:45 user nova-compute[73258]:     </nova:instance>
Aug 27 06:43:45 user nova-compute[73258]:   </metadata>
Aug 27 06:43:45 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:43:45 user nova-compute[73258]:     <system>
Aug 27 06:43:45 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:43:45 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:43:45 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:43:45 user nova-compute[73258]:       <entry name="serial">2e89032a-0f74-4116-867e-a3b46fd20a7a</entry>
Aug 27 06:43:45 user nova-compute[73258]:       <entry name="uuid">2e89032a-0f74-4116-867e-a3b46fd20a7a</entry>
Aug 27 06:43:45 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:43:45 user nova-compute[73258]:     </system>
Aug 27 06:43:45 user nova-compute[73258]:   </sysinfo>
Aug 27 06:43:45 user nova-compute[73258]:   <os>
Aug 27 06:43:45 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:43:45 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:43:45 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:43:45 user nova-compute[73258]:   </os>
Aug 27 06:43:45 user nova-compute[73258]:   <features>
Aug 27 06:43:45 user nova-compute[73258]:     <acpi/>
Aug 27 06:43:45 user nova-compute[73258]:     <apic/>
Aug 27 06:43:45 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:43:45 user nova-compute[73258]:   </features>
Aug 27 06:43:45 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:43:45 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:43:45 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:43:45 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:43:45 user nova-compute[73258]:   </clock>
Aug 27 06:43:45 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:43:45 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:43:45 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:43:45 user nova-compute[73258]:   </cpu>
Aug 27 06:43:45 user nova-compute[73258]:   <devices>
Aug 27 06:43:45 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:43:45 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:43:45 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk"/>
Aug 27 06:43:45 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:43:45 user nova-compute[73258]:     </disk>
Aug 27 06:43:45 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:43:45 user nova-compute[73258]:       <mac address="fa:16:3e:0c:40:0b"/>
Aug 27 06:43:45 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:43:45 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:43:45 user nova-compute[73258]:       <target dev="tapfe2e1694-c4"/>
Aug 27 06:43:45 user nova-compute[73258]:     </interface>
Aug 27 06:43:45 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:43:45 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/console.log" append="off"/>
Aug 27 06:43:45 user nova-compute[73258]:     </serial>
Aug 27 06:43:45 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:43:45 user nova-compute[73258]:     <video>
Aug 27 06:43:45 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:43:45 user nova-compute[73258]:     </video>
Aug 27 06:43:45 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:43:45 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:43:45 user nova-compute[73258]:     </rng>
Aug 27 06:43:45 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:43:45 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:43:45 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:43:45 user nova-compute[73258]:     </memballoon>
Aug 27 06:43:45 user nova-compute[73258]:   </devices>
Aug 27 06:43:45 user nova-compute[73258]: </domain>
Aug 27 06:43:45 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:43:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-452335647',display_name='tempest-AttachVolumeNegativeTest-server-452335647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-452335647',id=22,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk9DgsKsKYWVyRIZjKwtBXnc9POMzA2TRV4qFM6W5jcvuUbFrmSyN6kvOv/U7Rbp9xzh9P85XoZAarmIxqp9asAscNKgLuc+d5bqhJr40vVNzkBCPjHOgzFNbk5wt0aXg==',key_name='tempest-keypair-1000528364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f43f32eaadfd4f7eacc418385cc5e474',ramdisk_id='',reservation_id='r-ooo7dubj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-537954646',owner_user_name='tempest-AttachVolumeNegativeTest-537954646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:43:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd74559df08d44e298ba6e2ccbaaefae',uuid=2e89032a-0f74-4116-867e-a3b46fd20a7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe2e1694-c46e-4a27-99ae-695d0394799a", "address": "fa:16:3e:0c:40:0b", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e1694-c4", "ovs_interfaceid": "fe2e1694-c46e-4a27-99ae-695d0394799a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converting VIF {"id": "fe2e1694-c46e-4a27-99ae-695d0394799a", "address": "fa:16:3e:0c:40:0b", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e1694-c4", "ovs_interfaceid": "fe2e1694-c46e-4a27-99ae-695d0394799a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:40:0b,bridge_name='br-int',has_traffic_filtering=True,id=fe2e1694-c46e-4a27-99ae-695d0394799a,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2e1694-c4') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG os_vif [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:40:0b,bridge_name='br-int',has_traffic_filtering=True,id=fe2e1694-c46e-4a27-99ae-695d0394799a,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2e1694-c4') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe2e1694-c4, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe2e1694-c4, col_values=(('external_ids', {'iface-id': 'fe2e1694-c46e-4a27-99ae-695d0394799a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:40:0b', 'vm-uuid': '2e89032a-0f74-4116-867e-a3b46fd20a7a'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:45 user nova-compute[73258]: INFO os_vif [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:40:0b,bridge_name='br-int',has_traffic_filtering=True,id=fe2e1694-c46e-4a27-99ae-695d0394799a,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2e1694-c4')
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] No VIF found with MAC fa:16:3e:0c:40:0b, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:45 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:43:46 user nova-compute[73258]: DEBUG nova.network.neutron [req-22d1cf28-c8ca-4f4d-95e0-aad975f53831 req-9531a570-41e5-424d-a586-1ea85532718e service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Updated VIF entry in instance network info cache for port fe2e1694-c46e-4a27-99ae-695d0394799a. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:43:46 user nova-compute[73258]: DEBUG nova.network.neutron [req-22d1cf28-c8ca-4f4d-95e0-aad975f53831 req-9531a570-41e5-424d-a586-1ea85532718e service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Updating instance_info_cache with network_info: [{"id": "fe2e1694-c46e-4a27-99ae-695d0394799a", "address": "fa:16:3e:0c:40:0b", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e1694-c4", "ovs_interfaceid": "fe2e1694-c46e-4a27-99ae-695d0394799a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:43:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-22d1cf28-c8ca-4f4d-95e0-aad975f53831 req-9531a570-41e5-424d-a586-1ea85532718e service nova] Releasing lock "refresh_cache-2e89032a-0f74-4116-867e-a3b46fd20a7a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:43:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:47 user nova-compute[73258]: DEBUG nova.compute.manager [req-0cdd2b92-e6b5-46a5-ad4e-0535bc80fd31 req-dbccd5fb-6b65-4e97-9451-7b1c911791f7 service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Received event network-vif-plugged-fe2e1694-c46e-4a27-99ae-695d0394799a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:43:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0cdd2b92-e6b5-46a5-ad4e-0535bc80fd31 req-dbccd5fb-6b65-4e97-9451-7b1c911791f7 service nova] Acquiring lock "2e89032a-0f74-4116-867e-a3b46fd20a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0cdd2b92-e6b5-46a5-ad4e-0535bc80fd31 req-dbccd5fb-6b65-4e97-9451-7b1c911791f7 service nova] Lock "2e89032a-0f74-4116-867e-a3b46fd20a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0cdd2b92-e6b5-46a5-ad4e-0535bc80fd31 req-dbccd5fb-6b65-4e97-9451-7b1c911791f7 service nova] Lock "2e89032a-0f74-4116-867e-a3b46fd20a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:47 user nova-compute[73258]: DEBUG nova.compute.manager [req-0cdd2b92-e6b5-46a5-ad4e-0535bc80fd31 req-dbccd5fb-6b65-4e97-9451-7b1c911791f7 service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] No waiting events found dispatching network-vif-plugged-fe2e1694-c46e-4a27-99ae-695d0394799a {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:43:47 user nova-compute[73258]: WARNING nova.compute.manager [req-0cdd2b92-e6b5-46a5-ad4e-0535bc80fd31 req-dbccd5fb-6b65-4e97-9451-7b1c911791f7 service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Received unexpected event network-vif-plugged-fe2e1694-c46e-4a27-99ae-695d0394799a for instance with vm_state building and task_state spawning.
Aug 27 06:43:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118629.4255815, 2e89032a-0f74-4116-867e-a3b46fd20a7a => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:43:49 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] VM Resumed (Lifecycle Event)
Aug 27 06:43:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:43:49 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Instance spawned successfully.
Aug 27 06:43:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:43:49 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:43:49 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118629.437963, 2e89032a-0f74-4116-867e-a3b46fd20a7a => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:43:49 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] VM Started (Lifecycle Event)
Aug 27 06:43:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-d6f17879-bb49-4860-8abd-a89a79e49233 req-56a27c7e-e654-478a-81c5-fca17e40daa1 service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Received event network-vif-plugged-fe2e1694-c46e-4a27-99ae-695d0394799a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d6f17879-bb49-4860-8abd-a89a79e49233 req-56a27c7e-e654-478a-81c5-fca17e40daa1 service nova] Acquiring lock "2e89032a-0f74-4116-867e-a3b46fd20a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d6f17879-bb49-4860-8abd-a89a79e49233 req-56a27c7e-e654-478a-81c5-fca17e40daa1 service nova] Lock "2e89032a-0f74-4116-867e-a3b46fd20a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d6f17879-bb49-4860-8abd-a89a79e49233 req-56a27c7e-e654-478a-81c5-fca17e40daa1 service nova] Lock "2e89032a-0f74-4116-867e-a3b46fd20a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-d6f17879-bb49-4860-8abd-a89a79e49233 req-56a27c7e-e654-478a-81c5-fca17e40daa1 service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] No waiting events found dispatching network-vif-plugged-fe2e1694-c46e-4a27-99ae-695d0394799a {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:43:49 user nova-compute[73258]: WARNING nova.compute.manager [req-d6f17879-bb49-4860-8abd-a89a79e49233 req-56a27c7e-e654-478a-81c5-fca17e40daa1 service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Received unexpected event network-vif-plugged-fe2e1694-c46e-4a27-99ae-695d0394799a for instance with vm_state building and task_state spawning.
Aug 27 06:43:49 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:43:49 user nova-compute[73258]: INFO nova.compute.manager [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Took 5.96 seconds to spawn the instance on the hypervisor.
Aug 27 06:43:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:43:49 user nova-compute[73258]: INFO nova.compute.manager [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Took 6.77 seconds to build instance.
Aug 27 06:43:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c5b685b6-dab9-4817-a7b4-250cd7d45130 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "2e89032a-0f74-4116-867e-a3b46fd20a7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.885s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:51 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118616.591788, 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:43:51 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] VM Stopped (Lifecycle Event)
Aug 27 06:43:51 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6212bf7c-b43e-4485-a783-5a0e2dd358f5 None None] [instance: 32ca4a64-5e49-4bbb-bf96-d3f8cf39146e] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:43:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:52 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:43:52 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:43:52 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=7051MB free_disk=24.157108306884766GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:43:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:43:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:43:52 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:43:52 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:43:52 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1672aa9f-be6f-4357-877f-a48f62119df4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:43:52 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:43:52 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 4a2970a3-2a05-4462-bf0b-1595743222fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:43:52 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a836678e-240d-4ead-b0b5-64d146910a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:43:52 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 21e7abcc-86a6-4315-9a84-9efcc907156f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:43:52 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9517c681-ed2b-49c2-94a6-aa2181b4b62f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:43:52 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 8396ca48-c47c-41b1-9872-24dbb0b9f526 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:43:52 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 2e89032a-0f74-4116-867e-a3b46fd20a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:43:52 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:43:52 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:43:53 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:43:53 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:43:53 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:43:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:43:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:43:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:43:56 user nova-compute[73258]: INFO nova.compute.manager [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] instance snapshotting
Aug 27 06:43:56 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Beginning live snapshot process
Aug 27 06:43:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json -f qcow2 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json -f qcow2 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgwohdup9/98ae00f5caa64da98cea06620c1c3c26.delta 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgwohdup9/98ae00f5caa64da98cea06620c1c3c26.delta 1073741824" returned: 0 in 0.051s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:57 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 27 06:43:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:43:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:43:58 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 06:43:58 user nova-compute[73258]: DEBUG nova.privsep.utils [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 06:43:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgwohdup9/98ae00f5caa64da98cea06620c1c3c26.delta /opt/stack/data/nova/instances/snapshots/tmpgwohdup9/98ae00f5caa64da98cea06620c1c3c26 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:43:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgwohdup9/98ae00f5caa64da98cea06620c1c3c26.delta /opt/stack/data/nova/instances/snapshots/tmpgwohdup9/98ae00f5caa64da98cea06620c1c3c26" returned: 0 in 0.598s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:43:59 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Snapshot extracted, beginning image upload
Aug 27 06:44:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:44:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 06:44:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:44:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:44:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:01 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Snapshot image upload complete
Aug 27 06:44:01 user nova-compute[73258]: INFO nova.compute.manager [None req-95221a77-c580-4709-86e2-7c281f41310f tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Took 5.30 seconds to snapshot the instance on the hypervisor.
Aug 27 06:44:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:17 user nova-compute[73258]: INFO nova.compute.manager [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Terminating instance
Aug 27 06:44:17 user nova-compute[73258]: DEBUG nova.compute.manager [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:44:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-6985bea4-7ca6-4975-9fbd-0332344ed80a req-99f087e0-eeac-457e-874d-5a4f6fdbff4b service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-vif-unplugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:44:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6985bea4-7ca6-4975-9fbd-0332344ed80a req-99f087e0-eeac-457e-874d-5a4f6fdbff4b service nova] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6985bea4-7ca6-4975-9fbd-0332344ed80a req-99f087e0-eeac-457e-874d-5a4f6fdbff4b service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6985bea4-7ca6-4975-9fbd-0332344ed80a req-99f087e0-eeac-457e-874d-5a4f6fdbff4b service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-6985bea4-7ca6-4975-9fbd-0332344ed80a req-99f087e0-eeac-457e-874d-5a4f6fdbff4b service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] No waiting events found dispatching network-vif-unplugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:44:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-6985bea4-7ca6-4975-9fbd-0332344ed80a req-99f087e0-eeac-457e-874d-5a4f6fdbff4b service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-vif-unplugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:44:18 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Instance destroyed successfully.
Aug 27 06:44:18 user nova-compute[73258]: DEBUG nova.objects.instance [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lazy-loading 'resources' on Instance uuid 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:44:18 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1098597537',display_name='tempest-ServerStableDeviceRescueTest-server-1098597537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1098597537',id=5,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAM0bmrEujlL8AI20zgQ/6kDsTFJuTxBCGvCarDVibclhhoc8ycGQgzzGiJjqiEsO14pVdFTzq5p35TGFRRkumZiqKN3fKgLokKihqSJCwjk5FC1NUqd8yScmsAcMPUhUg==',key_name='tempest-keypair-275662107',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:41:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f79d0a3715b343dea709d64cc322db6f',ramdisk_id='',reservation_id='r-epepb7c3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-543871806',owner_user_name='tempest-ServerStableDeviceRescueTest-543871806-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:42:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='526f6ab3befe4130ac81cd46f9678ebe',uuid=0a70cda7-b972-4d06-ac46-27ebb6d9d8ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:44:18 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Converting VIF {"id": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "address": "fa:16:3e:b1:1f:48", "network": {"id": "2584e799-abc7-4e9b-9295-e30c677c03b2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1117671728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f79d0a3715b343dea709d64cc322db6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa695f0b6-94", "ovs_interfaceid": "a695f0b6-9494-4a0c-9bd1-853631b8d8f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:44:18 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:1f:48,bridge_name='br-int',has_traffic_filtering=True,id=a695f0b6-9494-4a0c-9bd1-853631b8d8f4,network=Network(2584e799-abc7-4e9b-9295-e30c677c03b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa695f0b6-94') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:44:18 user nova-compute[73258]: DEBUG os_vif [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:1f:48,bridge_name='br-int',has_traffic_filtering=True,id=a695f0b6-9494-4a0c-9bd1-853631b8d8f4,network=Network(2584e799-abc7-4e9b-9295-e30c677c03b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa695f0b6-94') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:44:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa695f0b6-94, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:44:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:44:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:18 user nova-compute[73258]: INFO os_vif [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:1f:48,bridge_name='br-int',has_traffic_filtering=True,id=a695f0b6-9494-4a0c-9bd1-853631b8d8f4,network=Network(2584e799-abc7-4e9b-9295-e30c677c03b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa695f0b6-94')
Aug 27 06:44:18 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Deleting instance files /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae_del
Aug 27 06:44:18 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Deletion of /opt/stack/data/nova/instances/0a70cda7-b972-4d06-ac46-27ebb6d9d8ae_del complete
Aug 27 06:44:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:18 user nova-compute[73258]: INFO nova.compute.manager [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 27 06:44:18 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:44:18 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:44:18 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:44:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:19 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:44:19 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Took 1.03 seconds to deallocate network for instance.
Aug 27 06:44:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-a2fc1a67-d912-4ee8-ac06-d483aa58e424 req-331db98c-aee8-45eb-a1df-8e8ee83255d3 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-vif-deleted-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:44:19 user nova-compute[73258]: INFO nova.compute.manager [req-a2fc1a67-d912-4ee8-ac06-d483aa58e424 req-331db98c-aee8-45eb-a1df-8e8ee83255d3 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Neutron deleted interface a695f0b6-9494-4a0c-9bd1-853631b8d8f4; detaching it from the instance and deleting it from the info cache
Aug 27 06:44:19 user nova-compute[73258]: DEBUG nova.network.neutron [req-a2fc1a67-d912-4ee8-ac06-d483aa58e424 req-331db98c-aee8-45eb-a1df-8e8ee83255d3 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:44:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-a2fc1a67-d912-4ee8-ac06-d483aa58e424 req-331db98c-aee8-45eb-a1df-8e8ee83255d3 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Detach interface failed, port_id=a695f0b6-9494-4a0c-9bd1-853631b8d8f4, reason: Instance 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:44:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:19 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:44:19 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:44:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:19 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Deleted allocations for instance 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae
Aug 27 06:44:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-df0a1db5-bb9c-44e3-bacf-16fddfad4c05 tempest-ServerStableDeviceRescueTest-543871806 tempest-ServerStableDeviceRescueTest-543871806-project-member] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.428s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-b8104ed1-52a3-4e5f-90b2-794a50945bf3 req-4dd64d04-0734-4de7-bb9e-337154a0bdf5 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:44:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b8104ed1-52a3-4e5f-90b2-794a50945bf3 req-4dd64d04-0734-4de7-bb9e-337154a0bdf5 service nova] Acquiring lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b8104ed1-52a3-4e5f-90b2-794a50945bf3 req-4dd64d04-0734-4de7-bb9e-337154a0bdf5 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b8104ed1-52a3-4e5f-90b2-794a50945bf3 req-4dd64d04-0734-4de7-bb9e-337154a0bdf5 service nova] Lock "0a70cda7-b972-4d06-ac46-27ebb6d9d8ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-b8104ed1-52a3-4e5f-90b2-794a50945bf3 req-4dd64d04-0734-4de7-bb9e-337154a0bdf5 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] No waiting events found dispatching network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:44:20 user nova-compute[73258]: WARNING nova.compute.manager [req-b8104ed1-52a3-4e5f-90b2-794a50945bf3 req-4dd64d04-0734-4de7-bb9e-337154a0bdf5 service nova] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Received unexpected event network-vif-plugged-a695f0b6-9494-4a0c-9bd1-853631b8d8f4 for instance with vm_state deleted and task_state None.
Aug 27 06:44:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "50505a95-da00-4238-966d-c0a1e188b25c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "50505a95-da00-4238-966d-c0a1e188b25c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:44:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:44:21 user nova-compute[73258]: INFO nova.compute.claims [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Claim successful on node user
Aug 27 06:44:22 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG nova.network.neutron [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:44:22 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:44:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG nova.policy [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e39b42a04fd64685ac7382cd16dc7285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2900acc4299f427fa7152d2f039e026f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:44:22 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Creating image(s)
Aug 27 06:44:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "/opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "/opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "/opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.196s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk 1073741824" returned: 0 in 0.053s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.227s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:23 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Checking if we can resize image /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:44:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:23 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Cannot resize image /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:44:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:44:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Ensure instance console log exists: /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:44:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:23 user nova-compute[73258]: DEBUG nova.network.neutron [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Successfully created port: 13b80966-4283-4438-ae88-8c0a770c1c55 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:44:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.network.neutron [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Successfully updated port: 13b80966-4283-4438-ae88-8c0a770c1c55 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "refresh_cache-50505a95-da00-4238-966d-c0a1e188b25c" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquired lock "refresh_cache-50505a95-da00-4238-966d-c0a1e188b25c" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.network.neutron [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-8b5ddfc2-45c7-439f-aee1-1892ddfea8bc req-199ec03b-aa46-48a9-a7cc-32698ae5f193 service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Received event network-changed-13b80966-4283-4438-ae88-8c0a770c1c55 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-8b5ddfc2-45c7-439f-aee1-1892ddfea8bc req-199ec03b-aa46-48a9-a7cc-32698ae5f193 service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Refreshing instance network info cache due to event network-changed-13b80966-4283-4438-ae88-8c0a770c1c55. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8b5ddfc2-45c7-439f-aee1-1892ddfea8bc req-199ec03b-aa46-48a9-a7cc-32698ae5f193 service nova] Acquiring lock "refresh_cache-50505a95-da00-4238-966d-c0a1e188b25c" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.network.neutron [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.network.neutron [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Updating instance_info_cache with network_info: [{"id": "13b80966-4283-4438-ae88-8c0a770c1c55", "address": "fa:16:3e:07:c3:72", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b80966-42", "ovs_interfaceid": "13b80966-4283-4438-ae88-8c0a770c1c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Releasing lock "refresh_cache-50505a95-da00-4238-966d-c0a1e188b25c" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Instance network_info: |[{"id": "13b80966-4283-4438-ae88-8c0a770c1c55", "address": "fa:16:3e:07:c3:72", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b80966-42", "ovs_interfaceid": "13b80966-4283-4438-ae88-8c0a770c1c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8b5ddfc2-45c7-439f-aee1-1892ddfea8bc req-199ec03b-aa46-48a9-a7cc-32698ae5f193 service nova] Acquired lock "refresh_cache-50505a95-da00-4238-966d-c0a1e188b25c" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.network.neutron [req-8b5ddfc2-45c7-439f-aee1-1892ddfea8bc req-199ec03b-aa46-48a9-a7cc-32698ae5f193 service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Refreshing network info cache for port 13b80966-4283-4438-ae88-8c0a770c1c55 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Start _get_guest_xml network_info=[{"id": "13b80966-4283-4438-ae88-8c0a770c1c55", "address": "fa:16:3e:07:c3:72", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b80966-42", "ovs_interfaceid": "13b80966-4283-4438-ae88-8c0a770c1c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:44:24 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:44:24 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:44:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1969656533',display_name='tempest-VolumesSnapshotTestJSON-instance-1969656533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1969656533',id=23,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaBUcc+fl48JvwZrb7uzwVRGl1d4zh4BV2X0LLHzHmApOrJX8yWRvbT7YOHHUt2OtZD1+vCdP2eKy1U0C0E+EHcwnxQUNSwOiFDuTprSn689HYcjAprywFMBUtq8IhkiQ==',key_name='tempest-keypair-453956977',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2900acc4299f427fa7152d2f039e026f',ramdisk_id='',reservation_id='r-g39n2rip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-993486304',owner_user_name='tempest-VolumesSnapshotTestJSON-993486304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:44:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e39b42a04fd64685ac7382cd16dc7285',uuid=50505a95-da00-4238-966d-c0a1e188b25c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13b80966-4283-4438-ae88-8c0a770c1c55", "address": "fa:16:3e:07:c3:72", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b80966-42", "ovs_interfaceid": "13b80966-4283-4438-ae88-8c0a770c1c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Converting VIF {"id": "13b80966-4283-4438-ae88-8c0a770c1c55", "address": "fa:16:3e:07:c3:72", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b80966-42", "ovs_interfaceid": "13b80966-4283-4438-ae88-8c0a770c1c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:c3:72,bridge_name='br-int',has_traffic_filtering=True,id=13b80966-4283-4438-ae88-8c0a770c1c55,network=Network(82b73052-3c5c-4f8f-b938-b4423125eae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b80966-42') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.objects.instance [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lazy-loading 'pci_devices' on Instance uuid 50505a95-da00-4238-966d-c0a1e188b25c {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:44:24 user nova-compute[73258]:   <uuid>50505a95-da00-4238-966d-c0a1e188b25c</uuid>
Aug 27 06:44:24 user nova-compute[73258]:   <name>instance-00000017</name>
Aug 27 06:44:24 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:44:24 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:44:24 user nova-compute[73258]:   <metadata>
Aug 27 06:44:24 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:44:24 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:44:24 user nova-compute[73258]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1969656533</nova:name>
Aug 27 06:44:24 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:44:24</nova:creationTime>
Aug 27 06:44:24 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:44:24 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:44:24 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:44:24 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:44:24 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:44:24 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:44:24 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:44:24 user nova-compute[73258]:       <nova:owner>
Aug 27 06:44:24 user nova-compute[73258]:         <nova:user uuid="e39b42a04fd64685ac7382cd16dc7285">tempest-VolumesSnapshotTestJSON-993486304-project-member</nova:user>
Aug 27 06:44:24 user nova-compute[73258]:         <nova:project uuid="2900acc4299f427fa7152d2f039e026f">tempest-VolumesSnapshotTestJSON-993486304</nova:project>
Aug 27 06:44:24 user nova-compute[73258]:       </nova:owner>
Aug 27 06:44:24 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:44:24 user nova-compute[73258]:       <nova:ports>
Aug 27 06:44:24 user nova-compute[73258]:         <nova:port uuid="13b80966-4283-4438-ae88-8c0a770c1c55">
Aug 27 06:44:24 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 06:44:24 user nova-compute[73258]:         </nova:port>
Aug 27 06:44:24 user nova-compute[73258]:       </nova:ports>
Aug 27 06:44:24 user nova-compute[73258]:     </nova:instance>
Aug 27 06:44:24 user nova-compute[73258]:   </metadata>
Aug 27 06:44:24 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:44:24 user nova-compute[73258]:     <system>
Aug 27 06:44:24 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:44:24 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:44:24 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:44:24 user nova-compute[73258]:       <entry name="serial">50505a95-da00-4238-966d-c0a1e188b25c</entry>
Aug 27 06:44:24 user nova-compute[73258]:       <entry name="uuid">50505a95-da00-4238-966d-c0a1e188b25c</entry>
Aug 27 06:44:24 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:44:24 user nova-compute[73258]:     </system>
Aug 27 06:44:24 user nova-compute[73258]:   </sysinfo>
Aug 27 06:44:24 user nova-compute[73258]:   <os>
Aug 27 06:44:24 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:44:24 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:44:24 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:44:24 user nova-compute[73258]:   </os>
Aug 27 06:44:24 user nova-compute[73258]:   <features>
Aug 27 06:44:24 user nova-compute[73258]:     <acpi/>
Aug 27 06:44:24 user nova-compute[73258]:     <apic/>
Aug 27 06:44:24 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:44:24 user nova-compute[73258]:   </features>
Aug 27 06:44:24 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:44:24 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:44:24 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:44:24 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:44:24 user nova-compute[73258]:   </clock>
Aug 27 06:44:24 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:44:24 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:44:24 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:44:24 user nova-compute[73258]:   </cpu>
Aug 27 06:44:24 user nova-compute[73258]:   <devices>
Aug 27 06:44:24 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:44:24 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:44:24 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk"/>
Aug 27 06:44:24 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:44:24 user nova-compute[73258]:     </disk>
Aug 27 06:44:24 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:44:24 user nova-compute[73258]:       <mac address="fa:16:3e:07:c3:72"/>
Aug 27 06:44:24 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:44:24 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:44:24 user nova-compute[73258]:       <target dev="tap13b80966-42"/>
Aug 27 06:44:24 user nova-compute[73258]:     </interface>
Aug 27 06:44:24 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:44:24 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/console.log" append="off"/>
Aug 27 06:44:24 user nova-compute[73258]:     </serial>
Aug 27 06:44:24 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:44:24 user nova-compute[73258]:     <video>
Aug 27 06:44:24 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:44:24 user nova-compute[73258]:     </video>
Aug 27 06:44:24 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:44:24 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:44:24 user nova-compute[73258]:     </rng>
Aug 27 06:44:24 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:44:24 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:44:24 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:44:24 user nova-compute[73258]:     </memballoon>
Aug 27 06:44:24 user nova-compute[73258]:   </devices>
Aug 27 06:44:24 user nova-compute[73258]: </domain>
Aug 27 06:44:24 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:44:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1969656533',display_name='tempest-VolumesSnapshotTestJSON-instance-1969656533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1969656533',id=23,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaBUcc+fl48JvwZrb7uzwVRGl1d4zh4BV2X0LLHzHmApOrJX8yWRvbT7YOHHUt2OtZD1+vCdP2eKy1U0C0E+EHcwnxQUNSwOiFDuTprSn689HYcjAprywFMBUtq8IhkiQ==',key_name='tempest-keypair-453956977',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2900acc4299f427fa7152d2f039e026f',ramdisk_id='',reservation_id='r-g39n2rip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-993486304',owner_user_name='tempest-VolumesSnapshotTestJSON-993486304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:44:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e39b42a04fd64685ac7382cd16dc7285',uuid=50505a95-da00-4238-966d-c0a1e188b25c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13b80966-4283-4438-ae88-8c0a770c1c55", "address": "fa:16:3e:07:c3:72", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b80966-42", "ovs_interfaceid": "13b80966-4283-4438-ae88-8c0a770c1c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Converting VIF {"id": "13b80966-4283-4438-ae88-8c0a770c1c55", "address": "fa:16:3e:07:c3:72", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b80966-42", "ovs_interfaceid": "13b80966-4283-4438-ae88-8c0a770c1c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:c3:72,bridge_name='br-int',has_traffic_filtering=True,id=13b80966-4283-4438-ae88-8c0a770c1c55,network=Network(82b73052-3c5c-4f8f-b938-b4423125eae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b80966-42') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG os_vif [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c3:72,bridge_name='br-int',has_traffic_filtering=True,id=13b80966-4283-4438-ae88-8c0a770c1c55,network=Network(82b73052-3c5c-4f8f-b938-b4423125eae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b80966-42') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13b80966-42, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13b80966-42, col_values=(('external_ids', {'iface-id': '13b80966-4283-4438-ae88-8c0a770c1c55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:c3:72', 'vm-uuid': '50505a95-da00-4238-966d-c0a1e188b25c'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:24 user nova-compute[73258]: INFO os_vif [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c3:72,bridge_name='br-int',has_traffic_filtering=True,id=13b80966-4283-4438-ae88-8c0a770c1c55,network=Network(82b73052-3c5c-4f8f-b938-b4423125eae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b80966-42')
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] No VIF found with MAC fa:16:3e:07:c3:72, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.network.neutron [req-8b5ddfc2-45c7-439f-aee1-1892ddfea8bc req-199ec03b-aa46-48a9-a7cc-32698ae5f193 service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Updated VIF entry in instance network info cache for port 13b80966-4283-4438-ae88-8c0a770c1c55. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG nova.network.neutron [req-8b5ddfc2-45c7-439f-aee1-1892ddfea8bc req-199ec03b-aa46-48a9-a7cc-32698ae5f193 service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Updating instance_info_cache with network_info: [{"id": "13b80966-4283-4438-ae88-8c0a770c1c55", "address": "fa:16:3e:07:c3:72", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b80966-42", "ovs_interfaceid": "13b80966-4283-4438-ae88-8c0a770c1c55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:44:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8b5ddfc2-45c7-439f-aee1-1892ddfea8bc req-199ec03b-aa46-48a9-a7cc-32698ae5f193 service nova] Releasing lock "refresh_cache-50505a95-da00-4238-966d-c0a1e188b25c" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:44:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-6b599d12-7551-4d75-ab27-86ee3dbcee99 req-b36889a2-5eb7-46a2-a4f3-527dca3cb70a service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Received event network-vif-plugged-13b80966-4283-4438-ae88-8c0a770c1c55 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:44:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6b599d12-7551-4d75-ab27-86ee3dbcee99 req-b36889a2-5eb7-46a2-a4f3-527dca3cb70a service nova] Acquiring lock "50505a95-da00-4238-966d-c0a1e188b25c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6b599d12-7551-4d75-ab27-86ee3dbcee99 req-b36889a2-5eb7-46a2-a4f3-527dca3cb70a service nova] Lock "50505a95-da00-4238-966d-c0a1e188b25c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6b599d12-7551-4d75-ab27-86ee3dbcee99 req-b36889a2-5eb7-46a2-a4f3-527dca3cb70a service nova] Lock "50505a95-da00-4238-966d-c0a1e188b25c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-6b599d12-7551-4d75-ab27-86ee3dbcee99 req-b36889a2-5eb7-46a2-a4f3-527dca3cb70a service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] No waiting events found dispatching network-vif-plugged-13b80966-4283-4438-ae88-8c0a770c1c55 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:44:26 user nova-compute[73258]: WARNING nova.compute.manager [req-6b599d12-7551-4d75-ab27-86ee3dbcee99 req-b36889a2-5eb7-46a2-a4f3-527dca3cb70a service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Received unexpected event network-vif-plugged-13b80966-4283-4438-ae88-8c0a770c1c55 for instance with vm_state building and task_state spawning.
Aug 27 06:44:28 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118668.1840036, 50505a95-da00-4238-966d-c0a1e188b25c => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:44:28 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] VM Resumed (Lifecycle Event)
Aug 27 06:44:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:44:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:44:28 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Instance spawned successfully.
Aug 27 06:44:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:44:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:44:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:44:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:44:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:44:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:44:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:44:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:44:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:44:28 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:44:28 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118668.1873484, 50505a95-da00-4238-966d-c0a1e188b25c => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:44:28 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] VM Started (Lifecycle Event)
Aug 27 06:44:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:44:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:44:28 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:44:28 user nova-compute[73258]: INFO nova.compute.manager [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Took 5.99 seconds to spawn the instance on the hypervisor.
Aug 27 06:44:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:44:28 user nova-compute[73258]: INFO nova.compute.manager [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Took 6.80 seconds to build instance.
Aug 27 06:44:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e8e6625b-1cf3-46cc-9449-73646099f6a4 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "50505a95-da00-4238-966d-c0a1e188b25c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.890s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-edcd1102-bba1-4dda-aa46-d48f12434788 req-096a189f-5d58-4ffb-83fd-4ba3accbad76 service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Received event network-vif-plugged-13b80966-4283-4438-ae88-8c0a770c1c55 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:44:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-edcd1102-bba1-4dda-aa46-d48f12434788 req-096a189f-5d58-4ffb-83fd-4ba3accbad76 service nova] Acquiring lock "50505a95-da00-4238-966d-c0a1e188b25c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-edcd1102-bba1-4dda-aa46-d48f12434788 req-096a189f-5d58-4ffb-83fd-4ba3accbad76 service nova] Lock "50505a95-da00-4238-966d-c0a1e188b25c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-edcd1102-bba1-4dda-aa46-d48f12434788 req-096a189f-5d58-4ffb-83fd-4ba3accbad76 service nova] Lock "50505a95-da00-4238-966d-c0a1e188b25c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-edcd1102-bba1-4dda-aa46-d48f12434788 req-096a189f-5d58-4ffb-83fd-4ba3accbad76 service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] No waiting events found dispatching network-vif-plugged-13b80966-4283-4438-ae88-8c0a770c1c55 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:44:28 user nova-compute[73258]: WARNING nova.compute.manager [req-edcd1102-bba1-4dda-aa46-d48f12434788 req-096a189f-5d58-4ffb-83fd-4ba3accbad76 service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Received unexpected event network-vif-plugged-13b80966-4283-4438-ae88-8c0a770c1c55 for instance with vm_state active and task_state None.
Aug 27 06:44:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:44:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:44:29 user nova-compute[73258]: INFO nova.compute.claims [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Claim successful on node user
Aug 27 06:44:30 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:44:30 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:44:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG nova.policy [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff1f51bb7163499c94ebbc93a051b4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a4f958e494352aaa119a4d44a52c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:44:30 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Creating image(s)
Aug 27 06:44:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "/opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "/opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.204s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk 1073741824" returned: 0 in 0.053s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:31 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Successfully created port: fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:44:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:31 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:44:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:31 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Cannot resize image /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:44:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:44:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Ensure instance console log exists: /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:44:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Successfully updated port: fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquired lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-099f11ae-f4d3-42d1-b927-e0bb1a8522c6 req-3976b8c7-1607-4757-9bde-1f706f2965ec service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received event network-changed-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-099f11ae-f4d3-42d1-b927-e0bb1a8522c6 req-3976b8c7-1607-4757-9bde-1f706f2965ec service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Refreshing instance network info cache due to event network-changed-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-099f11ae-f4d3-42d1-b927-e0bb1a8522c6 req-3976b8c7-1607-4757-9bde-1f706f2965ec service nova] Acquiring lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Updating instance_info_cache with network_info: [{"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Releasing lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Instance network_info: |[{"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-099f11ae-f4d3-42d1-b927-e0bb1a8522c6 req-3976b8c7-1607-4757-9bde-1f706f2965ec service nova] Acquired lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.network.neutron [req-099f11ae-f4d3-42d1-b927-e0bb1a8522c6 req-3976b8c7-1607-4757-9bde-1f706f2965ec service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Refreshing network info cache for port fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Start _get_guest_xml network_info=[{"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:44:32 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:44:32 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:44:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-133269916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-133269916',id=24,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPhZgvMlZKszgmkJRdB2Td8QkZ+kehRxdRcco72ikdAPBqgA1064wic3jyDjgqQp2aKcq+6YzjRXdUerPFbWzpsTYXbn26mHdAkPlLsA+z50REBPVUDwI0jEOuRNEDA4w==',key_name='tempest-keypair-45658026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='235a4f958e494352aaa119a4d44a52c5',ramdisk_id='',reservation_id='r-qf0qib1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1261077306',owner_user_name='tempest-AttachVolumeShelveTestJSON-1261077306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff1f51bb7163499c94ebbc93a051b4df',uuid=e6e96ad8-e34e-4970-b3a6-c06df0c6d994,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converting VIF {"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:ae:e2,bridge_name='br-int',has_traffic_filtering=True,id=fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4351a6-f0') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.objects.instance [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'pci_devices' on Instance uuid e6e96ad8-e34e-4970-b3a6-c06df0c6d994 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:44:32 user nova-compute[73258]:   <uuid>e6e96ad8-e34e-4970-b3a6-c06df0c6d994</uuid>
Aug 27 06:44:32 user nova-compute[73258]:   <name>instance-00000018</name>
Aug 27 06:44:32 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:44:32 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:44:32 user nova-compute[73258]:   <metadata>
Aug 27 06:44:32 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:44:32 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:44:32 user nova-compute[73258]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-133269916</nova:name>
Aug 27 06:44:32 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:44:32</nova:creationTime>
Aug 27 06:44:32 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:44:32 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:44:32 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:44:32 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:44:32 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:44:32 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:44:32 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:44:32 user nova-compute[73258]:       <nova:owner>
Aug 27 06:44:32 user nova-compute[73258]:         <nova:user uuid="ff1f51bb7163499c94ebbc93a051b4df">tempest-AttachVolumeShelveTestJSON-1261077306-project-member</nova:user>
Aug 27 06:44:32 user nova-compute[73258]:         <nova:project uuid="235a4f958e494352aaa119a4d44a52c5">tempest-AttachVolumeShelveTestJSON-1261077306</nova:project>
Aug 27 06:44:32 user nova-compute[73258]:       </nova:owner>
Aug 27 06:44:32 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:44:32 user nova-compute[73258]:       <nova:ports>
Aug 27 06:44:32 user nova-compute[73258]:         <nova:port uuid="fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7">
Aug 27 06:44:32 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 06:44:32 user nova-compute[73258]:         </nova:port>
Aug 27 06:44:32 user nova-compute[73258]:       </nova:ports>
Aug 27 06:44:32 user nova-compute[73258]:     </nova:instance>
Aug 27 06:44:32 user nova-compute[73258]:   </metadata>
Aug 27 06:44:32 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:44:32 user nova-compute[73258]:     <system>
Aug 27 06:44:32 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:44:32 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:44:32 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:44:32 user nova-compute[73258]:       <entry name="serial">e6e96ad8-e34e-4970-b3a6-c06df0c6d994</entry>
Aug 27 06:44:32 user nova-compute[73258]:       <entry name="uuid">e6e96ad8-e34e-4970-b3a6-c06df0c6d994</entry>
Aug 27 06:44:32 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:44:32 user nova-compute[73258]:     </system>
Aug 27 06:44:32 user nova-compute[73258]:   </sysinfo>
Aug 27 06:44:32 user nova-compute[73258]:   <os>
Aug 27 06:44:32 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:44:32 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:44:32 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:44:32 user nova-compute[73258]:   </os>
Aug 27 06:44:32 user nova-compute[73258]:   <features>
Aug 27 06:44:32 user nova-compute[73258]:     <acpi/>
Aug 27 06:44:32 user nova-compute[73258]:     <apic/>
Aug 27 06:44:32 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:44:32 user nova-compute[73258]:   </features>
Aug 27 06:44:32 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:44:32 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:44:32 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:44:32 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:44:32 user nova-compute[73258]:   </clock>
Aug 27 06:44:32 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:44:32 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:44:32 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:44:32 user nova-compute[73258]:   </cpu>
Aug 27 06:44:32 user nova-compute[73258]:   <devices>
Aug 27 06:44:32 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:44:32 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:44:32 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk"/>
Aug 27 06:44:32 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:44:32 user nova-compute[73258]:     </disk>
Aug 27 06:44:32 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:44:32 user nova-compute[73258]:       <mac address="fa:16:3e:34:ae:e2"/>
Aug 27 06:44:32 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:44:32 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:44:32 user nova-compute[73258]:       <target dev="tapfc4351a6-f0"/>
Aug 27 06:44:32 user nova-compute[73258]:     </interface>
Aug 27 06:44:32 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:44:32 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/console.log" append="off"/>
Aug 27 06:44:32 user nova-compute[73258]:     </serial>
Aug 27 06:44:32 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:44:32 user nova-compute[73258]:     <video>
Aug 27 06:44:32 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:44:32 user nova-compute[73258]:     </video>
Aug 27 06:44:32 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:44:32 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:44:32 user nova-compute[73258]:     </rng>
Aug 27 06:44:32 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:44:32 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:44:32 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:44:32 user nova-compute[73258]:     </memballoon>
Aug 27 06:44:32 user nova-compute[73258]:   </devices>
Aug 27 06:44:32 user nova-compute[73258]: </domain>
Aug 27 06:44:32 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:44:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-133269916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-133269916',id=24,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPhZgvMlZKszgmkJRdB2Td8QkZ+kehRxdRcco72ikdAPBqgA1064wic3jyDjgqQp2aKcq+6YzjRXdUerPFbWzpsTYXbn26mHdAkPlLsA+z50REBPVUDwI0jEOuRNEDA4w==',key_name='tempest-keypair-45658026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='235a4f958e494352aaa119a4d44a52c5',ramdisk_id='',reservation_id='r-qf0qib1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1261077306',owner_user_name='tempest-AttachVolumeShelveTestJSON-1261077306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff1f51bb7163499c94ebbc93a051b4df',uuid=e6e96ad8-e34e-4970-b3a6-c06df0c6d994,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converting VIF {"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:ae:e2,bridge_name='br-int',has_traffic_filtering=True,id=fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4351a6-f0') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG os_vif [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:ae:e2,bridge_name='br-int',has_traffic_filtering=True,id=fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4351a6-f0') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc4351a6-f0, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc4351a6-f0, col_values=(('external_ids', {'iface-id': 'fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:ae:e2', 'vm-uuid': 'e6e96ad8-e34e-4970-b3a6-c06df0c6d994'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:32 user nova-compute[73258]: INFO os_vif [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:ae:e2,bridge_name='br-int',has_traffic_filtering=True,id=fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4351a6-f0')
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:44:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] No VIF found with MAC fa:16:3e:34:ae:e2, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:44:33 user nova-compute[73258]: DEBUG nova.network.neutron [req-099f11ae-f4d3-42d1-b927-e0bb1a8522c6 req-3976b8c7-1607-4757-9bde-1f706f2965ec service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Updated VIF entry in instance network info cache for port fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:44:33 user nova-compute[73258]: DEBUG nova.network.neutron [req-099f11ae-f4d3-42d1-b927-e0bb1a8522c6 req-3976b8c7-1607-4757-9bde-1f706f2965ec service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Updating instance_info_cache with network_info: [{"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:44:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-099f11ae-f4d3-42d1-b927-e0bb1a8522c6 req-3976b8c7-1607-4757-9bde-1f706f2965ec service nova] Releasing lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:44:33 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118658.3554952, 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:44:33 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] VM Stopped (Lifecycle Event)
Aug 27 06:44:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a1fa559d-28dd-4740-942c-7d7e64bbf6c7 None None] [instance: 0a70cda7-b972-4d06-ac46-27ebb6d9d8ae] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:44:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-b51db3d8-eb20-4cb4-9b58-c0b73bc2c9f9 req-050d13b9-ecdb-4e50-b774-40cbaaf130a4 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received event network-vif-plugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:44:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b51db3d8-eb20-4cb4-9b58-c0b73bc2c9f9 req-050d13b9-ecdb-4e50-b774-40cbaaf130a4 service nova] Acquiring lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b51db3d8-eb20-4cb4-9b58-c0b73bc2c9f9 req-050d13b9-ecdb-4e50-b774-40cbaaf130a4 service nova] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b51db3d8-eb20-4cb4-9b58-c0b73bc2c9f9 req-050d13b9-ecdb-4e50-b774-40cbaaf130a4 service nova] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-b51db3d8-eb20-4cb4-9b58-c0b73bc2c9f9 req-050d13b9-ecdb-4e50-b774-40cbaaf130a4 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] No waiting events found dispatching network-vif-plugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:44:34 user nova-compute[73258]: WARNING nova.compute.manager [req-b51db3d8-eb20-4cb4-9b58-c0b73bc2c9f9 req-050d13b9-ecdb-4e50-b774-40cbaaf130a4 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received unexpected event network-vif-plugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 for instance with vm_state building and task_state spawning.
Aug 27 06:44:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-0d1a1a17-bffd-4b39-b36d-c583971e5ad2 req-b5be9c97-2798-454c-8557-83b09229e0ed service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Received event network-changed-1180e78d-2144-45a5-a958-567420edf02a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.compute.manager [req-0d1a1a17-bffd-4b39-b36d-c583971e5ad2 req-b5be9c97-2798-454c-8557-83b09229e0ed service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Refreshing instance network info cache due to event network-changed-1180e78d-2144-45a5-a958-567420edf02a. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0d1a1a17-bffd-4b39-b36d-c583971e5ad2 req-b5be9c97-2798-454c-8557-83b09229e0ed service nova] Acquiring lock "refresh_cache-21e7abcc-86a6-4315-9a84-9efcc907156f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0d1a1a17-bffd-4b39-b36d-c583971e5ad2 req-b5be9c97-2798-454c-8557-83b09229e0ed service nova] Acquired lock "refresh_cache-21e7abcc-86a6-4315-9a84-9efcc907156f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.network.neutron [req-0d1a1a17-bffd-4b39-b36d-c583971e5ad2 req-b5be9c97-2798-454c-8557-83b09229e0ed service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Refreshing network info cache for port 1180e78d-2144-45a5-a958-567420edf02a {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Acquiring lock "21e7abcc-86a6-4315-9a84-9efcc907156f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.objects.instance [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lazy-loading 'flavor' on Instance uuid 21e7abcc-86a6-4315-9a84-9efcc907156f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.compute.manager [req-e34bf0e3-42ec-4117-9615-94385199f0a6 req-7c1cb5ff-d886-46dc-adc6-335b3cfcbdc1 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received event network-vif-plugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e34bf0e3-42ec-4117-9615-94385199f0a6 req-7c1cb5ff-d886-46dc-adc6-335b3cfcbdc1 service nova] Acquiring lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e34bf0e3-42ec-4117-9615-94385199f0a6 req-7c1cb5ff-d886-46dc-adc6-335b3cfcbdc1 service nova] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e34bf0e3-42ec-4117-9615-94385199f0a6 req-7c1cb5ff-d886-46dc-adc6-335b3cfcbdc1 service nova] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.compute.manager [req-e34bf0e3-42ec-4117-9615-94385199f0a6 req-7c1cb5ff-d886-46dc-adc6-335b3cfcbdc1 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] No waiting events found dispatching network-vif-plugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:44:36 user nova-compute[73258]: WARNING nova.compute.manager [req-e34bf0e3-42ec-4117-9615-94385199f0a6 req-7c1cb5ff-d886-46dc-adc6-335b3cfcbdc1 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received unexpected event network-vif-plugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 for instance with vm_state building and task_state spawning.
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118676.3827891, e6e96ad8-e34e-4970-b3a6-c06df0c6d994 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:44:36 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] VM Resumed (Lifecycle Event)
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:44:36 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Instance spawned successfully.
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Acquiring lock "21e7abcc-86a6-4315-9a84-9efcc907156f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:36 user nova-compute[73258]: INFO nova.compute.manager [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Attaching volume 9fd08267-2d17-41de-a03a-cdbd78fcf589 to /dev/vdb
Aug 27 06:44:36 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118676.3864532, e6e96ad8-e34e-4970-b3a6-c06df0c6d994 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:44:36 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] VM Started (Lifecycle Event)
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:44:36 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:44:36 user nova-compute[73258]: INFO nova.compute.manager [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Took 6.04 seconds to spawn the instance on the hypervisor.
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG os_brick.utils [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.network.neutron [req-0d1a1a17-bffd-4b39-b36d-c583971e5ad2 req-b5be9c97-2798-454c-8557-83b09229e0ed service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Updated VIF entry in instance network info cache for port 1180e78d-2144-45a5-a958-567420edf02a. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.network.neutron [req-0d1a1a17-bffd-4b39-b36d-c583971e5ad2 req-b5be9c97-2798-454c-8557-83b09229e0ed service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Updating instance_info_cache with network_info: [{"id": "1180e78d-2144-45a5-a958-567420edf02a", "address": "fa:16:3e:d1:f6:19", "network": {"id": "e690fd29-676c-47ee-88ba-886eea8dcf5f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-65889246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c7973a9a594a5aa6852b10b742c174", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1180e78d-21", "ovs_interfaceid": "1180e78d-2144-45a5-a958-567420edf02a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff2e2a1-5c77-4a1f-be5f-62ec15de0da7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0d1a1a17-bffd-4b39-b36d-c583971e5ad2 req-b5be9c97-2798-454c-8557-83b09229e0ed service nova] Releasing lock "refresh_cache-21e7abcc-86a6-4315-9a84-9efcc907156f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc57124-c9df-4599-86ff-f661708e5230]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca7e51b-a86d-4ace-ab15-c925b5471747]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:36 user nova-compute[73258]: INFO nova.compute.manager [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Took 6.86 seconds to build instance.
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42d12a4-7bd7-41ca-b1c7-c7b0cf69f0b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d0547e2-89f0-4dc5-8481-f01c4e3f9350 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.014s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:44:36 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:44:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5893bd53-3672-410d-826c-5de66abe3c36]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG os_brick.utils [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:44:36 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Updating existing volume attachment record: 9b0fcc95-fb38-40a0-acc0-40a869e886ee {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:44:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:44:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:44:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:44:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:44:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:44:43 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:44:43 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Updating instance_info_cache with network_info: [{"id": "217b1702-a403-4f3a-bdae-7793382e5f38", "address": "fa:16:3e:5d:4e:76", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217b1702-a4", "ovs_interfaceid": "217b1702-a403-4f3a-bdae-7793382e5f38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:44:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:44:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:44:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:44:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:44:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:44:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:44:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:44:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:44:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:44:45 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:44:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:47 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:44:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:47 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReHTOrwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:44:48 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:44:48 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:44:48 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[80997c6e-bf18-4a59-9843-4ebdfda057ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:44:48 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b1b00f-af34-4336-83f7-b95badd04beb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589] added
Aug 27 06:44:48 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba32e37-f8f4-4396-ae94-4339d13f5012]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad7c573-c513-4454-9ea8-b8172b1d71b5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ReHTOrwU {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ReHTOrwU" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc49a27-2345-49e1-93c4-4a2b0c73cd51]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ReHTOrwU'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8430afdc-99df-40f3-a615-4534079efe33]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c86d750-a1eb-4f17-8cf8-5eb9e82b3bb0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:44:48 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:44:48 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afba779-87b1-4853-8190-2dd8d047fcb0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589, portal: 172.16.0.220,3260]
Aug 27 06:44:48 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589, portal: 172.16.0.220,3260] successful.
Aug 27 06:44:48 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[021e832b-6cbb-4299-a319-51f149b7d64e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd87ebe-37f9-40cc-9551-7386674145ea]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:44:48 user nova-compute[73258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)
Aug 27 06:44:48 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:44:48 user nova-compute[73258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)
Aug 27 06:44:48 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede7b443-da8b-42c7-940f-825186600599]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReHTOrwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:44:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26665666539303833', 'path': '/dev/sdc'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:44:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665666539303833', 'path': '/dev/sdc'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:44:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:49 user nova-compute[73258]: DEBUG nova.objects.instance [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lazy-loading 'flavor' on Instance uuid 21e7abcc-86a6-4315-9a84-9efcc907156f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:44:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:44:49 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:44:49 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 06:44:49 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:44:49 user nova-compute[73258]:   <serial>9fd08267-2d17-41de-a03a-cdbd78fcf589</serial>
Aug 27 06:44:49 user nova-compute[73258]: </disk>
Aug 27 06:44:49 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:44:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:44:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:44:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] No VIF found with MAC fa:16:3e:d1:f6:19, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:44:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:44:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7ca10693-8639-4ba7-a8c5-95766e5a669e tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.818s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Acquiring lock "21e7abcc-86a6-4315-9a84-9efcc907156f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.003s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG os_brick.utils [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab24997-4a84-436c-b490-5e128140bdd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[11973251-91e1-487d-a92f-eb64d6824af6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d26c2a-da15-4e38-818d-b0d7689b659a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7013070-a96f-4fbf-b0f6-1cbe19d843d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:44:51 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7739c71-b8cf-44b5-b019-63feeeaedf80]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG os_brick.utils [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:51 user nova-compute[73258]: INFO nova.compute.manager [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Swapping volume 9fd08267-2d17-41de-a03a-cdbd78fcf589 for 87788861-0b5b-4709-b03d-1b67c7332c7f
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:52 user nova-compute[73258]: DEBUG nova.compute.manager [req-f455ae55-afbe-4f7d-8817-f27ff403eb1d req-92d8e806-7340-4ed3-a60a-1164b44477e9 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-changed-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:44:52 user nova-compute[73258]: DEBUG nova.compute.manager [req-f455ae55-afbe-4f7d-8817-f27ff403eb1d req-92d8e806-7340-4ed3-a60a-1164b44477e9 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Refreshing instance network info cache due to event network-changed-7b4375ea-f74b-4677-a768-97e96029c237. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:44:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f455ae55-afbe-4f7d-8817-f27ff403eb1d req-92d8e806-7340-4ed3-a60a-1164b44477e9 service nova] Acquiring lock "refresh_cache-9517c681-ed2b-49c2-94a6-aa2181b4b62f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:44:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f455ae55-afbe-4f7d-8817-f27ff403eb1d req-92d8e806-7340-4ed3-a60a-1164b44477e9 service nova] Acquired lock "refresh_cache-9517c681-ed2b-49c2-94a6-aa2181b4b62f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:44:52 user nova-compute[73258]: DEBUG nova.network.neutron [req-f455ae55-afbe-4f7d-8817-f27ff403eb1d req-92d8e806-7340-4ed3-a60a-1164b44477e9 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Refreshing network info cache for port 7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:44:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:44:53 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:44:53 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:44:53 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=7048MB free_disk=24.16527557373047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1672aa9f-be6f-4357-877f-a48f62119df4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 4a2970a3-2a05-4462-bf0b-1595743222fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a836678e-240d-4ead-b0b5-64d146910a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 21e7abcc-86a6-4315-9a84-9efcc907156f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9517c681-ed2b-49c2-94a6-aa2181b4b62f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 8396ca48-c47c-41b1-9872-24dbb0b9f526 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 2e89032a-0f74-4116-867e-a3b46fd20a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 50505a95-da00-4238-966d-c0a1e188b25c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance e6e96ad8-e34e-4970-b3a6-c06df0c6d994 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG nova.network.neutron [req-f455ae55-afbe-4f7d-8817-f27ff403eb1d req-92d8e806-7340-4ed3-a60a-1164b44477e9 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Updated VIF entry in instance network info cache for port 7b4375ea-f74b-4677-a768-97e96029c237. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG nova.network.neutron [req-f455ae55-afbe-4f7d-8817-f27ff403eb1d req-92d8e806-7340-4ed3-a60a-1164b44477e9 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Updating instance_info_cache with network_info: [{"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f455ae55-afbe-4f7d-8817-f27ff403eb1d req-92d8e806-7340-4ed3-a60a-1164b44477e9 service nova] Releasing lock "refresh_cache-9517c681-ed2b-49c2-94a6-aa2181b4b62f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:44:53 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:44:54 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:44:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquiring lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:44:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:44:55 user nova-compute[73258]: INFO nova.compute.claims [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Claim successful on node user
Aug 27 06:44:56 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:44:56 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:44:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:44:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:44:56 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:44:56 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:44:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:44:56 user nova-compute[73258]: DEBUG nova.policy [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bd578ee905a49e88abe9c72668bc1dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11b4cd365934e568225156ab305cda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:44:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:44:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:44:56 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Creating image(s)
Aug 27 06:44:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquiring lock "/opt/stack/data/nova/instances/af558a1a-7bee-46b9-8b00-ff5f5a545e8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "/opt/stack/data/nova/instances/af558a1a-7bee-46b9-8b00-ff5f5a545e8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "/opt/stack/data/nova/instances/af558a1a-7bee-46b9-8b00-ff5f5a545e8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.177s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.193s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/af558a1a-7bee-46b9-8b00-ff5f5a545e8e/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/af558a1a-7bee-46b9-8b00-ff5f5a545e8e/disk 1073741824" returned: 0 in 0.068s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Successfully created port: 37db544d-7a03-4d2d-a220-0bc1cd79da55 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af558a1a-7bee-46b9-8b00-ff5f5a545e8e/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af558a1a-7bee-46b9-8b00-ff5f5a545e8e/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af558a1a-7bee-46b9-8b00-ff5f5a545e8e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Cannot resize image /opt/stack/data/nova/instances/af558a1a-7bee-46b9-8b00-ff5f5a545e8e/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Ensure instance console log exists: /opt/stack/data/nova/instances/af558a1a-7bee-46b9-8b00-ff5f5a545e8e/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'flavor' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:44:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:44:57 user nova-compute[73258]: INFO nova.compute.manager [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Attaching volume eb06556d-be68-45c0-ad6d-7b516b1d9f7e to /dev/vdb
Aug 27 06:44:58 user nova-compute[73258]: DEBUG os_brick.utils [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53df8aa-7a48-4082-ba09-277982bc72fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a182a8fc-3de7-4bd0-ac46-5272794dea45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1512d87-c474-45f5-b3a8-75e555c98817]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[047b1e20-67c8-4b20-b861-ffe6c2656b0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Successfully updated port: 37db544d-7a03-4d2d-a220-0bc1cd79da55 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:44:58 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ecb8dc-0104-4ee4-aa34-b3cbdddd9009]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG os_brick.utils [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Updating existing volume attachment record: b408e360-9f2f-4c21-b657-4375aa2f8743 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquiring lock "refresh_cache-af558a1a-7bee-46b9-8b00-ff5f5a545e8e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquired lock "refresh_cache-af558a1a-7bee-46b9-8b00-ff5f5a545e8e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.compute.manager [req-9d1d6f2f-6c6c-4e1d-bd4d-706119898300 req-56162fa5-f41e-4759-9055-65c8a322bcca service nova] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Received event network-changed-37db544d-7a03-4d2d-a220-0bc1cd79da55 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.compute.manager [req-9d1d6f2f-6c6c-4e1d-bd4d-706119898300 req-56162fa5-f41e-4759-9055-65c8a322bcca service nova] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Refreshing instance network info cache due to event network-changed-37db544d-7a03-4d2d-a220-0bc1cd79da55. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9d1d6f2f-6c6c-4e1d-bd4d-706119898300 req-56162fa5-f41e-4759-9055-65c8a322bcca service nova] Acquiring lock "refresh_cache-af558a1a-7bee-46b9-8b00-ff5f5a545e8e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Updating instance_info_cache with network_info: [{"id": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "address": "fa:16:3e:58:1a:78", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37db544d-7a", "ovs_interfaceid": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Releasing lock "refresh_cache-af558a1a-7bee-46b9-8b00-ff5f5a545e8e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Instance network_info: |[{"id": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "address": "fa:16:3e:58:1a:78", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37db544d-7a", "ovs_interfaceid": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9d1d6f2f-6c6c-4e1d-bd4d-706119898300 req-56162fa5-f41e-4759-9055-65c8a322bcca service nova] Acquired lock "refresh_cache-af558a1a-7bee-46b9-8b00-ff5f5a545e8e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.network.neutron [req-9d1d6f2f-6c6c-4e1d-bd4d-706119898300 req-56162fa5-f41e-4759-9055-65c8a322bcca service nova] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Refreshing network info cache for port 37db544d-7a03-4d2d-a220-0bc1cd79da55 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Start _get_guest_xml network_info=[{"id": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "address": "fa:16:3e:58:1a:78", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37db544d-7a", "ovs_interfaceid": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:44:58 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:44:58 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-17827185',display_name='tempest-ServersNegativeTestJSON-server-17827185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-17827185',id=25,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11b4cd365934e568225156ab305cda2',ramdisk_id='',reservation_id='r-5l0sfrlg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1353100795',owner_user_name='tempest-ServersNegativeTestJSON-1353100795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:44:57Z,user_data=None,user_id='7bd578ee905a49e88abe9c72668bc1dd',uuid=af558a1a-7bee-46b9-8b00-ff5f5a545e8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "address": "fa:16:3e:58:1a:78", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37db544d-7a", "ovs_interfaceid": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Converting VIF {"id": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "address": "fa:16:3e:58:1a:78", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37db544d-7a", "ovs_interfaceid": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:1a:78,bridge_name='br-int',has_traffic_filtering=True,id=37db544d-7a03-4d2d-a220-0bc1cd79da55,network=Network(baf86837-de09-4d7d-a6a1-36fb8bf7bf68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37db544d-7a') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.objects.instance [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lazy-loading 'pci_devices' on Instance uuid af558a1a-7bee-46b9-8b00-ff5f5a545e8e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:44:58 user nova-compute[73258]:   <uuid>af558a1a-7bee-46b9-8b00-ff5f5a545e8e</uuid>
Aug 27 06:44:58 user nova-compute[73258]:   <name>instance-00000019</name>
Aug 27 06:44:58 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:44:58 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:44:58 user nova-compute[73258]:   <metadata>
Aug 27 06:44:58 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:44:58 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:44:58 user nova-compute[73258]:       <nova:name>tempest-ServersNegativeTestJSON-server-17827185</nova:name>
Aug 27 06:44:58 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:44:58</nova:creationTime>
Aug 27 06:44:58 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:44:58 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:44:58 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:44:58 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:44:58 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:44:58 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:44:58 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:44:58 user nova-compute[73258]:       <nova:owner>
Aug 27 06:44:58 user nova-compute[73258]:         <nova:user uuid="7bd578ee905a49e88abe9c72668bc1dd">tempest-ServersNegativeTestJSON-1353100795-project-member</nova:user>
Aug 27 06:44:58 user nova-compute[73258]:         <nova:project uuid="e11b4cd365934e568225156ab305cda2">tempest-ServersNegativeTestJSON-1353100795</nova:project>
Aug 27 06:44:58 user nova-compute[73258]:       </nova:owner>
Aug 27 06:44:58 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:44:58 user nova-compute[73258]:       <nova:ports>
Aug 27 06:44:58 user nova-compute[73258]:         <nova:port uuid="37db544d-7a03-4d2d-a220-0bc1cd79da55">
Aug 27 06:44:58 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 06:44:58 user nova-compute[73258]:         </nova:port>
Aug 27 06:44:58 user nova-compute[73258]:       </nova:ports>
Aug 27 06:44:58 user nova-compute[73258]:     </nova:instance>
Aug 27 06:44:58 user nova-compute[73258]:   </metadata>
Aug 27 06:44:58 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:44:58 user nova-compute[73258]:     <system>
Aug 27 06:44:58 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:44:58 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:44:58 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:44:58 user nova-compute[73258]:       <entry name="serial">af558a1a-7bee-46b9-8b00-ff5f5a545e8e</entry>
Aug 27 06:44:58 user nova-compute[73258]:       <entry name="uuid">af558a1a-7bee-46b9-8b00-ff5f5a545e8e</entry>
Aug 27 06:44:58 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:44:58 user nova-compute[73258]:     </system>
Aug 27 06:44:58 user nova-compute[73258]:   </sysinfo>
Aug 27 06:44:58 user nova-compute[73258]:   <os>
Aug 27 06:44:58 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:44:58 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:44:58 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:44:58 user nova-compute[73258]:   </os>
Aug 27 06:44:58 user nova-compute[73258]:   <features>
Aug 27 06:44:58 user nova-compute[73258]:     <acpi/>
Aug 27 06:44:58 user nova-compute[73258]:     <apic/>
Aug 27 06:44:58 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:44:58 user nova-compute[73258]:   </features>
Aug 27 06:44:58 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:44:58 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:44:58 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:44:58 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:44:58 user nova-compute[73258]:   </clock>
Aug 27 06:44:58 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:44:58 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:44:58 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:44:58 user nova-compute[73258]:   </cpu>
Aug 27 06:44:58 user nova-compute[73258]:   <devices>
Aug 27 06:44:58 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:44:58 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:44:58 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/af558a1a-7bee-46b9-8b00-ff5f5a545e8e/disk"/>
Aug 27 06:44:58 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:44:58 user nova-compute[73258]:     </disk>
Aug 27 06:44:58 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:44:58 user nova-compute[73258]:       <mac address="fa:16:3e:58:1a:78"/>
Aug 27 06:44:58 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:44:58 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:44:58 user nova-compute[73258]:       <target dev="tap37db544d-7a"/>
Aug 27 06:44:58 user nova-compute[73258]:     </interface>
Aug 27 06:44:58 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:44:58 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/af558a1a-7bee-46b9-8b00-ff5f5a545e8e/console.log" append="off"/>
Aug 27 06:44:58 user nova-compute[73258]:     </serial>
Aug 27 06:44:58 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:44:58 user nova-compute[73258]:     <video>
Aug 27 06:44:58 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:44:58 user nova-compute[73258]:     </video>
Aug 27 06:44:58 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:44:58 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:44:58 user nova-compute[73258]:     </rng>
Aug 27 06:44:58 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:44:58 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:44:58 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:44:58 user nova-compute[73258]:     </memballoon>
Aug 27 06:44:58 user nova-compute[73258]:   </devices>
Aug 27 06:44:58 user nova-compute[73258]: </domain>
Aug 27 06:44:58 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-17827185',display_name='tempest-ServersNegativeTestJSON-server-17827185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-17827185',id=25,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11b4cd365934e568225156ab305cda2',ramdisk_id='',reservation_id='r-5l0sfrlg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1353100795',owner_user_name='tempest-ServersNegativeTestJSON-1353100795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:44:57Z,user_data=None,user_id='7bd578ee905a49e88abe9c72668bc1dd',uuid=af558a1a-7bee-46b9-8b00-ff5f5a545e8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "address": "fa:16:3e:58:1a:78", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37db544d-7a", "ovs_interfaceid": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Converting VIF {"id": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "address": "fa:16:3e:58:1a:78", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37db544d-7a", "ovs_interfaceid": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:1a:78,bridge_name='br-int',has_traffic_filtering=True,id=37db544d-7a03-4d2d-a220-0bc1cd79da55,network=Network(baf86837-de09-4d7d-a6a1-36fb8bf7bf68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37db544d-7a') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG os_vif [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:1a:78,bridge_name='br-int',has_traffic_filtering=True,id=37db544d-7a03-4d2d-a220-0bc1cd79da55,network=Network(baf86837-de09-4d7d-a6a1-36fb8bf7bf68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37db544d-7a') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37db544d-7a, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37db544d-7a, col_values=(('external_ids', {'iface-id': '37db544d-7a03-4d2d-a220-0bc1cd79da55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:1a:78', 'vm-uuid': 'af558a1a-7bee-46b9-8b00-ff5f5a545e8e'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:58 user nova-compute[73258]: INFO os_vif [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:1a:78,bridge_name='br-int',has_traffic_filtering=True,id=37db544d-7a03-4d2d-a220-0bc1cd79da55,network=Network(baf86837-de09-4d7d-a6a1-36fb8bf7bf68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37db544d-7a')
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] No VIF found with MAC fa:16:3e:58:1a:78, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:44:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:44:59 user nova-compute[73258]: DEBUG nova.network.neutron [req-9d1d6f2f-6c6c-4e1d-bd4d-706119898300 req-56162fa5-f41e-4759-9055-65c8a322bcca service nova] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Updated VIF entry in instance network info cache for port 37db544d-7a03-4d2d-a220-0bc1cd79da55. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:44:59 user nova-compute[73258]: DEBUG nova.network.neutron [req-9d1d6f2f-6c6c-4e1d-bd4d-706119898300 req-56162fa5-f41e-4759-9055-65c8a322bcca service nova] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Updating instance_info_cache with network_info: [{"id": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "address": "fa:16:3e:58:1a:78", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37db544d-7a", "ovs_interfaceid": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:44:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9d1d6f2f-6c6c-4e1d-bd4d-706119898300 req-56162fa5-f41e-4759-9055-65c8a322bcca service nova] Releasing lock "refresh_cache-af558a1a-7bee-46b9-8b00-ff5f5a545e8e" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:44:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:00 user nova-compute[73258]: DEBUG nova.compute.manager [req-0a4d31a7-082a-485a-befa-f740fa3bfdd9 req-8a4bcb40-dbb2-4f11-9d4f-f4e10f68dd93 service nova] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Received event network-vif-plugged-37db544d-7a03-4d2d-a220-0bc1cd79da55 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:45:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0a4d31a7-082a-485a-befa-f740fa3bfdd9 req-8a4bcb40-dbb2-4f11-9d4f-f4e10f68dd93 service nova] Acquiring lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0a4d31a7-082a-485a-befa-f740fa3bfdd9 req-8a4bcb40-dbb2-4f11-9d4f-f4e10f68dd93 service nova] Lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0a4d31a7-082a-485a-befa-f740fa3bfdd9 req-8a4bcb40-dbb2-4f11-9d4f-f4e10f68dd93 service nova] Lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:00 user nova-compute[73258]: DEBUG nova.compute.manager [req-0a4d31a7-082a-485a-befa-f740fa3bfdd9 req-8a4bcb40-dbb2-4f11-9d4f-f4e10f68dd93 service nova] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] No waiting events found dispatching network-vif-plugged-37db544d-7a03-4d2d-a220-0bc1cd79da55 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:45:00 user nova-compute[73258]: WARNING nova.compute.manager [req-0a4d31a7-082a-485a-befa-f740fa3bfdd9 req-8a4bcb40-dbb2-4f11-9d4f-f4e10f68dd93 service nova] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Received unexpected event network-vif-plugged-37db544d-7a03-4d2d-a220-0bc1cd79da55 for instance with vm_state building and task_state spawning.
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.compute.manager [req-fb737cac-cf40-42ce-94b6-d2516471ff52 req-0b353622-bd14-461e-a47a-b03f18346496 service nova] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Received event network-vif-plugged-37db544d-7a03-4d2d-a220-0bc1cd79da55 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:45:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fb737cac-cf40-42ce-94b6-d2516471ff52 req-0b353622-bd14-461e-a47a-b03f18346496 service nova] Acquiring lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fb737cac-cf40-42ce-94b6-d2516471ff52 req-0b353622-bd14-461e-a47a-b03f18346496 service nova] Lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fb737cac-cf40-42ce-94b6-d2516471ff52 req-0b353622-bd14-461e-a47a-b03f18346496 service nova] Lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.compute.manager [req-fb737cac-cf40-42ce-94b6-d2516471ff52 req-0b353622-bd14-461e-a47a-b03f18346496 service nova] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] No waiting events found dispatching network-vif-plugged-37db544d-7a03-4d2d-a220-0bc1cd79da55 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:45:02 user nova-compute[73258]: WARNING nova.compute.manager [req-fb737cac-cf40-42ce-94b6-d2516471ff52 req-0b353622-bd14-461e-a47a-b03f18346496 service nova] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Received unexpected event network-vif-plugged-37db544d-7a03-4d2d-a220-0bc1cd79da55 for instance with vm_state building and task_state spawning.
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118702.3915887, af558a1a-7bee-46b9-8b00-ff5f5a545e8e => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:45:02 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] VM Resumed (Lifecycle Event)
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:45:02 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Instance spawned successfully.
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:45:02 user nova-compute[73258]: INFO nova.compute.manager [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Rescuing
Aug 27 06:45:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:45:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquired lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.network.neutron [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:45:02 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118702.3991652, af558a1a-7bee-46b9-8b00-ff5f5a545e8e => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:45:02 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] VM Started (Lifecycle Event)
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:45:02 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:45:02 user nova-compute[73258]: INFO nova.compute.manager [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Took 5.76 seconds to spawn the instance on the hypervisor.
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:45:02 user nova-compute[73258]: INFO nova.compute.manager [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Took 6.77 seconds to build instance.
Aug 27 06:45:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6e44e04e-4217-46f4-a7b9-93903ebe952f tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.887s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:02 user nova-compute[73258]: DEBUG nova.network.neutron [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Updating instance_info_cache with network_info: [{"id": "217b1702-a403-4f3a-bdae-7793382e5f38", "address": "fa:16:3e:5d:4e:76", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217b1702-a4", "ovs_interfaceid": "217b1702-a403-4f3a-bdae-7793382e5f38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:45:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Releasing lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG nova.compute.manager [req-fe25f9cd-3275-45fb-9798-3e5c6942cc5a req-ba8bc496-420a-4f39-83ac-064d6abb948d service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received event network-vif-unplugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fe25f9cd-3275-45fb-9798-3e5c6942cc5a req-ba8bc496-420a-4f39-83ac-064d6abb948d service nova] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fe25f9cd-3275-45fb-9798-3e5c6942cc5a req-ba8bc496-420a-4f39-83ac-064d6abb948d service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fe25f9cd-3275-45fb-9798-3e5c6942cc5a req-ba8bc496-420a-4f39-83ac-064d6abb948d service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG nova.compute.manager [req-fe25f9cd-3275-45fb-9798-3e5c6942cc5a req-ba8bc496-420a-4f39-83ac-064d6abb948d service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] No waiting events found dispatching network-vif-unplugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:45:03 user nova-compute[73258]: WARNING nova.compute.manager [req-fe25f9cd-3275-45fb-9798-3e5c6942cc5a req-ba8bc496-420a-4f39-83ac-064d6abb948d service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received unexpected event network-vif-unplugged-217b1702-a403-4f3a-bdae-7793382e5f38 for instance with vm_state active and task_state rescuing.
Aug 27 06:45:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:03 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Instance destroyed successfully.
Aug 27 06:45:03 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Attempting rescue
Aug 27 06:45:03 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73258) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Instance directory exists: not creating {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 06:45:03 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Creating image(s)
Aug 27 06:45:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "/opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "/opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "/opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG nova.objects.instance [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1672aa9f-be6f-4357-877f-a48f62119df4 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.191s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk.rescue {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk.rescue" returned: 0 in 0.063s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG nova.objects.instance [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'migration_context' on Instance uuid 1672aa9f-be6f-4357-877f-a48f62119df4 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG nova.objects.base [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Object Instance<1672aa9f-be6f-4357-877f-a48f62119df4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Start _get_guest_xml network_info=[{"id": "217b1702-a403-4f3a-bdae-7793382e5f38", "address": "fa:16:3e:5d:4e:76", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "vif_mac": "fa:16:3e:5d:4e:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217b1702-a4", "ovs_interfaceid": "217b1702-a403-4f3a-bdae-7793382e5f38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG nova.objects.instance [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'resources' on Instance uuid 1672aa9f-be6f-4357-877f-a48f62119df4 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG nova.objects.base [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Object Instance<1672aa9f-be6f-4357-877f-a48f62119df4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:45:03 user nova-compute[73258]: DEBUG nova.objects.instance [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'numa_topology' on Instance uuid 1672aa9f-be6f-4357-877f-a48f62119df4 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.objects.base [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Object Instance<1672aa9f-be6f-4357-877f-a48f62119df4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:45:04 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:45:04 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.objects.instance [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1672aa9f-be6f-4357-877f-a48f62119df4 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.objects.base [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Object Instance<1672aa9f-be6f-4357-877f-a48f62119df4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:40:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-986376124',display_name='tempest-ServerRescueNegativeTestJSON-server-986376124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-986376124',id=14,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:40:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6efa67b959a473da5a06f9e0aa8795f',ramdisk_id='',reservation_id='r-gemtid0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1025141277',owner_user_name='tempest-ServerRescueNegativeTestJSON-1025141277-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:40:21Z,user_data=None,user_id='685859ec81944e3398853037c24673a4',uuid=1672aa9f-be6f-4357-877f-a48f62119df4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "217b1702-a403-4f3a-bdae-7793382e5f38", "address": "fa:16:3e:5d:4e:76", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "vif_mac": "fa:16:3e:5d:4e:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217b1702-a4", "ovs_interfaceid": "217b1702-a403-4f3a-bdae-7793382e5f38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converting VIF {"id": "217b1702-a403-4f3a-bdae-7793382e5f38", "address": "fa:16:3e:5d:4e:76", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "vif_mac": "fa:16:3e:5d:4e:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217b1702-a4", "ovs_interfaceid": "217b1702-a403-4f3a-bdae-7793382e5f38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:4e:76,bridge_name='br-int',has_traffic_filtering=True,id=217b1702-a403-4f3a-bdae-7793382e5f38,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217b1702-a4') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.objects.instance [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'pci_devices' on Instance uuid 1672aa9f-be6f-4357-877f-a48f62119df4 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.objects.base [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Object Instance<1672aa9f-be6f-4357-877f-a48f62119df4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:45:04 user nova-compute[73258]:   <uuid>1672aa9f-be6f-4357-877f-a48f62119df4</uuid>
Aug 27 06:45:04 user nova-compute[73258]:   <name>instance-0000000e</name>
Aug 27 06:45:04 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:45:04 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:45:04 user nova-compute[73258]:   <metadata>
Aug 27 06:45:04 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:45:04 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:45:04 user nova-compute[73258]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-986376124</nova:name>
Aug 27 06:45:04 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:45:04</nova:creationTime>
Aug 27 06:45:04 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:45:04 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:45:04 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:45:04 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:45:04 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:45:04 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:45:04 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:45:04 user nova-compute[73258]:       <nova:owner>
Aug 27 06:45:04 user nova-compute[73258]:         <nova:user uuid="685859ec81944e3398853037c24673a4">tempest-ServerRescueNegativeTestJSON-1025141277-project-member</nova:user>
Aug 27 06:45:04 user nova-compute[73258]:         <nova:project uuid="f6efa67b959a473da5a06f9e0aa8795f">tempest-ServerRescueNegativeTestJSON-1025141277</nova:project>
Aug 27 06:45:04 user nova-compute[73258]:       </nova:owner>
Aug 27 06:45:04 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:45:04 user nova-compute[73258]:       <nova:ports>
Aug 27 06:45:04 user nova-compute[73258]:         <nova:port uuid="217b1702-a403-4f3a-bdae-7793382e5f38">
Aug 27 06:45:04 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 06:45:04 user nova-compute[73258]:         </nova:port>
Aug 27 06:45:04 user nova-compute[73258]:       </nova:ports>
Aug 27 06:45:04 user nova-compute[73258]:     </nova:instance>
Aug 27 06:45:04 user nova-compute[73258]:   </metadata>
Aug 27 06:45:04 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:45:04 user nova-compute[73258]:     <system>
Aug 27 06:45:04 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:45:04 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:45:04 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:45:04 user nova-compute[73258]:       <entry name="serial">1672aa9f-be6f-4357-877f-a48f62119df4</entry>
Aug 27 06:45:04 user nova-compute[73258]:       <entry name="uuid">1672aa9f-be6f-4357-877f-a48f62119df4</entry>
Aug 27 06:45:04 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:45:04 user nova-compute[73258]:     </system>
Aug 27 06:45:04 user nova-compute[73258]:   </sysinfo>
Aug 27 06:45:04 user nova-compute[73258]:   <os>
Aug 27 06:45:04 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:45:04 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:45:04 user nova-compute[73258]:   </os>
Aug 27 06:45:04 user nova-compute[73258]:   <features>
Aug 27 06:45:04 user nova-compute[73258]:     <acpi/>
Aug 27 06:45:04 user nova-compute[73258]:     <apic/>
Aug 27 06:45:04 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:45:04 user nova-compute[73258]:   </features>
Aug 27 06:45:04 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:45:04 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:45:04 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:45:04 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:45:04 user nova-compute[73258]:   </clock>
Aug 27 06:45:04 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:45:04 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:45:04 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:45:04 user nova-compute[73258]:   </cpu>
Aug 27 06:45:04 user nova-compute[73258]:   <devices>
Aug 27 06:45:04 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:45:04 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:45:04 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk.rescue"/>
Aug 27 06:45:04 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:45:04 user nova-compute[73258]:     </disk>
Aug 27 06:45:04 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:45:04 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:45:04 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk"/>
Aug 27 06:45:04 user nova-compute[73258]:       <target dev="vdb" bus="virtio"/>
Aug 27 06:45:04 user nova-compute[73258]:     </disk>
Aug 27 06:45:04 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:45:04 user nova-compute[73258]:       <mac address="fa:16:3e:5d:4e:76"/>
Aug 27 06:45:04 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:45:04 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:45:04 user nova-compute[73258]:       <target dev="tap217b1702-a4"/>
Aug 27 06:45:04 user nova-compute[73258]:     </interface>
Aug 27 06:45:04 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:45:04 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/console.log" append="off"/>
Aug 27 06:45:04 user nova-compute[73258]:     </serial>
Aug 27 06:45:04 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:45:04 user nova-compute[73258]:     <video>
Aug 27 06:45:04 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:45:04 user nova-compute[73258]:     </video>
Aug 27 06:45:04 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:45:04 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:45:04 user nova-compute[73258]:     </rng>
Aug 27 06:45:04 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:45:04 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:45:04 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:45:04 user nova-compute[73258]:     </memballoon>
Aug 27 06:45:04 user nova-compute[73258]:   </devices>
Aug 27 06:45:04 user nova-compute[73258]: </domain>
Aug 27 06:45:04 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:45:04 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Instance destroyed successfully.
Aug 27 06:45:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] No VIF found with MAC fa:16:3e:5d:4e:76, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNHzEYPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '21e7abcc-86a6-4315-9a84-9efcc907156f', 'attached_at': '', 'detached_at': '', 'volume_id': '87788861-0b5b-4709-b03d-1b67c7332c7f', 'serial': '87788861-0b5b-4709-b03d-1b67c7332c7f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReHTOrwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '21e7abcc-86a6-4315-9a84-9efcc907156f', 'attached_at': '', 'detached_at': '', 'volume_id': '9fd08267-2d17-41de-a03a-cdbd78fcf589', 'serial'} {{(pid=73258) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNHzEYPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:45:04 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:45:04 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:45:04 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9156ca97-9389-428b-93ff-aebf99062ad2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "7ee743f1-9611-4165-838e-54fccb332f1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "7ee743f1-9611-4165-838e-54fccb332f1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:45:04 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe385d7-37c2-451c-be93-366d8c3c61f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f] added
Aug 27 06:45:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff7e13a-a13d-4f79-af7c-c344fd461afc]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c244da7c-353e-473e-8ded-a674d2a2af70]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yNHzEYPj {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yNHzEYPj" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e446f4-1c28-4fe9-880f-2cbd1daa665e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yNHzEYPj'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:45:04 user nova-compute[73258]: INFO nova.compute.claims [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Claim successful on node user
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c007c80-85b1-44ea-8a51-89d02ebee73e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[289e716b-038a-4883-a53d-5d664e20219e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:04 user nova-compute[73258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)
Aug 27 06:45:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:04 user nova-compute[73258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)
Aug 27 06:45:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[12700ff8-36af-4cb0-9b6e-dbaa28e0c875]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f, portal: 172.16.0.220,3260]
Aug 27 06:45:04 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f, portal: 172.16.0.220,3260] successful.
Aug 27 06:45:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79caa51-f6a0-4386-bb40-3c0e1eea6f24]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c843bb6-3080-44fa-b177-e982ba8d5de1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:04 user nova-compute[73258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)
Aug 27 06:45:04 user nova-compute[73258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)
Aug 27 06:45:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:04 user nova-compute[73258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)
Aug 27 06:45:04 user nova-compute[73258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)
Aug 27 06:45:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0ce599-7b1f-4c55-9c6f-24ef4a89c4b4]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:04 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: None {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.667s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:45:05 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:45:05 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG nova.compute.manager [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG nova.compute.manager [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] No waiting events found dispatching network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:45:05 user nova-compute[73258]: WARNING nova.compute.manager [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received unexpected event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 for instance with vm_state active and task_state rescuing.
Aug 27 06:45:05 user nova-compute[73258]: DEBUG nova.compute.manager [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG nova.compute.manager [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] No waiting events found dispatching network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:45:05 user nova-compute[73258]: WARNING nova.compute.manager [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received unexpected event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 for instance with vm_state active and task_state rescuing.
Aug 27 06:45:05 user nova-compute[73258]: DEBUG nova.compute.manager [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG nova.compute.manager [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] No waiting events found dispatching network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:45:05 user nova-compute[73258]: WARNING nova.compute.manager [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received unexpected event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 for instance with vm_state active and task_state rescuing.
Aug 27 06:45:05 user nova-compute[73258]: DEBUG nova.compute.manager [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received event network-vif-unplugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG nova.compute.manager [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] No waiting events found dispatching network-vif-unplugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:45:05 user nova-compute[73258]: WARNING nova.compute.manager [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received unexpected event network-vif-unplugged-217b1702-a403-4f3a-bdae-7793382e5f38 for instance with vm_state active and task_state rescuing.
Aug 27 06:45:05 user nova-compute[73258]: DEBUG nova.compute.manager [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG nova.compute.manager [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] No waiting events found dispatching network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:45:05 user nova-compute[73258]: WARNING nova.compute.manager [req-88f0cebd-b269-490a-86b7-760f5580b578 req-5ddc4846-c3c1-4a02-b7f9-a96c02b75615 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received unexpected event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 for instance with vm_state active and task_state rescuing.
Aug 27 06:45:05 user nova-compute[73258]: INFO nova.virt.block_device [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Booting with blank volume at /dev/vda
Aug 27 06:45:05 user nova-compute[73258]: DEBUG nova.policy [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36c0faed29a446aa9fa6ff8692581aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cf34590d8d4b8b89b9626c6e150df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNHzEYPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26639636333636636', 'path': '/dev/sdd'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639636333636636', 'path': '/dev/sdd'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:45:05 user nova-compute[73258]: DEBUG nova.objects.instance [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Lazy-loading 'flavor' on Instance uuid 21e7abcc-86a6-4315-9a84-9efcc907156f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:45:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:45:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] COPY block job progress, current cursor: 108003328 final cursor: 1073741824 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:45:07 user nova-compute[73258]: DEBUG nova.compute.manager [req-24169f1f-1292-4f24-943a-49c0c93f5671 req-9c4da185-02b8-42f5-a630-74aafbdd505b service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:45:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-24169f1f-1292-4f24-943a-49c0c93f5671 req-9c4da185-02b8-42f5-a630-74aafbdd505b service nova] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-24169f1f-1292-4f24-943a-49c0c93f5671 req-9c4da185-02b8-42f5-a630-74aafbdd505b service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-24169f1f-1292-4f24-943a-49c0c93f5671 req-9c4da185-02b8-42f5-a630-74aafbdd505b service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:07 user nova-compute[73258]: DEBUG nova.compute.manager [req-24169f1f-1292-4f24-943a-49c0c93f5671 req-9c4da185-02b8-42f5-a630-74aafbdd505b service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] No waiting events found dispatching network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:45:07 user nova-compute[73258]: WARNING nova.compute.manager [req-24169f1f-1292-4f24-943a-49c0c93f5671 req-9c4da185-02b8-42f5-a630-74aafbdd505b service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received unexpected event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 for instance with vm_state active and task_state rescuing.
Aug 27 06:45:07 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Successfully created port: 27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:45:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] COPY block job progress, current cursor: 235929600 final cursor: 1073741824 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:45:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] COPY block job progress, current cursor: 318767104 final cursor: 1073741824 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:45:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] COPY block job progress, current cursor: 444596224 final cursor: 1073741824 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:45:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:09 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Successfully updated port: 27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:45:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "refresh_cache-7ee743f1-9611-4165-838e-54fccb332f1a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:45:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquired lock "refresh_cache-7ee743f1-9611-4165-838e-54fccb332f1a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:45:09 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:45:09 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:45:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] COPY block job progress, current cursor: 595591168 final cursor: 1073741824 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:45:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Removed pending event for 1672aa9f-be6f-4357-877f-a48f62119df4 due to event {{(pid=73258) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 06:45:09 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118709.748235, 1672aa9f-be6f-4357-877f-a48f62119df4 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:45:09 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] VM Resumed (Lifecycle Event)
Aug 27 06:45:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-992ed3c6-c38c-4ee2-870b-b5537059307d req-86d4032d-f2ff-4cdf-a9c5-ec28d1efcb72 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:45:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-992ed3c6-c38c-4ee2-870b-b5537059307d req-86d4032d-f2ff-4cdf-a9c5-ec28d1efcb72 service nova] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-992ed3c6-c38c-4ee2-870b-b5537059307d req-86d4032d-f2ff-4cdf-a9c5-ec28d1efcb72 service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-992ed3c6-c38c-4ee2-870b-b5537059307d req-86d4032d-f2ff-4cdf-a9c5-ec28d1efcb72 service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-992ed3c6-c38c-4ee2-870b-b5537059307d req-86d4032d-f2ff-4cdf-a9c5-ec28d1efcb72 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] No waiting events found dispatching network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:45:09 user nova-compute[73258]: WARNING nova.compute.manager [req-992ed3c6-c38c-4ee2-870b-b5537059307d req-86d4032d-f2ff-4cdf-a9c5-ec28d1efcb72 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received unexpected event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 for instance with vm_state active and task_state rescuing.
Aug 27 06:45:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-992ed3c6-c38c-4ee2-870b-b5537059307d req-86d4032d-f2ff-4cdf-a9c5-ec28d1efcb72 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received event network-changed-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:45:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-992ed3c6-c38c-4ee2-870b-b5537059307d req-86d4032d-f2ff-4cdf-a9c5-ec28d1efcb72 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Refreshing instance network info cache due to event network-changed-27d47d21-922e-43da-8dee-8d62f45edd64. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:45:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-992ed3c6-c38c-4ee2-870b-b5537059307d req-86d4032d-f2ff-4cdf-a9c5-ec28d1efcb72 service nova] Acquiring lock "refresh_cache-7ee743f1-9611-4165-838e-54fccb332f1a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:45:09 user nova-compute[73258]: DEBUG nova.compute.manager [None req-187b45f3-f991-4013-b2fd-9958bd6cf687 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:45:09 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:45:09 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:45:09 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 06:45:09 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118709.753124, 1672aa9f-be6f-4357-877f-a48f62119df4 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:45:09 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] VM Started (Lifecycle Event)
Aug 27 06:45:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] COPY block job progress, current cursor: 750780416 final cursor: 1073741824 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:45:09 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:45:09 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:45:10 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Updating instance_info_cache with network_info: [{"id": "27d47d21-922e-43da-8dee-8d62f45edd64", "address": "fa:16:3e:5c:73:20", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d47d21-92", "ovs_interfaceid": "27d47d21-922e-43da-8dee-8d62f45edd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:45:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Releasing lock "refresh_cache-7ee743f1-9611-4165-838e-54fccb332f1a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:45:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Instance network_info: |[{"id": "27d47d21-922e-43da-8dee-8d62f45edd64", "address": "fa:16:3e:5c:73:20", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d47d21-92", "ovs_interfaceid": "27d47d21-922e-43da-8dee-8d62f45edd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:45:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-992ed3c6-c38c-4ee2-870b-b5537059307d req-86d4032d-f2ff-4cdf-a9c5-ec28d1efcb72 service nova] Acquired lock "refresh_cache-7ee743f1-9611-4165-838e-54fccb332f1a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:45:10 user nova-compute[73258]: DEBUG nova.network.neutron [req-992ed3c6-c38c-4ee2-870b-b5537059307d req-86d4032d-f2ff-4cdf-a9c5-ec28d1efcb72 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Refreshing network info cache for port 27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:45:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] COPY block job progress, current cursor: 898629632 final cursor: 1073741824 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:45:10 user nova-compute[73258]: DEBUG nova.network.neutron [req-992ed3c6-c38c-4ee2-870b-b5537059307d req-86d4032d-f2ff-4cdf-a9c5-ec28d1efcb72 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Updated VIF entry in instance network info cache for port 27d47d21-922e-43da-8dee-8d62f45edd64. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:45:10 user nova-compute[73258]: DEBUG nova.network.neutron [req-992ed3c6-c38c-4ee2-870b-b5537059307d req-86d4032d-f2ff-4cdf-a9c5-ec28d1efcb72 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Updating instance_info_cache with network_info: [{"id": "27d47d21-922e-43da-8dee-8d62f45edd64", "address": "fa:16:3e:5c:73:20", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d47d21-92", "ovs_interfaceid": "27d47d21-922e-43da-8dee-8d62f45edd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:45:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-992ed3c6-c38c-4ee2-870b-b5537059307d req-86d4032d-f2ff-4cdf-a9c5-ec28d1efcb72 service nova] Releasing lock "refresh_cache-7ee743f1-9611-4165-838e-54fccb332f1a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:45:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] COPY block job progress, current cursor: 1006632960 final cursor: 1073741824 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.utils [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[19875b31-63cd-4fa0-a13a-661851598ce2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[926fc1a6-a52e-430d-83c6-3c9116d145b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f6e296-1882-43dc-ba6e-90512ffbdd19]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4876dca2-6ccb-4304-8308-446362f936a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReHTOrwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:45:11 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:45:11 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb3b039-cc58-418c-b372-6449a7d8ac66]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.utils [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Updating existing volume attachment record: f84d1190-d983-47ee-b315-3ad74e228f3c {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdcec29-7d8c-4716-9c25-6aba7cc14aa7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[427e3540-2ac1-4963-9b45-c3eaa395d485]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:11 user nova-compute[73258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)
Aug 27 06:45:11 user nova-compute[73258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)
Aug 27 06:45:11 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:11 user nova-compute[73258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)
Aug 27 06:45:11 user nova-compute[73258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)
Aug 27 06:45:11 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4305104c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589'): ({'sdc'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Removing single pathed devices sdc {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda64808-f723-4282-bdaa-118b16fa51ee]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa18fd80-1126-4a7f-ac2a-008b76b164c1]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Flushing IO for device /dev/sdc {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b303cf63-c4ba-4b30-aaae-a29c15c90a6f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dc60e2-2794-442d-9546-f1534287eba2]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83c2278-b126-4aac-8955-68809a165c44]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:12 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[129c9610-76fc-4b55-b315-5eb6dcdacd23]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:12 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589, portal: 172.16.0.220,3260]
Aug 27 06:45:12 user nova-compute[73258]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589, portal: 172.16.0.220,3260] successful.
Aug 27 06:45:12 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:12 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac6f545-4c3c-4aaa-8029-1b09dba9352e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:12 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:12 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:45:12 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] <== disconnect_volume: return (375ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:45:12 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:45:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNHzEYPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '21e7abcc-86a6-4315-9a84-9efcc907156f', 'attached_at': '', 'detached_at': '', 'volume_id': '87788861-0b5b-4709-b03d-1b67c7332c7f', 'serial'} {{(pid=73258) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 27 06:45:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] swap_volume: removing Cinder connection for volume 9fd08267-2d17-41de-a03a-cdbd78fcf589 {{(pid=73258) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] swap_volume: Updating volume 9fd08267-2d17-41de-a03a-cdbd78fcf589 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "yNHzEYPj", "auth_password": "F0uiOXUh1VzDIl", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "87788861-0b5b-4709-b03d-1b67c7332c7f"}, "status": "reserved", "instance": "21e7abcc-86a6-4315-9a84-9efcc907156f", "attached_at": "", "detached_at": "", "volume_id": "87788861-0b5b-4709-b03d-1b67c7332c7f", "serial": "87788861-0b5b-4709-b03d-1b67c7332c7f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '87788861-0b5b-4709-b03d-1b67c7332c7f', 'no_device': None, 'attachment_id': 'd041e41c-4628-463f-942f-cf0732aaab21'} {{(pid=73258) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d9d2aa4b-c84b-4b16-a920-dbd974222579 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 22.004s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Acquiring lock "21e7abcc-86a6-4315-9a84-9efcc907156f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.005s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG os_brick.utils [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fd6869-506a-47be-945e-1079778723fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[080f9ad7-15f9-401d-adc2-1e524e7252ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab699bd-c1f1-4595-b293-e92acda658c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[748da7f9-cc18-4cb8-8193-c93158c51e1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:45:13 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:45:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bad8573-b47a-4444-ba1e-0a232f9cdb9e]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:45:13 user nova-compute[73258]: DEBUG os_brick.utils [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:45:14 user nova-compute[73258]: INFO nova.compute.manager [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Swapping volume 87788861-0b5b-4709-b03d-1b67c7332c7f for 9fd08267-2d17-41de-a03a-cdbd78fcf589
Aug 27 06:45:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGxhdLjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:45:20 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:45:20 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:45:20 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5ed951-70b3-4c48-a501-fc7887e28277]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:45:20 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e98b64c-a25b-4ff0-b40e-38f20277ef27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e] added
Aug 27 06:45:20 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eea72d-28d9-4b8a-8562-66e64880b298]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccdf64a-d77f-4e9d-b39d-4b4253adb7ac]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JGxhdLjf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JGxhdLjf" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b324945f-7eda-4ecd-9e74-fe95bfb332ab]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JGxhdLjf'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd25184-b2e5-4f62-b575-763712ac3221]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fff749-e067-4aed-b255-05ffa6a8dd5f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:20 user nova-compute[73258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)
Aug 27 06:45:20 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:20 user nova-compute[73258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)
Aug 27 06:45:20 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7175e5ba-f388-461d-b311-abfefe8306d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e, portal: 172.16.0.220,3260]
Aug 27 06:45:20 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e, portal: 172.16.0.220,3260] successful.
Aug 27 06:45:20 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cdd5f1-6e21-4a76-b02d-33169bc449dd]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd7c91b-9b6d-4c62-88d6-6ec8a2c70ed2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:20 user nova-compute[73258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)
Aug 27 06:45:20 user nova-compute[73258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:45:20 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:20 user nova-compute[73258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)
Aug 27 06:45:20 user nova-compute[73258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:45:20 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc17987-47d9-46e7-92dc-7660068a8ca7]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:20 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: None {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:45:21 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:45:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGxhdLjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:45:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:45:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23162393531343935', 'path': '/dev/sdc'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:45:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162393531343935', 'path': '/dev/sdc'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:45:21 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'flavor' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:45:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:45:21 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:45:21 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 06:45:21 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:45:21 user nova-compute[73258]:   <serial>eb06556d-be68-45c0-ad6d-7b516b1d9f7e</serial>
Aug 27 06:45:21 user nova-compute[73258]: </disk>
Aug 27 06:45:21 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:45:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:45:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:45:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] No VIF found with MAC fa:16:3e:f5:fe:36, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:45:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a2045265-8eab-478f-b7ca-6db91a1f593b tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.248s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-806ffbfe-7c78-4115-bfdf-3dab74fdb5e6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-806ffbfe-7c78-4115-bfdf-3dab74fdb5e6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-806ffbfe-7c78-4115-bfdf-3dab74fdb5e6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:45:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-806ffbfe-7c78-4115-bfdf-3dab74fdb5e6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73258) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 27 06:45:22 user nova-compute[73258]: DEBUG nova.objects.instance [None req-806ffbfe-7c78-4115-bfdf-3dab74fdb5e6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'flavor' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:45:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:23 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Instance destroyed successfully.
Aug 27 06:45:23 user nova-compute[73258]: DEBUG nova.compute.manager [None req-806ffbfe-7c78-4115-bfdf-3dab74fdb5e6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:45:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-806ffbfe-7c78-4115-bfdf-3dab74fdb5e6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.985s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:23 user nova-compute[73258]: DEBUG nova.compute.manager [req-b40768c5-4c17-4642-8e00-6604f342170d req-50c86077-d0f2-427c-a945-3b09f32d796a service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-vif-unplugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:45:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b40768c5-4c17-4642-8e00-6604f342170d req-50c86077-d0f2-427c-a945-3b09f32d796a service nova] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b40768c5-4c17-4642-8e00-6604f342170d req-50c86077-d0f2-427c-a945-3b09f32d796a service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b40768c5-4c17-4642-8e00-6604f342170d req-50c86077-d0f2-427c-a945-3b09f32d796a service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:23 user nova-compute[73258]: DEBUG nova.compute.manager [req-b40768c5-4c17-4642-8e00-6604f342170d req-50c86077-d0f2-427c-a945-3b09f32d796a service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] No waiting events found dispatching network-vif-unplugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:45:23 user nova-compute[73258]: WARNING nova.compute.manager [req-b40768c5-4c17-4642-8e00-6604f342170d req-50c86077-d0f2-427c-a945-3b09f32d796a service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received unexpected event network-vif-unplugged-7b4375ea-f74b-4677-a768-97e96029c237 for instance with vm_state stopped and task_state None.
Aug 27 06:45:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:45:25 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Creating image(s)
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Did not create local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Ensure instance console log exists: /opt/stack/data/nova/instances/7ee743f1-9611-4165-838e-54fccb332f1a/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Start _get_guest_xml network_info=[{"id": "27d47d21-922e-43da-8dee-8d62f45edd64", "address": "fa:16:3e:5c:73:20", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d47d21-92", "ovs_interfaceid": "27d47d21-922e-43da-8dee-8d62f45edd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKkwYrbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7ee743f1-9611-4165-838e-54fccb332f1a', 'attached_at': '', 'detached_at': '', 'volume_id': '692b19f7-0f31-49f8-bfb3-fe4ef93542f7', 'serial': '692b19f7-0f31-49f8-bfb3-fe4ef93542f7'}, 'attachment_id': 'f84d1190-d983-47ee-b315-3ad74e228f3c', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:45:25 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:45:25 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKkwYrbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:45:25 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:45:25 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:45:25 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[17137b58-aa9e-4b18-a4a1-ae4aee41faf6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:45:25 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[90061b96-9e69-4a6c-b037-296648e96b76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7] added
Aug 27 06:45:25 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba9c4e0-a528-4141-8630-19e2e3845f66]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[728c04b3-cce4-431c-aa01-5d5bd6647c3e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AKkwYrbR {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AKkwYrbR" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabdaaf8-62e2-4fbe-8747-b4953f30c37e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AKkwYrbR'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb33fc49-4eff-47ce-8311-a2d10a8beab8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c5fe52-22fc-4126-8ece-50a6d8bd6dfb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:25 user nova-compute[73258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)
Aug 27 06:45:25 user nova-compute[73258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:45:25 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:25 user nova-compute[73258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)
Aug 27 06:45:25 user nova-compute[73258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:45:25 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.compute.manager [req-413464c7-7b59-4008-a751-cf6a1eed5858 req-c6c1e0ef-d07d-4c9a-b2e1-5d7fb2705ac4 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-413464c7-7b59-4008-a751-cf6a1eed5858 req-c6c1e0ef-d07d-4c9a-b2e1-5d7fb2705ac4 service nova] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-413464c7-7b59-4008-a751-cf6a1eed5858 req-c6c1e0ef-d07d-4c9a-b2e1-5d7fb2705ac4 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-413464c7-7b59-4008-a751-cf6a1eed5858 req-c6c1e0ef-d07d-4c9a-b2e1-5d7fb2705ac4 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG nova.compute.manager [req-413464c7-7b59-4008-a751-cf6a1eed5858 req-c6c1e0ef-d07d-4c9a-b2e1-5d7fb2705ac4 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] No waiting events found dispatching network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:45:25 user nova-compute[73258]: WARNING nova.compute.manager [req-413464c7-7b59-4008-a751-cf6a1eed5858 req-c6c1e0ef-d07d-4c9a-b2e1-5d7fb2705ac4 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received unexpected event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 for instance with vm_state stopped and task_state None.
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.140s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[589171b0-3197-42a1-9daa-03d2625934c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7, portal: 172.16.0.220,3260]
Aug 27 06:45:25 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7, portal: 172.16.0.220,3260] successful.
Aug 27 06:45:25 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd72002-6b1f-49d3-8ff4-163070a089fb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[984c2b9c-280b-4446-929a-3ef834560d53]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:25 user nova-compute[73258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)
Aug 27 06:45:25 user nova-compute[73258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:45:25 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:45:25 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:25 user nova-compute[73258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)
Aug 27 06:45:25 user nova-compute[73258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:45:25 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:45:25 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:45:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:26 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e239ccb0-1b75-47de-a84f-3db40f75a352]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:26 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:45:26 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKkwYrbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '23532303464613439', 'path': '/dev/sde'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532303464613439', 'path': '/dev/sde'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:45:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2132461241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2132461241',id=26,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81cf34590d8d4b8b89b9626c6e150df6',ramdisk_id='',reservation_id='r-tebfip5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:45:06Z,user_data=None,user_id='36c0faed29a446aa9fa6ff8692581aba',uuid=7ee743f1-9611-4165-838e-54fccb332f1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27d47d21-922e-43da-8dee-8d62f45edd64", "address": "fa:16:3e:5c:73:20", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d47d21-92", "ovs_interfaceid": "27d47d21-922e-43da-8dee-8d62f45edd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converting VIF {"id": "27d47d21-922e-43da-8dee-8d62f45edd64", "address": "fa:16:3e:5c:73:20", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d47d21-92", "ovs_interfaceid": "27d47d21-922e-43da-8dee-8d62f45edd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:73:20,bridge_name='br-int',has_traffic_filtering=True,id=27d47d21-922e-43da-8dee-8d62f45edd64,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d47d21-92') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG nova.objects.instance [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ee743f1-9611-4165-838e-54fccb332f1a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:45:27 user nova-compute[73258]:   <uuid>7ee743f1-9611-4165-838e-54fccb332f1a</uuid>
Aug 27 06:45:27 user nova-compute[73258]:   <name>instance-0000001a</name>
Aug 27 06:45:27 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:45:27 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:45:27 user nova-compute[73258]:   <metadata>
Aug 27 06:45:27 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:45:27 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:45:27 user nova-compute[73258]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2132461241</nova:name>
Aug 27 06:45:27 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:45:25</nova:creationTime>
Aug 27 06:45:27 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:45:27 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:45:27 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:45:27 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:45:27 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:45:27 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:45:27 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:45:27 user nova-compute[73258]:       <nova:owner>
Aug 27 06:45:27 user nova-compute[73258]:         <nova:user uuid="36c0faed29a446aa9fa6ff8692581aba">tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member</nova:user>
Aug 27 06:45:27 user nova-compute[73258]:         <nova:project uuid="81cf34590d8d4b8b89b9626c6e150df6">tempest-ServerBootFromVolumeStableRescueTest-1306655557</nova:project>
Aug 27 06:45:27 user nova-compute[73258]:       </nova:owner>
Aug 27 06:45:27 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:45:27 user nova-compute[73258]:       <nova:ports>
Aug 27 06:45:27 user nova-compute[73258]:         <nova:port uuid="27d47d21-922e-43da-8dee-8d62f45edd64">
Aug 27 06:45:27 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 06:45:27 user nova-compute[73258]:         </nova:port>
Aug 27 06:45:27 user nova-compute[73258]:       </nova:ports>
Aug 27 06:45:27 user nova-compute[73258]:     </nova:instance>
Aug 27 06:45:27 user nova-compute[73258]:   </metadata>
Aug 27 06:45:27 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:45:27 user nova-compute[73258]:     <system>
Aug 27 06:45:27 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:45:27 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:45:27 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:45:27 user nova-compute[73258]:       <entry name="serial">7ee743f1-9611-4165-838e-54fccb332f1a</entry>
Aug 27 06:45:27 user nova-compute[73258]:       <entry name="uuid">7ee743f1-9611-4165-838e-54fccb332f1a</entry>
Aug 27 06:45:27 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:45:27 user nova-compute[73258]:     </system>
Aug 27 06:45:27 user nova-compute[73258]:   </sysinfo>
Aug 27 06:45:27 user nova-compute[73258]:   <os>
Aug 27 06:45:27 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:45:27 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:45:27 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:45:27 user nova-compute[73258]:   </os>
Aug 27 06:45:27 user nova-compute[73258]:   <features>
Aug 27 06:45:27 user nova-compute[73258]:     <acpi/>
Aug 27 06:45:27 user nova-compute[73258]:     <apic/>
Aug 27 06:45:27 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:45:27 user nova-compute[73258]:   </features>
Aug 27 06:45:27 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:45:27 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:45:27 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:45:27 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:45:27 user nova-compute[73258]:   </clock>
Aug 27 06:45:27 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:45:27 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:45:27 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:45:27 user nova-compute[73258]:   </cpu>
Aug 27 06:45:27 user nova-compute[73258]:   <devices>
Aug 27 06:45:27 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:45:27 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:45:27 user nova-compute[73258]:       <source dev="/dev/sde"/>
Aug 27 06:45:27 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:45:27 user nova-compute[73258]:       <serial>692b19f7-0f31-49f8-bfb3-fe4ef93542f7</serial>
Aug 27 06:45:27 user nova-compute[73258]:     </disk>
Aug 27 06:45:27 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:45:27 user nova-compute[73258]:       <mac address="fa:16:3e:5c:73:20"/>
Aug 27 06:45:27 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:45:27 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:45:27 user nova-compute[73258]:       <target dev="tap27d47d21-92"/>
Aug 27 06:45:27 user nova-compute[73258]:     </interface>
Aug 27 06:45:27 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:45:27 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/7ee743f1-9611-4165-838e-54fccb332f1a/console.log" append="off"/>
Aug 27 06:45:27 user nova-compute[73258]:     </serial>
Aug 27 06:45:27 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:45:27 user nova-compute[73258]:     <video>
Aug 27 06:45:27 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:45:27 user nova-compute[73258]:     </video>
Aug 27 06:45:27 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:45:27 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:45:27 user nova-compute[73258]:     </rng>
Aug 27 06:45:27 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:45:27 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:45:27 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:45:27 user nova-compute[73258]:     </memballoon>
Aug 27 06:45:27 user nova-compute[73258]:   </devices>
Aug 27 06:45:27 user nova-compute[73258]: </domain>
Aug 27 06:45:27 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:45:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2132461241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2132461241',id=26,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81cf34590d8d4b8b89b9626c6e150df6',ramdisk_id='',reservation_id='r-tebfip5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:45:06Z,user_data=None,user_id='36c0faed29a446aa9fa6ff8692581aba',uuid=7ee743f1-9611-4165-838e-54fccb332f1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27d47d21-922e-43da-8dee-8d62f45edd64", "address": "fa:16:3e:5c:73:20", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d47d21-92", "ovs_interfaceid": "27d47d21-922e-43da-8dee-8d62f45edd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converting VIF {"id": "27d47d21-922e-43da-8dee-8d62f45edd64", "address": "fa:16:3e:5c:73:20", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d47d21-92", "ovs_interfaceid": "27d47d21-922e-43da-8dee-8d62f45edd64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:73:20,bridge_name='br-int',has_traffic_filtering=True,id=27d47d21-922e-43da-8dee-8d62f45edd64,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d47d21-92') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG os_vif [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:73:20,bridge_name='br-int',has_traffic_filtering=True,id=27d47d21-922e-43da-8dee-8d62f45edd64,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d47d21-92') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27d47d21-92, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27d47d21-92, col_values=(('external_ids', {'iface-id': '27d47d21-922e-43da-8dee-8d62f45edd64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:73:20', 'vm-uuid': '7ee743f1-9611-4165-838e-54fccb332f1a'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:27 user nova-compute[73258]: INFO os_vif [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:73:20,bridge_name='br-int',has_traffic_filtering=True,id=27d47d21-922e-43da-8dee-8d62f45edd64,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d47d21-92')
Aug 27 06:45:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:45:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] No VIF found with MAC fa:16:3e:5c:73:20, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReHTOrwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '21e7abcc-86a6-4315-9a84-9efcc907156f', 'attached_at': '', 'detached_at': '', 'volume_id': '9fd08267-2d17-41de-a03a-cdbd78fcf589', 'serial': '9fd08267-2d17-41de-a03a-cdbd78fcf589'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNHzEYPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '87788861-0b5b-4709-b03d-1b67c7332c7f'}, 'status': 'reserved', 'instance': '21e7abcc-86a6-4315-9a84-9efcc907156f', 'attached_at': '', 'detached_at': '', 'volume_id': '87788861-0b5b-4709-b03d-1b67c7332c7f', 'serial'} {{(pid=73258) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReHTOrwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:45:28 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:45:28 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:45:28 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b066da-579b-4437-a434-7bc0b90a0e10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:45:28 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eed848a-7ee4-4fa3-9690-f2e975288bb7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589] added
Aug 27 06:45:28 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0e4047-6e4a-4d2a-8e9c-0c7f4da23a15]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[46379e39-8dac-4ef3-9a9c-44ad8caea44b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ReHTOrwU {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ReHTOrwU" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dbe1a0-dbb0-4441-b53a-5c2bacf74e30]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ReHTOrwU'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1f05c9-70d3-4384-b7f2-33872038d381]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7ee628-e85f-4712-9f2b-890138be8f23]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:28 user nova-compute[73258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)
Aug 27 06:45:28 user nova-compute[73258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:45:28 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:45:28 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:28 user nova-compute[73258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)
Aug 27 06:45:28 user nova-compute[73258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:45:28 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:45:28 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0dbad7-ebee-440f-a164-2cc5f955b44f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589, portal: 172.16.0.220,3260]
Aug 27 06:45:28 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589, portal: 172.16.0.220,3260] successful.
Aug 27 06:45:28 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a60dc2-0b20-4669-a965-914ecf802c1d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f29a2b-dab2-46f7-b1d6-4decd5a3fd97]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:28 user nova-compute[73258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)
Aug 27 06:45:28 user nova-compute[73258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:45:28 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:45:28 user nova-compute[73258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)
Aug 27 06:45:28 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:28 user nova-compute[73258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)
Aug 27 06:45:28 user nova-compute[73258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:45:28 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:45:28 user nova-compute[73258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)
Aug 27 06:45:28 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] HCTL ('37', '-', '-', 0) found on session 25 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[98132b02-05ad-49ca-9e52-dc77011e37a5]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Searching for a device in session 25 and hctl ['37', '*', '*', 0] yield: None {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-d4ec366c-6f3d-434f-be51-9056a50ec740 req-8c4e33d5-32b5-454e-a8cb-28e597501657 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received event network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d4ec366c-6f3d-434f-be51-9056a50ec740 req-8c4e33d5-32b5-454e-a8cb-28e597501657 service nova] Acquiring lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d4ec366c-6f3d-434f-be51-9056a50ec740 req-8c4e33d5-32b5-454e-a8cb-28e597501657 service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d4ec366c-6f3d-434f-be51-9056a50ec740 req-8c4e33d5-32b5-454e-a8cb-28e597501657 service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-d4ec366c-6f3d-434f-be51-9056a50ec740 req-8c4e33d5-32b5-454e-a8cb-28e597501657 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] No waiting events found dispatching network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:45:28 user nova-compute[73258]: WARNING nova.compute.manager [req-d4ec366c-6f3d-434f-be51-9056a50ec740 req-8c4e33d5-32b5-454e-a8cb-28e597501657 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received unexpected event network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 for instance with vm_state building and task_state spawning.
Aug 27 06:45:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:29 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Searching for a device in session 25 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:45:29 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReHTOrwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:45:29 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:45:29 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26665666539303833', 'path': '/dev/sdf'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:45:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665666539303833', 'path': '/dev/sdf'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:45:29 user nova-compute[73258]: DEBUG nova.objects.instance [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Lazy-loading 'flavor' on Instance uuid 21e7abcc-86a6-4315-9a84-9efcc907156f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:45:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:45:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] COPY block job progress, current cursor: 143654912 final cursor: 1073741824 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:45:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-f1f5e034-c2f6-4d70-8014-ff553b1d24e8 req-4c4205bf-8849-4d9f-ab3f-d59a92ab0cb9 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received event network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:45:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f1f5e034-c2f6-4d70-8014-ff553b1d24e8 req-4c4205bf-8849-4d9f-ab3f-d59a92ab0cb9 service nova] Acquiring lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f1f5e034-c2f6-4d70-8014-ff553b1d24e8 req-4c4205bf-8849-4d9f-ab3f-d59a92ab0cb9 service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f1f5e034-c2f6-4d70-8014-ff553b1d24e8 req-4c4205bf-8849-4d9f-ab3f-d59a92ab0cb9 service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-f1f5e034-c2f6-4d70-8014-ff553b1d24e8 req-4c4205bf-8849-4d9f-ab3f-d59a92ab0cb9 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] No waiting events found dispatching network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:45:30 user nova-compute[73258]: WARNING nova.compute.manager [req-f1f5e034-c2f6-4d70-8014-ff553b1d24e8 req-4c4205bf-8849-4d9f-ab3f-d59a92ab0cb9 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received unexpected event network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 for instance with vm_state building and task_state spawning.
Aug 27 06:45:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] COPY block job progress, current cursor: 273678336 final cursor: 1073741824 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:45:30 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118730.8771007, 7ee743f1-9611-4165-838e-54fccb332f1a => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:45:30 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] VM Resumed (Lifecycle Event)
Aug 27 06:45:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:45:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:45:30 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Instance spawned successfully.
Aug 27 06:45:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:45:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:45:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:45:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:45:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:45:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:45:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:45:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:45:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:45:30 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:45:30 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118730.8803034, 7ee743f1-9611-4165-838e-54fccb332f1a => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:45:30 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] VM Started (Lifecycle Event)
Aug 27 06:45:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:45:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:45:31 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:45:31 user nova-compute[73258]: INFO nova.compute.manager [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Took 5.50 seconds to spawn the instance on the hypervisor.
Aug 27 06:45:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:45:31 user nova-compute[73258]: INFO nova.compute.manager [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Took 26.54 seconds to build instance.
Aug 27 06:45:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6aa87921-4d19-4230-a936-16dbfcb7c867 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "7ee743f1-9611-4165-838e-54fccb332f1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.655s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] COPY block job progress, current cursor: 421527552 final cursor: 1073741824 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:45:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] COPY block job progress, current cursor: 525336576 final cursor: 1073741824 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:45:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] COPY block job progress, current cursor: 655360000 final cursor: 1073741824 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:45:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] COPY block job progress, current cursor: 834666496 final cursor: 1073741824 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:45:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] COPY block job progress, current cursor: 998244352 final cursor: 1073741824 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:45:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:45:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNHzEYPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '87788861-0b5b-4709-b03d-1b67c7332c7f'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:45:34 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:45:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f711409d-d3ef-4b71-b02a-c6108971b495]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e82722-ce5f-4a6d-8eee-6fe4633ffdcd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:34 user nova-compute[73258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)
Aug 27 06:45:34 user nova-compute[73258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:45:34 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:45:34 user nova-compute[73258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)
Aug 27 06:45:34 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:34 user nova-compute[73258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f (non-flash)
Aug 27 06:45:34 user nova-compute[73258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:45:34 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:45:34 user nova-compute[73258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)
Aug 27 06:45:34 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa410526170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f'): ({'sdd'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Removing single pathed devices sdd {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebdcbaf-d5e8-4b5c-898d-af13698a8199]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8518b6b-8103-40a5-8791-adbe2549d1e0]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Flushing IO for device /dev/sdd {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f021ecf2-d2be-4f35-b253-d4c27d1b5e13]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5e08d5-8f27-4a24-b6b2-d8c6569bf3f1]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] SCSI volumes sdd have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e967f50-2bd1-447f-b330-4f1164aad2a9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7064fb06-3aac-4391-a2b8-a67b1d52154a]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f, portal: 172.16.0.220,3260]
Aug 27 06:45:34 user nova-compute[73258]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f, portal: 172.16.0.220,3260] successful.
Aug 27 06:45:34 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-3a4c2a3c-2e04-4691-9481-af8fe51e717f req-184deb55-7cbe-4844-b15c-ea36e2a2863c service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Received event network-changed-fe2e1694-c46e-4a27-99ae-695d0394799a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-3a4c2a3c-2e04-4691-9481-af8fe51e717f req-184deb55-7cbe-4844-b15c-ea36e2a2863c service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Refreshing instance network info cache due to event network-changed-fe2e1694-c46e-4a27-99ae-695d0394799a. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3a4c2a3c-2e04-4691-9481-af8fe51e717f req-184deb55-7cbe-4844-b15c-ea36e2a2863c service nova] Acquiring lock "refresh_cache-2e89032a-0f74-4116-867e-a3b46fd20a7a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3a4c2a3c-2e04-4691-9481-af8fe51e717f req-184deb55-7cbe-4844-b15c-ea36e2a2863c service nova] Acquired lock "refresh_cache-2e89032a-0f74-4116-867e-a3b46fd20a7a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG nova.network.neutron [req-3a4c2a3c-2e04-4691-9481-af8fe51e717f req-184deb55-7cbe-4844-b15c-ea36e2a2863c service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Refreshing network info cache for port fe2e1694-c46e-4a27-99ae-695d0394799a {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87788861-0b5b-4709-b03d-1b67c7332c7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56760b4-1c49-41f9-b2f3-6cae8979e67c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] <== disconnect_volume: return (334ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG nova.compute.manager [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReHTOrwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '21e7abcc-86a6-4315-9a84-9efcc907156f', 'attached_at': '', 'detached_at': '', 'volume_id': '9fd08267-2d17-41de-a03a-cdbd78fcf589', 'serial'} {{(pid=73258) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 27 06:45:34 user nova-compute[73258]: DEBUG nova.compute.manager [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] swap_volume: removing Cinder connection for volume 87788861-0b5b-4709-b03d-1b67c7332c7f {{(pid=73258) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 27 06:45:35 user nova-compute[73258]: DEBUG nova.compute.manager [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] swap_volume: Updating volume 87788861-0b5b-4709-b03d-1b67c7332c7f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "ReHTOrwU", "auth_password": "lvsFrUxIXjo78p", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "9fd08267-2d17-41de-a03a-cdbd78fcf589"}, "status": "reserved", "instance": "21e7abcc-86a6-4315-9a84-9efcc907156f", "attached_at": "", "detached_at": "", "volume_id": "9fd08267-2d17-41de-a03a-cdbd78fcf589", "serial": "9fd08267-2d17-41de-a03a-cdbd78fcf589"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '9fd08267-2d17-41de-a03a-cdbd78fcf589', 'no_device': None, 'attachment_id': '62b580a0-e530-4ac6-b23a-f81b3a54dfcc'} {{(pid=73258) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 27 06:45:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-81177651-d963-4ec5-b11a-158767a830d0 tempest-TestVolumeSwap-414594815 tempest-TestVolumeSwap-414594815-project-admin] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 21.567s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:35 user nova-compute[73258]: DEBUG nova.network.neutron [req-3a4c2a3c-2e04-4691-9481-af8fe51e717f req-184deb55-7cbe-4844-b15c-ea36e2a2863c service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Updated VIF entry in instance network info cache for port fe2e1694-c46e-4a27-99ae-695d0394799a. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:45:35 user nova-compute[73258]: DEBUG nova.network.neutron [req-3a4c2a3c-2e04-4691-9481-af8fe51e717f req-184deb55-7cbe-4844-b15c-ea36e2a2863c service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Updating instance_info_cache with network_info: [{"id": "fe2e1694-c46e-4a27-99ae-695d0394799a", "address": "fa:16:3e:0c:40:0b", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e1694-c4", "ovs_interfaceid": "fe2e1694-c46e-4a27-99ae-695d0394799a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:45:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3a4c2a3c-2e04-4691-9481-af8fe51e717f req-184deb55-7cbe-4844-b15c-ea36e2a2863c service nova] Releasing lock "refresh_cache-2e89032a-0f74-4116-867e-a3b46fd20a7a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:45:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Acquiring lock "21e7abcc-86a6-4315-9a84-9efcc907156f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:35 user nova-compute[73258]: INFO nova.compute.manager [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Detaching volume 9fd08267-2d17-41de-a03a-cdbd78fcf589
Aug 27 06:45:35 user nova-compute[73258]: INFO nova.virt.block_device [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Attempting to driver detach volume 9fd08267-2d17-41de-a03a-cdbd78fcf589 from mountpoint /dev/vdb
Aug 27 06:45:35 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Attempting to detach device vdb from instance 21e7abcc-86a6-4315-9a84-9efcc907156f from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:45:35 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:45:35 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:45:35 user nova-compute[73258]:   <source dev="/dev/sdf"/>
Aug 27 06:45:35 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:45:35 user nova-compute[73258]:   <serial>9fd08267-2d17-41de-a03a-cdbd78fcf589</serial>
Aug 27 06:45:35 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:45:35 user nova-compute[73258]: </disk>
Aug 27 06:45:35 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:45:36 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Successfully detached device vdb from instance 21e7abcc-86a6-4315-9a84-9efcc907156f from the persistent domain config.
Aug 27 06:45:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 21e7abcc-86a6-4315-9a84-9efcc907156f from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:45:36 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:45:36 user nova-compute[73258]:   <source dev="/dev/sdf"/>
Aug 27 06:45:36 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:45:36 user nova-compute[73258]:   <serial>9fd08267-2d17-41de-a03a-cdbd78fcf589</serial>
Aug 27 06:45:36 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:45:36 user nova-compute[73258]: </disk>
Aug 27 06:45:36 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693118736.5765738, 21e7abcc-86a6-4315-9a84-9efcc907156f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 21e7abcc-86a6-4315-9a84-9efcc907156f {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:45:36 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Successfully detached device vdb from instance 21e7abcc-86a6-4315-9a84-9efcc907156f from the live domain config.
Aug 27 06:45:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReHTOrwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '9fd08267-2d17-41de-a03a-cdbd78fcf589'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:45:36 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:45:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31b888a-271d-4a5b-93ed-c2f122385be9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a685be5a-ced0-45e0-b6c1-4c1bd24bafab]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:36 user nova-compute[73258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:45:36 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:45:36 user nova-compute[73258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)
Aug 27 06:45:36 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:36 user nova-compute[73258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:45:36 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:45:36 user nova-compute[73258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 (non-flash)
Aug 27 06:45:36 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4305c1990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589'): ({'sdf'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Removing single pathed devices sdf {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d192b063-2ede-498a-9198-29df5649efb9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7a6597-69bd-4e37-893a-cd82c347a2e6]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Flushing IO for device /dev/sdf {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3dcd1d-494d-4a93-a99f-c57fb2bdd46c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ee85ec-4dca-4389-84d8-e2841b907d7f]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] SCSI volumes sdf have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.100s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e56cbb-a4b9-4336-ac8f-e9b523ea7378]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f1e61c-32b8-428f-87b0-eec0df016ff4]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589, portal: 172.16.0.220,3260]
Aug 27 06:45:36 user nova-compute[73258]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589, portal: 172.16.0.220,3260] successful.
Aug 27 06:45:36 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa967edd-477b-45ab-b70d-1c2c0162a8cb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] <== disconnect_volume: return (366ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:45:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:45:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:38 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118723.5879316, 9517c681-ed2b-49c2-94a6-aa2181b4b62f => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:45:38 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] VM Stopped (Lifecycle Event)
Aug 27 06:45:38 user nova-compute[73258]: DEBUG nova.compute.manager [None req-88929267-a67c-40fa-a1c9-92d284cad431 None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:45:38 user nova-compute[73258]: DEBUG nova.compute.manager [None req-88929267-a67c-40fa-a1c9-92d284cad431 None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:45:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "2e89032a-0f74-4116-867e-a3b46fd20a7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "2e89032a-0f74-4116-867e-a3b46fd20a7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG nova.objects.instance [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lazy-loading 'flavor' on Instance uuid 2e89032a-0f74-4116-867e-a3b46fd20a7a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "2e89032a-0f74-4116-867e-a3b46fd20a7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "2e89032a-0f74-4116-867e-a3b46fd20a7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "2e89032a-0f74-4116-867e-a3b46fd20a7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:39 user nova-compute[73258]: INFO nova.compute.manager [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Attaching volume f52bfde5-cdc1-4c72-bb83-553cd7979aad to /dev/vdb
Aug 27 06:45:39 user nova-compute[73258]: DEBUG os_brick.utils [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae110b09-444c-4e2c-8569-3398120b81f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4c7680-8118-4848-af95-7c0e34ee7588]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dcc77b-7b8e-439c-9f2b-3c43d388fffe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fd1491-37f2-4def-b9c6-ad1387ae5f2c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:45:39 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:45:39 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[00953021-996d-42ad-8921-7365048109a2]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG os_brick.utils [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:45:39 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Updating existing volume attachment record: b47f8547-0c1a-4774-a5ae-9aad9a825f1d {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:45:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:45:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:45:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:45:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-9acc81d9-12bc-46d6-8af9-2fc3106de2b2" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:45:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-9acc81d9-12bc-46d6-8af9-2fc3106de2b2" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:45:43 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:45:43 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Updating instance_info_cache with network_info: [{"id": "f177246f-1def-438b-8ac0-08f4e9cfed50", "address": "fa:16:3e:76:c0:d7", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf177246f-1d", "ovs_interfaceid": "f177246f-1def-438b-8ac0-08f4e9cfed50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:45:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-9acc81d9-12bc-46d6-8af9-2fc3106de2b2" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:45:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:45:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:45:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:45:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:45:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:45:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:45:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:45:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:45:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "4a2970a3-2a05-4462-bf0b-1595743222fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:45 user nova-compute[73258]: INFO nova.compute.manager [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Detaching volume 15319228-580b-4a94-aa25-32c646a7c19c
Aug 27 06:45:45 user nova-compute[73258]: INFO nova.virt.block_device [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Attempting to driver detach volume 15319228-580b-4a94-aa25-32c646a7c19c from mountpoint /dev/vdb
Aug 27 06:45:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Attempting to detach device vdb from instance 4a2970a3-2a05-4462-bf0b-1595743222fb from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:45:45 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:45:45 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:45:45 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:45:45 user nova-compute[73258]:   <serial>15319228-580b-4a94-aa25-32c646a7c19c</serial>
Aug 27 06:45:45 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 06:45:45 user nova-compute[73258]: </disk>
Aug 27 06:45:45 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:45:45 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Successfully detached device vdb from instance 4a2970a3-2a05-4462-bf0b-1595743222fb from the persistent domain config.
Aug 27 06:45:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4a2970a3-2a05-4462-bf0b-1595743222fb from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:45:45 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:45:45 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:45:45 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:45:45 user nova-compute[73258]:   <serial>15319228-580b-4a94-aa25-32c646a7c19c</serial>
Aug 27 06:45:45 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 06:45:45 user nova-compute[73258]: </disk>
Aug 27 06:45:45 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693118745.614072, 4a2970a3-2a05-4462-bf0b-1595743222fb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4a2970a3-2a05-4462-bf0b-1595743222fb {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:45:45 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Successfully detached device vdb from instance 4a2970a3-2a05-4462-bf0b-1595743222fb from the live domain config.
Aug 27 06:45:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TirxAwPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:45:45 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:45:45 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5268c4-9f62-44e1-b0fd-0de1fda2d0ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2039a503-4ceb-4ff6-bdde-ade890c2b6ea]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:45 user nova-compute[73258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:45:45 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:45:45 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c (non-flash)
Aug 27 06:45:45 user nova-compute[73258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:45:45 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:45:45 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa410427910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[af86cdf3-241f-4622-a9f5-299cbd34bcf0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0994fa1-7e74-4356-b26a-2b9fabdb9323]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd89e303-9a9a-4f97-a3b1-17a2b5c9e7a4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e3aaeb-dd0d-45ea-ba4c-d033b061cfe3]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e05835-b569-40e3-bdf1-f4223a586dbe]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef13ed27-8610-4f2a-bb54-e13e280a2ae0]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c, portal: 172.16.0.220,3260]
Aug 27 06:45:45 user nova-compute[73258]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c, portal: 172.16.0.220,3260] successful.
Aug 27 06:45:45 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15319228-580b-4a94-aa25-32c646a7c19c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[772bd7c6-8c37-4de9-ba05-275fcd36ac66]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] <== disconnect_volume: return (305ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:45:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:45:46 user nova-compute[73258]: DEBUG nova.objects.instance [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lazy-loading 'flavor' on Instance uuid 21e7abcc-86a6-4315-9a84-9efcc907156f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:45:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7666e438-8e7b-4f63-8e6b-deb0783150ab tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 10.495s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.volume.cinder [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Update attachment failed for attachment b47f8547-0c1a-4774-a5ae-9aad9a825f1d. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:f52bfde5-cdc1-4c72-bb83-553cd7979aad because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:f52bfde5-cdc1-4c72-bb83-553cd7979aad/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 was not found.).). (HTTP 500) (Request-ID: req-17447919-ec0c-4b1b-adac-0424d7caba45) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:f52bfde5-cdc1-4c72-bb83-553cd7979aad because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:f52bfde5-cdc1-4c72-bb83-553cd7979aad/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 was not found.).). (HTTP 500) (Request-ID: req-17447919-ec0c-4b1b-adac-0424d7caba45)
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Failed to attach f52bfde5-cdc1-4c72-bb83-553cd7979aad at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:f52bfde5-cdc1-4c72-bb83-553cd7979aad because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:f52bfde5-cdc1-4c72-bb83-553cd7979aad/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 was not found.).). (HTTP 500) (Request-ID: req-17447919-ec0c-4b1b-adac-0424d7caba45)
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Traceback (most recent call last):
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]     ret_val = method(obj, context, *args, **kwargs)
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]     self._do_attach(context, instance, volume, volume_api,
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]     self._volume_attach(context, volume, connector, instance,
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]     connection_info = volume_api.attachment_update(
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]     res = method(self, ctx, *args, **kwargs)
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]     with excutils.save_and_reraise_exception():
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]     self.force_reraise()
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]     raise self.value
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]     context, '3.44', skip_version_check=True).attachments.update(
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]     return method.func(obj, *args, **kwargs)
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]     resp = self._update('/attachments/%s' % id, body)
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]     return self._cs_request(url, 'PUT', **kwargs)
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]     return self.request(url, method, **kwargs)
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a]     raise exceptions.from_response(resp, body)
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:f52bfde5-cdc1-4c72-bb83-553cd7979aad because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:f52bfde5-cdc1-4c72-bb83-553cd7979aad/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 was not found.).). (HTTP 500) (Request-ID: req-17447919-ec0c-4b1b-adac-0424d7caba45)
Aug 27 06:45:46 user nova-compute[73258]: ERROR nova.compute.manager [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] 
Aug 27 06:45:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "2e89032a-0f74-4116-867e-a3b46fd20a7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.479s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server [None req-eade7cc7-8886-49a5-b626-c896950da887 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:f52bfde5-cdc1-4c72-bb83-553cd7979aad because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:f52bfde5-cdc1-4c72-bb83-553cd7979aad/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 was not found.).). (HTTP 500) (Request-ID: req-17447919-ec0c-4b1b-adac-0424d7caba45)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:f52bfde5-cdc1-4c72-bb83-553cd7979aad because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:f52bfde5-cdc1-4c72-bb83-553cd7979aad/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:9fd08267-2d17-41de-a03a-cdbd78fcf589 was not found.).). (HTTP 500) (Request-ID: req-17447919-ec0c-4b1b-adac-0424d7caba45)
Aug 27 06:45:47 user nova-compute[73258]: ERROR oslo_messaging.rpc.server 
Aug 27 06:45:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:47 user nova-compute[73258]: DEBUG nova.objects.instance [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lazy-loading 'flavor' on Instance uuid 4a2970a3-2a05-4462-bf0b-1595743222fb {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:45:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4358abb4-3ba7-4dc9-9eaf-3f5e4aea0671 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.140s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:48 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:45:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:48 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:45:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af558a1a-7bee-46b9-8b00-ff5f5a545e8e/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af558a1a-7bee-46b9-8b00-ff5f5a545e8e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af558a1a-7bee-46b9-8b00-ff5f5a545e8e/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af558a1a-7bee-46b9-8b00-ff5f5a545e8e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:51 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:45:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:45:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:45:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:45:54 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:45:55 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:45:55 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:45:55 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=6906MB free_disk=24.09272003173828GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1672aa9f-be6f-4357-877f-a48f62119df4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 4a2970a3-2a05-4462-bf0b-1595743222fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a836678e-240d-4ead-b0b5-64d146910a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 21e7abcc-86a6-4315-9a84-9efcc907156f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9517c681-ed2b-49c2-94a6-aa2181b4b62f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 8396ca48-c47c-41b1-9872-24dbb0b9f526 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 2e89032a-0f74-4116-867e-a3b46fd20a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 50505a95-da00-4238-966d-c0a1e188b25c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance e6e96ad8-e34e-4970-b3a6-c06df0c6d994 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance af558a1a-7bee-46b9-8b00-ff5f5a545e8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 7ee743f1-9611-4165-838e-54fccb332f1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:45:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:45:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-b18b5ab3-b6eb-44d6-863d-d523d60d46d9 req-09d4d4b2-9c6d-49a6-83ef-6a095c1df146 service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Received event network-changed-13b80966-4283-4438-ae88-8c0a770c1c55 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-b18b5ab3-b6eb-44d6-863d-d523d60d46d9 req-09d4d4b2-9c6d-49a6-83ef-6a095c1df146 service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Refreshing instance network info cache due to event network-changed-13b80966-4283-4438-ae88-8c0a770c1c55. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b18b5ab3-b6eb-44d6-863d-d523d60d46d9 req-09d4d4b2-9c6d-49a6-83ef-6a095c1df146 service nova] Acquiring lock "refresh_cache-50505a95-da00-4238-966d-c0a1e188b25c" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b18b5ab3-b6eb-44d6-863d-d523d60d46d9 req-09d4d4b2-9c6d-49a6-83ef-6a095c1df146 service nova] Acquired lock "refresh_cache-50505a95-da00-4238-966d-c0a1e188b25c" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG nova.network.neutron [req-b18b5ab3-b6eb-44d6-863d-d523d60d46d9 req-09d4d4b2-9c6d-49a6-83ef-6a095c1df146 service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Refreshing network info cache for port 13b80966-4283-4438-ae88-8c0a770c1c55 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "50505a95-da00-4238-966d-c0a1e188b25c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "50505a95-da00-4238-966d-c0a1e188b25c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG nova.objects.instance [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lazy-loading 'flavor' on Instance uuid 50505a95-da00-4238-966d-c0a1e188b25c {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:46:13 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Ignoring supplied device name: /dev/vdb
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "50505a95-da00-4238-966d-c0a1e188b25c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "50505a95-da00-4238-966d-c0a1e188b25c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "50505a95-da00-4238-966d-c0a1e188b25c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:13 user nova-compute[73258]: INFO nova.compute.manager [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Attaching volume 738d1fa4-5c20-472d-8b10-d7324321863c to /dev/vdb
Aug 27 06:46:13 user nova-compute[73258]: DEBUG nova.network.neutron [req-b18b5ab3-b6eb-44d6-863d-d523d60d46d9 req-09d4d4b2-9c6d-49a6-83ef-6a095c1df146 service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Updated VIF entry in instance network info cache for port 13b80966-4283-4438-ae88-8c0a770c1c55. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG nova.network.neutron [req-b18b5ab3-b6eb-44d6-863d-d523d60d46d9 req-09d4d4b2-9c6d-49a6-83ef-6a095c1df146 service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Updating instance_info_cache with network_info: [{"id": "13b80966-4283-4438-ae88-8c0a770c1c55", "address": "fa:16:3e:07:c3:72", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b80966-42", "ovs_interfaceid": "13b80966-4283-4438-ae88-8c0a770c1c55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG os_brick.utils [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b18b5ab3-b6eb-44d6-863d-d523d60d46d9 req-09d4d4b2-9c6d-49a6-83ef-6a095c1df146 service nova] Releasing lock "refresh_cache-50505a95-da00-4238-966d-c0a1e188b25c" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6274346f-310a-4423-a160-60f382257593]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[de227d75-3b27-4050-acde-9771777508e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c3f5e4-8c6a-4037-9060-dea52cd1da2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71cf90d-2bd2-4237-b5fd-3409034bb993]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:46:13 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:46:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac7262c-b053-4149-9742-f34294567f88]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG os_brick.utils [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Updating existing volume attachment record: 3569d793-6896-4e03-be17-e2f1fbc96287 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:46:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-a62465f8-f90d-4ed2-a976-a9916670bf4a req-9a977618-266e-4d1f-83fd-259f8808bf7e service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received event network-changed-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-a62465f8-f90d-4ed2-a976-a9916670bf4a req-9a977618-266e-4d1f-83fd-259f8808bf7e service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Refreshing instance network info cache due to event network-changed-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:46:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a62465f8-f90d-4ed2-a976-a9916670bf4a req-9a977618-266e-4d1f-83fd-259f8808bf7e service nova] Acquiring lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:46:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a62465f8-f90d-4ed2-a976-a9916670bf4a req-9a977618-266e-4d1f-83fd-259f8808bf7e service nova] Acquired lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:46:20 user nova-compute[73258]: DEBUG nova.network.neutron [req-a62465f8-f90d-4ed2-a976-a9916670bf4a req-9a977618-266e-4d1f-83fd-259f8808bf7e service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Refreshing network info cache for port fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:46:21 user nova-compute[73258]: DEBUG nova.network.neutron [req-a62465f8-f90d-4ed2-a976-a9916670bf4a req-9a977618-266e-4d1f-83fd-259f8808bf7e service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Updated VIF entry in instance network info cache for port fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:46:21 user nova-compute[73258]: DEBUG nova.network.neutron [req-a62465f8-f90d-4ed2-a976-a9916670bf4a req-9a977618-266e-4d1f-83fd-259f8808bf7e service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Updating instance_info_cache with network_info: [{"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:46:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a62465f8-f90d-4ed2-a976-a9916670bf4a req-9a977618-266e-4d1f-83fd-259f8808bf7e service nova] Releasing lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:46:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:46:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwOZSxVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:46:25 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:46:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:46:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:46:25 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:46:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:46:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:46:25 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:46:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e715f8c2-91e4-4172-974e-f8c530ee9198]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:46:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:46:25 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:46:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6550759-9772-46ca-ab07-5f13b3c0858c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:46:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c] added
Aug 27 06:46:25 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:46:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dba111b-8d2c-4716-a99e-3969b548a60c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:46:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:46:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71e8532-4952-43c8-ac67-f77e54d8d493]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:46:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwOZSxVq {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwOZSxVq" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe04eae3-5868-4373-b594-e514f04880f3]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lwOZSxVq'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb2d26f-c06c-4cf2-9c6e-7ef2071ba671]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fe8fab-ba6f-494f-9c8b-aee546f72d9d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:46:26 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:46:26 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:46:26 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:46:26 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce063b35-229b-4aef-ba9c-38c37b5c67a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c, portal: 172.16.0.220,3260]
Aug 27 06:46:26 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c, portal: 172.16.0.220,3260] successful.
Aug 27 06:46:26 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d0b6f8-ad84-4e59-b582-f26eadfb3e68]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2afeaf4-f03f-427d-86b7-28a39feca0ba]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:46:26 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:46:26 user nova-compute[73258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c (non-flash)
Aug 27 06:46:26 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:46:26 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:46:26 user nova-compute[73258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c (non-flash)
Aug 27 06:46:26 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[276be085-bbc3-4e73-93d8-99b40a7ce50f]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: None {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Acquiring lock "21e7abcc-86a6-4315-9a84-9efcc907156f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Acquiring lock "21e7abcc-86a6-4315-9a84-9efcc907156f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:26 user nova-compute[73258]: INFO nova.compute.manager [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Terminating instance
Aug 27 06:46:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-7ee01239-df52-4d34-bfa1-a43b8f76f9a4 req-5a5f794f-f363-4995-8eec-113e97291caf service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Received event network-vif-unplugged-1180e78d-2144-45a5-a958-567420edf02a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7ee01239-df52-4d34-bfa1-a43b8f76f9a4 req-5a5f794f-f363-4995-8eec-113e97291caf service nova] Acquiring lock "21e7abcc-86a6-4315-9a84-9efcc907156f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7ee01239-df52-4d34-bfa1-a43b8f76f9a4 req-5a5f794f-f363-4995-8eec-113e97291caf service nova] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7ee01239-df52-4d34-bfa1-a43b8f76f9a4 req-5a5f794f-f363-4995-8eec-113e97291caf service nova] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-7ee01239-df52-4d34-bfa1-a43b8f76f9a4 req-5a5f794f-f363-4995-8eec-113e97291caf service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] No waiting events found dispatching network-vif-unplugged-1180e78d-2144-45a5-a958-567420edf02a {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:46:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-7ee01239-df52-4d34-bfa1-a43b8f76f9a4 req-5a5f794f-f363-4995-8eec-113e97291caf service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Received event network-vif-unplugged-1180e78d-2144-45a5-a958-567420edf02a for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:27 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Instance destroyed successfully.
Aug 27 06:46:27 user nova-compute[73258]: DEBUG nova.objects.instance [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lazy-loading 'resources' on Instance uuid 21e7abcc-86a6-4315-9a84-9efcc907156f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:42:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-633508898',display_name='tempest-TestVolumeSwap-server-633508898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-633508898',id=19,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5V1ZIOnUJF87nfN5dwS0iWpp/WVrLWJwbN4Im0Vy4pUOwrL9/ddYL3YyNtNE0LFEojJu2KKXpq3f0aR9cp/yWR1SPnGK0Udv5BvvUNVQkyP9+WrYro5T4NUwMWRXHIxg==',key_name='tempest-keypair-720595720',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:42:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63c7973a9a594a5aa6852b10b742c174',ramdisk_id='',reservation_id='r-yetsf9t9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1017490211',owner_user_name='tempest-TestVolumeSwap-1017490211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:42:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64d0c2655b6c4ea0b9932a62ecc284f2',uuid=21e7abcc-86a6-4315-9a84-9efcc907156f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1180e78d-2144-45a5-a958-567420edf02a", "address": "fa:16:3e:d1:f6:19", "network": {"id": "e690fd29-676c-47ee-88ba-886eea8dcf5f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-65889246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c7973a9a594a5aa6852b10b742c174", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1180e78d-21", "ovs_interfaceid": "1180e78d-2144-45a5-a958-567420edf02a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Converting VIF {"id": "1180e78d-2144-45a5-a958-567420edf02a", "address": "fa:16:3e:d1:f6:19", "network": {"id": "e690fd29-676c-47ee-88ba-886eea8dcf5f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-65889246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63c7973a9a594a5aa6852b10b742c174", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1180e78d-21", "ovs_interfaceid": "1180e78d-2144-45a5-a958-567420edf02a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:f6:19,bridge_name='br-int',has_traffic_filtering=True,id=1180e78d-2144-45a5-a958-567420edf02a,network=Network(e690fd29-676c-47ee-88ba-886eea8dcf5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1180e78d-21') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG os_vif [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:f6:19,bridge_name='br-int',has_traffic_filtering=True,id=1180e78d-2144-45a5-a958-567420edf02a,network=Network(e690fd29-676c-47ee-88ba-886eea8dcf5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1180e78d-21') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1180e78d-21, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:27 user nova-compute[73258]: INFO os_vif [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:f6:19,bridge_name='br-int',has_traffic_filtering=True,id=1180e78d-2144-45a5-a958-567420edf02a,network=Network(e690fd29-676c-47ee-88ba-886eea8dcf5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1180e78d-21')
Aug 27 06:46:27 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Deleting instance files /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f_del
Aug 27 06:46:27 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Deletion of /opt/stack/data/nova/instances/21e7abcc-86a6-4315-9a84-9efcc907156f_del complete
Aug 27 06:46:27 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwOZSxVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26464396539336134', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464396539336134', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG nova.objects.instance [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lazy-loading 'flavor' on Instance uuid 50505a95-da00-4238-966d-c0a1e188b25c {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:46:27 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:46:27 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:46:27 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:46:27 user nova-compute[73258]:   <serial>738d1fa4-5c20-472d-8b10-d7324321863c</serial>
Aug 27 06:46:27 user nova-compute[73258]: </disk>
Aug 27 06:46:27 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:46:27 user nova-compute[73258]: INFO nova.compute.manager [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 27 06:46:27 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] No VIF found with MAC fa:16:3e:07:c3:72, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:46:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9706f3bb-85f9-401d-9ebd-aeb53425131a tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "50505a95-da00-4238-966d-c0a1e188b25c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.422s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:28 user nova-compute[73258]: INFO nova.compute.manager [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Shelving
Aug 27 06:46:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-84286a2a-6958-4ce7-8342-d24c339ef6ad req-65922e47-f122-4973-a0d6-b5f14d964632 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received event network-vif-unplugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-84286a2a-6958-4ce7-8342-d24c339ef6ad req-65922e47-f122-4973-a0d6-b5f14d964632 service nova] Acquiring lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-84286a2a-6958-4ce7-8342-d24c339ef6ad req-65922e47-f122-4973-a0d6-b5f14d964632 service nova] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-84286a2a-6958-4ce7-8342-d24c339ef6ad req-65922e47-f122-4973-a0d6-b5f14d964632 service nova] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-84286a2a-6958-4ce7-8342-d24c339ef6ad req-65922e47-f122-4973-a0d6-b5f14d964632 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] No waiting events found dispatching network-vif-unplugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:46:28 user nova-compute[73258]: WARNING nova.compute.manager [req-84286a2a-6958-4ce7-8342-d24c339ef6ad req-65922e47-f122-4973-a0d6-b5f14d964632 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received unexpected event network-vif-unplugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 for instance with vm_state active and task_state shelving.
Aug 27 06:46:28 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:46:28 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Took 1.28 seconds to deallocate network for instance.
Aug 27 06:46:28 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Instance destroyed successfully.
Aug 27 06:46:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:28 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Beginning cold snapshot process
Aug 27 06:46:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:29 user nova-compute[73258]: DEBUG nova.compute.manager [req-ab421438-f57f-469a-863b-fa508ea7f921 req-115db02d-d90c-47c9-a144-79ee0aa15a3b service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Received event network-vif-plugged-1180e78d-2144-45a5-a958-567420edf02a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ab421438-f57f-469a-863b-fa508ea7f921 req-115db02d-d90c-47c9-a144-79ee0aa15a3b service nova] Acquiring lock "21e7abcc-86a6-4315-9a84-9efcc907156f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ab421438-f57f-469a-863b-fa508ea7f921 req-115db02d-d90c-47c9-a144-79ee0aa15a3b service nova] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ab421438-f57f-469a-863b-fa508ea7f921 req-115db02d-d90c-47c9-a144-79ee0aa15a3b service nova] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:29 user nova-compute[73258]: DEBUG nova.compute.manager [req-ab421438-f57f-469a-863b-fa508ea7f921 req-115db02d-d90c-47c9-a144-79ee0aa15a3b service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] No waiting events found dispatching network-vif-plugged-1180e78d-2144-45a5-a958-567420edf02a {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:46:29 user nova-compute[73258]: WARNING nova.compute.manager [req-ab421438-f57f-469a-863b-fa508ea7f921 req-115db02d-d90c-47c9-a144-79ee0aa15a3b service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Received unexpected event network-vif-plugged-1180e78d-2144-45a5-a958-567420edf02a for instance with vm_state deleted and task_state None.
Aug 27 06:46:29 user nova-compute[73258]: DEBUG nova.compute.manager [req-ab421438-f57f-469a-863b-fa508ea7f921 req-115db02d-d90c-47c9-a144-79ee0aa15a3b service nova] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Received event network-vif-deleted-1180e78d-2144-45a5-a958-567420edf02a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:29 user nova-compute[73258]: DEBUG nova.privsep.utils [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 06:46:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk /opt/stack/data/nova/instances/snapshots/tmptebz1g1p/40b5bb4815844ada88bcb9afde6ffd87 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:29 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:46:29 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:46:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.805s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:29 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Deleted allocations for instance 21e7abcc-86a6-4315-9a84-9efcc907156f
Aug 27 06:46:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9249306f-229a-4d2f-a6df-cc7bc0308af2 tempest-TestVolumeSwap-1017490211 tempest-TestVolumeSwap-1017490211-project-member] Lock "21e7abcc-86a6-4315-9a84-9efcc907156f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.851s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk /opt/stack/data/nova/instances/snapshots/tmptebz1g1p/40b5bb4815844ada88bcb9afde6ffd87" returned: 0 in 1.383s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:30 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Snapshot extracted, beginning image upload
Aug 27 06:46:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-398615f7-d5ef-4019-93f2-ab54a252af91 req-8a7b69d2-8fbb-44ac-9e7e-99311ace85b0 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received event network-vif-plugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-398615f7-d5ef-4019-93f2-ab54a252af91 req-8a7b69d2-8fbb-44ac-9e7e-99311ace85b0 service nova] Acquiring lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-398615f7-d5ef-4019-93f2-ab54a252af91 req-8a7b69d2-8fbb-44ac-9e7e-99311ace85b0 service nova] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-398615f7-d5ef-4019-93f2-ab54a252af91 req-8a7b69d2-8fbb-44ac-9e7e-99311ace85b0 service nova] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-398615f7-d5ef-4019-93f2-ab54a252af91 req-8a7b69d2-8fbb-44ac-9e7e-99311ace85b0 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] No waiting events found dispatching network-vif-plugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:46:30 user nova-compute[73258]: WARNING nova.compute.manager [req-398615f7-d5ef-4019-93f2-ab54a252af91 req-8a7b69d2-8fbb-44ac-9e7e-99311ace85b0 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received unexpected event network-vif-plugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 for instance with vm_state active and task_state shelving_image_uploading.
Aug 27 06:46:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:33 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Snapshot image upload complete
Aug 27 06:46:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:46:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:33 user nova-compute[73258]: INFO nova.compute.manager [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Shelve offloading
Aug 27 06:46:33 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Instance destroyed successfully.
Aug 27 06:46:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:46:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:46:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquired lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:46:33 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:46:33 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Updating instance_info_cache with network_info: [{"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:46:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Releasing lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:46:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:35 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Instance destroyed successfully.
Aug 27 06:46:35 user nova-compute[73258]: DEBUG nova.objects.instance [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'resources' on Instance uuid e6e96ad8-e34e-4970-b3a6-c06df0c6d994 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:44:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-133269916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-133269916',id=24,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPhZgvMlZKszgmkJRdB2Td8QkZ+kehRxdRcco72ikdAPBqgA1064wic3jyDjgqQp2aKcq+6YzjRXdUerPFbWzpsTYXbn26mHdAkPlLsA+z50REBPVUDwI0jEOuRNEDA4w==',key_name='tempest-keypair-45658026',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:44:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='235a4f958e494352aaa119a4d44a52c5',ramdisk_id='',reservation_id='r-qf0qib1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1261077306',owner_user_name='tempest-AttachVolumeShelveTestJSON-1261077306-project-member',shelved_at='2023-08-27T06:46:33.236167',shelved_host='user',shelved_image_id='7a60ed71-cdc5-4fd9-9ff8-4ccd463b649b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff1f51bb7163499c94ebbc93a051b4df',uuid=e6e96ad8-e34e-4970-b3a6-c06df0c6d994,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converting VIF {"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:ae:e2,bridge_name='br-int',has_traffic_filtering=True,id=fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4351a6-f0') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG os_vif [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:ae:e2,bridge_name='br-int',has_traffic_filtering=True,id=fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4351a6-f0') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc4351a6-f0, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-bf1e51c3-e12b-40cb-9643-ef01a10513b1 req-3a4ca30a-b6db-4284-b0e2-f374cb395c36 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received event network-changed-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-bf1e51c3-e12b-40cb-9643-ef01a10513b1 req-3a4ca30a-b6db-4284-b0e2-f374cb395c36 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Refreshing instance network info cache due to event network-changed-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bf1e51c3-e12b-40cb-9643-ef01a10513b1 req-3a4ca30a-b6db-4284-b0e2-f374cb395c36 service nova] Acquiring lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bf1e51c3-e12b-40cb-9643-ef01a10513b1 req-3a4ca30a-b6db-4284-b0e2-f374cb395c36 service nova] Acquired lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG nova.network.neutron [req-bf1e51c3-e12b-40cb-9643-ef01a10513b1 req-3a4ca30a-b6db-4284-b0e2-f374cb395c36 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Refreshing network info cache for port fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:35 user nova-compute[73258]: INFO os_vif [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:ae:e2,bridge_name='br-int',has_traffic_filtering=True,id=fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4351a6-f0')
Aug 27 06:46:35 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Deleting instance files /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994_del
Aug 27 06:46:35 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Deletion of /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994_del complete
Aug 27 06:46:35 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Deleted allocations for instance e6e96ad8-e34e-4970-b3a6-c06df0c6d994
Aug 27 06:46:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG nova.objects.instance [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'numa_topology' on Instance uuid e6e96ad8-e34e-4970-b3a6-c06df0c6d994 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG nova.objects.base [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Object Instance<e6e96ad8-e34e-4970-b3a6-c06df0c6d994> lazy-loaded attributes: resources,numa_topology {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "4a2970a3-2a05-4462-bf0b-1595743222fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:35 user nova-compute[73258]: INFO nova.compute.manager [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Terminating instance
Aug 27 06:46:35 user nova-compute[73258]: DEBUG nova.compute.manager [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG nova.network.neutron [req-bf1e51c3-e12b-40cb-9643-ef01a10513b1 req-3a4ca30a-b6db-4284-b0e2-f374cb395c36 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Updated VIF entry in instance network info cache for port fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG nova.network.neutron [req-bf1e51c3-e12b-40cb-9643-ef01a10513b1 req-3a4ca30a-b6db-4284-b0e2-f374cb395c36 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Updating instance_info_cache with network_info: [{"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bf1e51c3-e12b-40cb-9643-ef01a10513b1 req-3a4ca30a-b6db-4284-b0e2-f374cb395c36 service nova] Releasing lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bf60b642-b657-449c-8445-dc7f770a7052 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.736s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-81d8b776-e60b-47d6-a238-e3a0c21226b6 req-f21b7333-3a50-4559-a079-6b1d85009756 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Received event network-vif-unplugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-81d8b776-e60b-47d6-a238-e3a0c21226b6 req-f21b7333-3a50-4559-a079-6b1d85009756 service nova] Acquiring lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-81d8b776-e60b-47d6-a238-e3a0c21226b6 req-f21b7333-3a50-4559-a079-6b1d85009756 service nova] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-81d8b776-e60b-47d6-a238-e3a0c21226b6 req-f21b7333-3a50-4559-a079-6b1d85009756 service nova] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-81d8b776-e60b-47d6-a238-e3a0c21226b6 req-f21b7333-3a50-4559-a079-6b1d85009756 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] No waiting events found dispatching network-vif-unplugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-81d8b776-e60b-47d6-a238-e3a0c21226b6 req-f21b7333-3a50-4559-a079-6b1d85009756 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Received event network-vif-unplugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:46:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:36 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Instance destroyed successfully.
Aug 27 06:46:36 user nova-compute[73258]: DEBUG nova.objects.instance [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lazy-loading 'resources' on Instance uuid 4a2970a3-2a05-4462-bf0b-1595743222fb {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:46:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T06:40:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-968445551',display_name='tempest-ServerActionsTestOtherA-server-581411342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-968445551',id=17,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdMnm+iJuT1xHxSDO3grlX9YhSVQuwPM7dsQXKJfx/OYDCb58PWILkOo0/JLzQygTw7Q96Wku55I12d7cqqFJX+FkBYpsqqlHI6UIfaBvOqiUrbrpnkTTfTzPPZnAM/+Q==',key_name='tempest-keypair-1720190692',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:43:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57faf7cb6c704c05aba06857a6cdd29f',ramdisk_id='',reservation_id='r-62w17hhk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1477462030',owner_user_name='tempest-ServerActionsTestOtherA-1477462030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:43:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f8a06ab5634f60b6ed2d1d9b2c342e',uuid=4a2970a3-2a05-4462-bf0b-1595743222fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "address": "fa:16:3e:d3:c2:3b", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85410bb9-db", "ovs_interfaceid": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:46:36 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converting VIF {"id": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "address": "fa:16:3e:d3:c2:3b", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85410bb9-db", "ovs_interfaceid": "85410bb9-dbd6-481c-a090-46d04e0d54b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:46:36 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:c2:3b,bridge_name='br-int',has_traffic_filtering=True,id=85410bb9-dbd6-481c-a090-46d04e0d54b6,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85410bb9-db') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:46:36 user nova-compute[73258]: DEBUG os_vif [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:c2:3b,bridge_name='br-int',has_traffic_filtering=True,id=85410bb9-dbd6-481c-a090-46d04e0d54b6,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85410bb9-db') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:46:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85410bb9-db, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:46:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:46:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:36 user nova-compute[73258]: INFO os_vif [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:c2:3b,bridge_name='br-int',has_traffic_filtering=True,id=85410bb9-dbd6-481c-a090-46d04e0d54b6,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85410bb9-db')
Aug 27 06:46:36 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Deleting instance files /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb_del
Aug 27 06:46:36 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Deletion of /opt/stack/data/nova/instances/4a2970a3-2a05-4462-bf0b-1595743222fb_del complete
Aug 27 06:46:36 user nova-compute[73258]: INFO nova.compute.manager [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 27 06:46:36 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:46:36 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:46:36 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:46:37 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:46:37 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Took 1.07 seconds to deallocate network for instance.
Aug 27 06:46:37 user nova-compute[73258]: DEBUG nova.compute.manager [req-44841c69-e1a4-43bb-aea8-097f43daf712 req-55b4d1a9-7d8a-468d-8cf2-aa30cbffb89e service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Received event network-vif-deleted-85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:37 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:46:37 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:46:37 user nova-compute[73258]: DEBUG nova.compute.manager [req-5af56645-1798-46e6-af1f-1e12b5c90be8 req-e4acffdb-0f18-4400-bac5-b0bbf751d059 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Received event network-vif-plugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5af56645-1798-46e6-af1f-1e12b5c90be8 req-e4acffdb-0f18-4400-bac5-b0bbf751d059 service nova] Acquiring lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5af56645-1798-46e6-af1f-1e12b5c90be8 req-e4acffdb-0f18-4400-bac5-b0bbf751d059 service nova] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5af56645-1798-46e6-af1f-1e12b5c90be8 req-e4acffdb-0f18-4400-bac5-b0bbf751d059 service nova] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:37 user nova-compute[73258]: DEBUG nova.compute.manager [req-5af56645-1798-46e6-af1f-1e12b5c90be8 req-e4acffdb-0f18-4400-bac5-b0bbf751d059 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] No waiting events found dispatching network-vif-plugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:46:37 user nova-compute[73258]: WARNING nova.compute.manager [req-5af56645-1798-46e6-af1f-1e12b5c90be8 req-e4acffdb-0f18-4400-bac5-b0bbf751d059 service nova] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Received unexpected event network-vif-plugged-85410bb9-dbd6-481c-a090-46d04e0d54b6 for instance with vm_state deleted and task_state None.
Aug 27 06:46:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:37 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Deleted allocations for instance 4a2970a3-2a05-4462-bf0b-1595743222fb
Aug 27 06:46:38 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4be26a91-f4db-4337-8828-4cb6068b40e2 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "4a2970a3-2a05-4462-bf0b-1595743222fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.691s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquiring lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:46:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:41 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:46:41 user nova-compute[73258]: INFO nova.compute.claims [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Claim successful on node user
Aug 27 06:46:41 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:46:41 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:46:42 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:46:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118787.1749198, 21e7abcc-86a6-4315-9a84-9efcc907156f => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:46:42 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] VM Stopped (Lifecycle Event)
Aug 27 06:46:42 user nova-compute[73258]: DEBUG nova.policy [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41ce9c10e4f14e478b5833700a5546cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb0b2a4be9946e680a0e65d58f9c4f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-4283f386-a577-47bd-a83e-289fe52c32b6 None None] [instance: 21e7abcc-86a6-4315-9a84-9efcc907156f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:46:42 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Creating image(s)
Aug 27 06:46:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquiring lock "/opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "/opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "/opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/disk 1073741824" returned: 0 in 0.054s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Successfully created port: fa0b4d64-3c43-470a-b6ff-b409580fffc3 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.191s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:46:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Cannot resize image /opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Ensure instance console log exists: /opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Successfully updated port: fa0b4d64-3c43-470a-b6ff-b409580fffc3 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquiring lock "refresh_cache-ffc4da0b-3aad-4e7b-a093-97bd2eb1103a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquired lock "refresh_cache-ffc4da0b-3aad-4e7b-a093-97bd2eb1103a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-2fd07bcc-5918-46e7-b3e0-432650995475 req-73f5c20b-9484-4e66-b1d9-dc1e45023439 service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Received event network-changed-fa0b4d64-3c43-470a-b6ff-b409580fffc3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-2fd07bcc-5918-46e7-b3e0-432650995475 req-73f5c20b-9484-4e66-b1d9-dc1e45023439 service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Refreshing instance network info cache due to event network-changed-fa0b4d64-3c43-470a-b6ff-b409580fffc3. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2fd07bcc-5918-46e7-b3e0-432650995475 req-73f5c20b-9484-4e66-b1d9-dc1e45023439 service nova] Acquiring lock "refresh_cache-ffc4da0b-3aad-4e7b-a093-97bd2eb1103a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Didn't find any instances for network info cache update. {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118788.6722567, e6e96ad8-e34e-4970-b3a6-c06df0c6d994 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:46:43 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] VM Stopped (Lifecycle Event)
Aug 27 06:46:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-540acaa2-466f-43e3-b9fb-e2425295c4be None None] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:43 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Updating instance_info_cache with network_info: [{"id": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "address": "fa:16:3e:5f:8d:a9", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0b4d64-3c", "ovs_interfaceid": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Releasing lock "refresh_cache-ffc4da0b-3aad-4e7b-a093-97bd2eb1103a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Instance network_info: |[{"id": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "address": "fa:16:3e:5f:8d:a9", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0b4d64-3c", "ovs_interfaceid": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2fd07bcc-5918-46e7-b3e0-432650995475 req-73f5c20b-9484-4e66-b1d9-dc1e45023439 service nova] Acquired lock "refresh_cache-ffc4da0b-3aad-4e7b-a093-97bd2eb1103a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.network.neutron [req-2fd07bcc-5918-46e7-b3e0-432650995475 req-73f5c20b-9484-4e66-b1d9-dc1e45023439 service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Refreshing network info cache for port fa0b4d64-3c43-470a-b6ff-b409580fffc3 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Start _get_guest_xml network_info=[{"id": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "address": "fa:16:3e:5f:8d:a9", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0b4d64-3c", "ovs_interfaceid": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:46:44 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:46:44 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:46:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2028247375',display_name='tempest-VolumesActionsTest-instance-2028247375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2028247375',id=27,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeb0b2a4be9946e680a0e65d58f9c4f3',ramdisk_id='',reservation_id='r-t5l6re5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1397322250',owner_user_name='tempest-VolumesActionsTest-1397322250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:46:42Z,user_data=None,user_id='41ce9c10e4f14e478b5833700a5546cc',uuid=ffc4da0b-3aad-4e7b-a093-97bd2eb1103a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "address": "fa:16:3e:5f:8d:a9", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0b4d64-3c", "ovs_interfaceid": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Converting VIF {"id": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "address": "fa:16:3e:5f:8d:a9", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0b4d64-3c", "ovs_interfaceid": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:8d:a9,bridge_name='br-int',has_traffic_filtering=True,id=fa0b4d64-3c43-470a-b6ff-b409580fffc3,network=Network(c5f850d2-9a33-4e76-a6fd-54865efe7aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa0b4d64-3c') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.objects.instance [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lazy-loading 'pci_devices' on Instance uuid ffc4da0b-3aad-4e7b-a093-97bd2eb1103a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:46:44 user nova-compute[73258]:   <uuid>ffc4da0b-3aad-4e7b-a093-97bd2eb1103a</uuid>
Aug 27 06:46:44 user nova-compute[73258]:   <name>instance-0000001b</name>
Aug 27 06:46:44 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:46:44 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:46:44 user nova-compute[73258]:   <metadata>
Aug 27 06:46:44 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:46:44 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:46:44 user nova-compute[73258]:       <nova:name>tempest-VolumesActionsTest-instance-2028247375</nova:name>
Aug 27 06:46:44 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:46:44</nova:creationTime>
Aug 27 06:46:44 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:46:44 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:46:44 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:46:44 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:46:44 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:46:44 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:46:44 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:46:44 user nova-compute[73258]:       <nova:owner>
Aug 27 06:46:44 user nova-compute[73258]:         <nova:user uuid="41ce9c10e4f14e478b5833700a5546cc">tempest-VolumesActionsTest-1397322250-project-member</nova:user>
Aug 27 06:46:44 user nova-compute[73258]:         <nova:project uuid="aeb0b2a4be9946e680a0e65d58f9c4f3">tempest-VolumesActionsTest-1397322250</nova:project>
Aug 27 06:46:44 user nova-compute[73258]:       </nova:owner>
Aug 27 06:46:44 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:46:44 user nova-compute[73258]:       <nova:ports>
Aug 27 06:46:44 user nova-compute[73258]:         <nova:port uuid="fa0b4d64-3c43-470a-b6ff-b409580fffc3">
Aug 27 06:46:44 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 06:46:44 user nova-compute[73258]:         </nova:port>
Aug 27 06:46:44 user nova-compute[73258]:       </nova:ports>
Aug 27 06:46:44 user nova-compute[73258]:     </nova:instance>
Aug 27 06:46:44 user nova-compute[73258]:   </metadata>
Aug 27 06:46:44 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:46:44 user nova-compute[73258]:     <system>
Aug 27 06:46:44 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:46:44 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:46:44 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:46:44 user nova-compute[73258]:       <entry name="serial">ffc4da0b-3aad-4e7b-a093-97bd2eb1103a</entry>
Aug 27 06:46:44 user nova-compute[73258]:       <entry name="uuid">ffc4da0b-3aad-4e7b-a093-97bd2eb1103a</entry>
Aug 27 06:46:44 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:46:44 user nova-compute[73258]:     </system>
Aug 27 06:46:44 user nova-compute[73258]:   </sysinfo>
Aug 27 06:46:44 user nova-compute[73258]:   <os>
Aug 27 06:46:44 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:46:44 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:46:44 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:46:44 user nova-compute[73258]:   </os>
Aug 27 06:46:44 user nova-compute[73258]:   <features>
Aug 27 06:46:44 user nova-compute[73258]:     <acpi/>
Aug 27 06:46:44 user nova-compute[73258]:     <apic/>
Aug 27 06:46:44 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:46:44 user nova-compute[73258]:   </features>
Aug 27 06:46:44 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:46:44 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:46:44 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:46:44 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:46:44 user nova-compute[73258]:   </clock>
Aug 27 06:46:44 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:46:44 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:46:44 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:46:44 user nova-compute[73258]:   </cpu>
Aug 27 06:46:44 user nova-compute[73258]:   <devices>
Aug 27 06:46:44 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:46:44 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:46:44 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/disk"/>
Aug 27 06:46:44 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:46:44 user nova-compute[73258]:     </disk>
Aug 27 06:46:44 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:46:44 user nova-compute[73258]:       <mac address="fa:16:3e:5f:8d:a9"/>
Aug 27 06:46:44 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:46:44 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:46:44 user nova-compute[73258]:       <target dev="tapfa0b4d64-3c"/>
Aug 27 06:46:44 user nova-compute[73258]:     </interface>
Aug 27 06:46:44 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:46:44 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/console.log" append="off"/>
Aug 27 06:46:44 user nova-compute[73258]:     </serial>
Aug 27 06:46:44 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:46:44 user nova-compute[73258]:     <video>
Aug 27 06:46:44 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:46:44 user nova-compute[73258]:     </video>
Aug 27 06:46:44 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:46:44 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:46:44 user nova-compute[73258]:     </rng>
Aug 27 06:46:44 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:46:44 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:46:44 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:46:44 user nova-compute[73258]:     </memballoon>
Aug 27 06:46:44 user nova-compute[73258]:   </devices>
Aug 27 06:46:44 user nova-compute[73258]: </domain>
Aug 27 06:46:44 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:46:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2028247375',display_name='tempest-VolumesActionsTest-instance-2028247375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2028247375',id=27,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeb0b2a4be9946e680a0e65d58f9c4f3',ramdisk_id='',reservation_id='r-t5l6re5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1397322250',owner_user_name='tempest-VolumesActionsTest-1397322250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:46:42Z,user_data=None,user_id='41ce9c10e4f14e478b5833700a5546cc',uuid=ffc4da0b-3aad-4e7b-a093-97bd2eb1103a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "address": "fa:16:3e:5f:8d:a9", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0b4d64-3c", "ovs_interfaceid": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Converting VIF {"id": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "address": "fa:16:3e:5f:8d:a9", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0b4d64-3c", "ovs_interfaceid": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:8d:a9,bridge_name='br-int',has_traffic_filtering=True,id=fa0b4d64-3c43-470a-b6ff-b409580fffc3,network=Network(c5f850d2-9a33-4e76-a6fd-54865efe7aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa0b4d64-3c') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG os_vif [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:8d:a9,bridge_name='br-int',has_traffic_filtering=True,id=fa0b4d64-3c43-470a-b6ff-b409580fffc3,network=Network(c5f850d2-9a33-4e76-a6fd-54865efe7aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa0b4d64-3c') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa0b4d64-3c, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa0b4d64-3c, col_values=(('external_ids', {'iface-id': 'fa0b4d64-3c43-470a-b6ff-b409580fffc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:8d:a9', 'vm-uuid': 'ffc4da0b-3aad-4e7b-a093-97bd2eb1103a'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:44 user nova-compute[73258]: INFO os_vif [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:8d:a9,bridge_name='br-int',has_traffic_filtering=True,id=fa0b4d64-3c43-470a-b6ff-b409580fffc3,network=Network(c5f850d2-9a33-4e76-a6fd-54865efe7aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa0b4d64-3c')
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] No VIF found with MAC fa:16:3e:5f:8d:a9, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.network.neutron [req-2fd07bcc-5918-46e7-b3e0-432650995475 req-73f5c20b-9484-4e66-b1d9-dc1e45023439 service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Updated VIF entry in instance network info cache for port fa0b4d64-3c43-470a-b6ff-b409580fffc3. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG nova.network.neutron [req-2fd07bcc-5918-46e7-b3e0-432650995475 req-73f5c20b-9484-4e66-b1d9-dc1e45023439 service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Updating instance_info_cache with network_info: [{"id": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "address": "fa:16:3e:5f:8d:a9", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0b4d64-3c", "ovs_interfaceid": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:46:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2fd07bcc-5918-46e7-b3e0-432650995475 req-73f5c20b-9484-4e66-b1d9-dc1e45023439 service nova] Releasing lock "refresh_cache-ffc4da0b-3aad-4e7b-a093-97bd2eb1103a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:46:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:45 user nova-compute[73258]: DEBUG nova.compute.manager [req-fae70df2-f343-4328-b6d8-24ad409c1f65 req-a3bc287a-595c-452c-afdc-376b3c6a7b23 service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Received event network-vif-plugged-fa0b4d64-3c43-470a-b6ff-b409580fffc3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fae70df2-f343-4328-b6d8-24ad409c1f65 req-a3bc287a-595c-452c-afdc-376b3c6a7b23 service nova] Acquiring lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fae70df2-f343-4328-b6d8-24ad409c1f65 req-a3bc287a-595c-452c-afdc-376b3c6a7b23 service nova] Lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fae70df2-f343-4328-b6d8-24ad409c1f65 req-a3bc287a-595c-452c-afdc-376b3c6a7b23 service nova] Lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:45 user nova-compute[73258]: DEBUG nova.compute.manager [req-fae70df2-f343-4328-b6d8-24ad409c1f65 req-a3bc287a-595c-452c-afdc-376b3c6a7b23 service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] No waiting events found dispatching network-vif-plugged-fa0b4d64-3c43-470a-b6ff-b409580fffc3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:46:45 user nova-compute[73258]: WARNING nova.compute.manager [req-fae70df2-f343-4328-b6d8-24ad409c1f65 req-a3bc287a-595c-452c-afdc-376b3c6a7b23 service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Received unexpected event network-vif-plugged-fa0b4d64-3c43-470a-b6ff-b409580fffc3 for instance with vm_state building and task_state spawning.
Aug 27 06:46:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquiring lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquiring lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:46 user nova-compute[73258]: INFO nova.compute.manager [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Terminating instance
Aug 27 06:46:46 user nova-compute[73258]: DEBUG nova.compute.manager [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:46 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Instance destroyed successfully.
Aug 27 06:46:46 user nova-compute[73258]: DEBUG nova.objects.instance [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lazy-loading 'resources' on Instance uuid af558a1a-7bee-46b9-8b00-ff5f5a545e8e {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-17827185',display_name='tempest-ServersNegativeTestJSON-server-17827185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-17827185',id=25,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:45:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e11b4cd365934e568225156ab305cda2',ramdisk_id='',reservation_id='r-5l0sfrlg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1353100795',owner_user_name='tempest-ServersNegativeTestJSON-1353100795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:45:03Z,user_data=None,user_id='7bd578ee905a49e88abe9c72668bc1dd',uuid=af558a1a-7bee-46b9-8b00-ff5f5a545e8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "address": "fa:16:3e:58:1a:78", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37db544d-7a", "ovs_interfaceid": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Converting VIF {"id": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "address": "fa:16:3e:58:1a:78", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37db544d-7a", "ovs_interfaceid": "37db544d-7a03-4d2d-a220-0bc1cd79da55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:1a:78,bridge_name='br-int',has_traffic_filtering=True,id=37db544d-7a03-4d2d-a220-0bc1cd79da55,network=Network(baf86837-de09-4d7d-a6a1-36fb8bf7bf68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37db544d-7a') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG os_vif [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:1a:78,bridge_name='br-int',has_traffic_filtering=True,id=37db544d-7a03-4d2d-a220-0bc1cd79da55,network=Network(baf86837-de09-4d7d-a6a1-36fb8bf7bf68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37db544d-7a') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37db544d-7a, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:46 user nova-compute[73258]: INFO os_vif [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:1a:78,bridge_name='br-int',has_traffic_filtering=True,id=37db544d-7a03-4d2d-a220-0bc1cd79da55,network=Network(baf86837-de09-4d7d-a6a1-36fb8bf7bf68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37db544d-7a')
Aug 27 06:46:46 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Deleting instance files /opt/stack/data/nova/instances/af558a1a-7bee-46b9-8b00-ff5f5a545e8e_del
Aug 27 06:46:46 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Deletion of /opt/stack/data/nova/instances/af558a1a-7bee-46b9-8b00-ff5f5a545e8e_del complete
Aug 27 06:46:46 user nova-compute[73258]: INFO nova.compute.manager [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 27 06:46:46 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG nova.compute.manager [req-07a08680-9b30-4b93-a55a-0a35ea42c670 req-6d80c389-f2ad-484f-bcdc-7ce68a1559cd service nova] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Received event network-vif-unplugged-37db544d-7a03-4d2d-a220-0bc1cd79da55 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-07a08680-9b30-4b93-a55a-0a35ea42c670 req-6d80c389-f2ad-484f-bcdc-7ce68a1559cd service nova] Acquiring lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-07a08680-9b30-4b93-a55a-0a35ea42c670 req-6d80c389-f2ad-484f-bcdc-7ce68a1559cd service nova] Lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-07a08680-9b30-4b93-a55a-0a35ea42c670 req-6d80c389-f2ad-484f-bcdc-7ce68a1559cd service nova] Lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG nova.compute.manager [req-07a08680-9b30-4b93-a55a-0a35ea42c670 req-6d80c389-f2ad-484f-bcdc-7ce68a1559cd service nova] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] No waiting events found dispatching network-vif-unplugged-37db544d-7a03-4d2d-a220-0bc1cd79da55 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:46:46 user nova-compute[73258]: DEBUG nova.compute.manager [req-07a08680-9b30-4b93-a55a-0a35ea42c670 req-6d80c389-f2ad-484f-bcdc-7ce68a1559cd service nova] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Received event network-vif-unplugged-37db544d-7a03-4d2d-a220-0bc1cd79da55 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:46:47 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Took 0.66 seconds to deallocate network for instance.
Aug 27 06:46:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118807.6699913, ffc4da0b-3aad-4e7b-a093-97bd2eb1103a => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:46:47 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] VM Resumed (Lifecycle Event)
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:46:47 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Instance spawned successfully.
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:46:47 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118807.673245, ffc4da0b-3aad-4e7b-a093-97bd2eb1103a => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:46:47 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] VM Started (Lifecycle Event)
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.compute.manager [req-5e1a5bc7-ca65-4e09-ab94-607cc3fef582 req-97c05c47-00f1-4c93-9129-c761fd668868 service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Received event network-vif-plugged-fa0b4d64-3c43-470a-b6ff-b409580fffc3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5e1a5bc7-ca65-4e09-ab94-607cc3fef582 req-97c05c47-00f1-4c93-9129-c761fd668868 service nova] Acquiring lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5e1a5bc7-ca65-4e09-ab94-607cc3fef582 req-97c05c47-00f1-4c93-9129-c761fd668868 service nova] Lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5e1a5bc7-ca65-4e09-ab94-607cc3fef582 req-97c05c47-00f1-4c93-9129-c761fd668868 service nova] Lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.compute.manager [req-5e1a5bc7-ca65-4e09-ab94-607cc3fef582 req-97c05c47-00f1-4c93-9129-c761fd668868 service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] No waiting events found dispatching network-vif-plugged-fa0b4d64-3c43-470a-b6ff-b409580fffc3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:46:47 user nova-compute[73258]: WARNING nova.compute.manager [req-5e1a5bc7-ca65-4e09-ab94-607cc3fef582 req-97c05c47-00f1-4c93-9129-c761fd668868 service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Received unexpected event network-vif-plugged-fa0b4d64-3c43-470a-b6ff-b409580fffc3 for instance with vm_state building and task_state spawning.
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.compute.manager [req-5e1a5bc7-ca65-4e09-ab94-607cc3fef582 req-97c05c47-00f1-4c93-9129-c761fd668868 service nova] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Received event network-vif-deleted-37db544d-7a03-4d2d-a220-0bc1cd79da55 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:46:47 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:46:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:47 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Deleted allocations for instance af558a1a-7bee-46b9-8b00-ff5f5a545e8e
Aug 27 06:46:47 user nova-compute[73258]: INFO nova.compute.manager [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Took 5.69 seconds to spawn the instance on the hypervisor.
Aug 27 06:46:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:46:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-25b61d3d-0e0e-4658-8624-bfc4abf2e782 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.977s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:48 user nova-compute[73258]: INFO nova.compute.manager [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Took 6.49 seconds to build instance.
Aug 27 06:46:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbfdd322-5b03-441d-8151-678003ee3213 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.600s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:48 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:46:48 user nova-compute[73258]: DEBUG nova.compute.manager [req-2f8f6d97-b01a-40c1-bcbd-07c225626f57 req-8732c36f-ad66-4b3c-9dbe-c3f40d0bb7f3 service nova] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Received event network-vif-plugged-37db544d-7a03-4d2d-a220-0bc1cd79da55 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2f8f6d97-b01a-40c1-bcbd-07c225626f57 req-8732c36f-ad66-4b3c-9dbe-c3f40d0bb7f3 service nova] Acquiring lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2f8f6d97-b01a-40c1-bcbd-07c225626f57 req-8732c36f-ad66-4b3c-9dbe-c3f40d0bb7f3 service nova] Lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2f8f6d97-b01a-40c1-bcbd-07c225626f57 req-8732c36f-ad66-4b3c-9dbe-c3f40d0bb7f3 service nova] Lock "af558a1a-7bee-46b9-8b00-ff5f5a545e8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:48 user nova-compute[73258]: DEBUG nova.compute.manager [req-2f8f6d97-b01a-40c1-bcbd-07c225626f57 req-8732c36f-ad66-4b3c-9dbe-c3f40d0bb7f3 service nova] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] No waiting events found dispatching network-vif-plugged-37db544d-7a03-4d2d-a220-0bc1cd79da55 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:46:48 user nova-compute[73258]: WARNING nova.compute.manager [req-2f8f6d97-b01a-40c1-bcbd-07c225626f57 req-8732c36f-ad66-4b3c-9dbe-c3f40d0bb7f3 service nova] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Received unexpected event network-vif-plugged-37db544d-7a03-4d2d-a220-0bc1cd79da55 for instance with vm_state deleted and task_state None.
Aug 27 06:46:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:50 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:46:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:50 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:46:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:51 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118796.2056155, 4a2970a3-2a05-4462-bf0b-1595743222fb => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:46:51 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] VM Stopped (Lifecycle Event)
Aug 27 06:46:51 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f1bad4fb-ffdd-420c-963e-f65aaab26cc2 None None] [instance: 4a2970a3-2a05-4462-bf0b-1595743222fb] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:46:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:46:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:46:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:53 user nova-compute[73258]: INFO nova.compute.manager [None req-374ce9dd-b87a-4d00-bd19-01ca2fbe3b5e tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Unrescuing
Aug 27 06:46:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-374ce9dd-b87a-4d00-bd19-01ca2fbe3b5e tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:46:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-374ce9dd-b87a-4d00-bd19-01ca2fbe3b5e tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquired lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:46:53 user nova-compute[73258]: DEBUG nova.network.neutron [None req-374ce9dd-b87a-4d00-bd19-01ca2fbe3b5e tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:46:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG nova.network.neutron [None req-374ce9dd-b87a-4d00-bd19-01ca2fbe3b5e tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Updating instance_info_cache with network_info: [{"id": "217b1702-a403-4f3a-bdae-7793382e5f38", "address": "fa:16:3e:5d:4e:76", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217b1702-a4", "ovs_interfaceid": "217b1702-a403-4f3a-bdae-7793382e5f38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-374ce9dd-b87a-4d00-bd19-01ca2fbe3b5e tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Releasing lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG nova.objects.instance [None req-374ce9dd-b87a-4d00-bd19-01ca2fbe3b5e tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'flavor' on Instance uuid 1672aa9f-be6f-4357-877f-a48f62119df4 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG nova.compute.manager [req-1ab2f1dd-d1fe-4acf-adf7-0ab6a73504f2 req-0dccf78d-d025-4843-97c9-086cdc16ac1e service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received event network-vif-unplugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1ab2f1dd-d1fe-4acf-adf7-0ab6a73504f2 req-0dccf78d-d025-4843-97c9-086cdc16ac1e service nova] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1ab2f1dd-d1fe-4acf-adf7-0ab6a73504f2 req-0dccf78d-d025-4843-97c9-086cdc16ac1e service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1ab2f1dd-d1fe-4acf-adf7-0ab6a73504f2 req-0dccf78d-d025-4843-97c9-086cdc16ac1e service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG nova.compute.manager [req-1ab2f1dd-d1fe-4acf-adf7-0ab6a73504f2 req-0dccf78d-d025-4843-97c9-086cdc16ac1e service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] No waiting events found dispatching network-vif-unplugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:46:54 user nova-compute[73258]: WARNING nova.compute.manager [req-1ab2f1dd-d1fe-4acf-adf7-0ab6a73504f2 req-0dccf78d-d025-4843-97c9-086cdc16ac1e service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received unexpected event network-vif-unplugged-217b1702-a403-4f3a-bdae-7793382e5f38 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:46:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:54 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Instance destroyed successfully.
Aug 27 06:46:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:55 user nova-compute[73258]: INFO nova.compute.manager [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Rescuing
Aug 27 06:46:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "refresh_cache-7ee743f1-9611-4165-838e-54fccb332f1a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:46:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquired lock "refresh_cache-7ee743f1-9611-4165-838e-54fccb332f1a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:46:55 user nova-compute[73258]: DEBUG nova.network.neutron [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:46:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG nova.compute.manager [req-bed15cde-d46d-44c3-bace-56c27ca0573d req-3a52c70e-277b-48c7-8e87-7a07c7cde1a6 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bed15cde-d46d-44c3-bace-56c27ca0573d req-3a52c70e-277b-48c7-8e87-7a07c7cde1a6 service nova] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bed15cde-d46d-44c3-bace-56c27ca0573d req-3a52c70e-277b-48c7-8e87-7a07c7cde1a6 service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bed15cde-d46d-44c3-bace-56c27ca0573d req-3a52c70e-277b-48c7-8e87-7a07c7cde1a6 service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG nova.compute.manager [req-bed15cde-d46d-44c3-bace-56c27ca0573d req-3a52c70e-277b-48c7-8e87-7a07c7cde1a6 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] No waiting events found dispatching network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:46:56 user nova-compute[73258]: WARNING nova.compute.manager [req-bed15cde-d46d-44c3-bace-56c27ca0573d req-3a52c70e-277b-48c7-8e87-7a07c7cde1a6 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received unexpected event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:46:56 user nova-compute[73258]: DEBUG nova.compute.manager [req-bed15cde-d46d-44c3-bace-56c27ca0573d req-3a52c70e-277b-48c7-8e87-7a07c7cde1a6 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bed15cde-d46d-44c3-bace-56c27ca0573d req-3a52c70e-277b-48c7-8e87-7a07c7cde1a6 service nova] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bed15cde-d46d-44c3-bace-56c27ca0573d req-3a52c70e-277b-48c7-8e87-7a07c7cde1a6 service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bed15cde-d46d-44c3-bace-56c27ca0573d req-3a52c70e-277b-48c7-8e87-7a07c7cde1a6 service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG nova.compute.manager [req-bed15cde-d46d-44c3-bace-56c27ca0573d req-3a52c70e-277b-48c7-8e87-7a07c7cde1a6 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] No waiting events found dispatching network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:46:56 user nova-compute[73258]: WARNING nova.compute.manager [req-bed15cde-d46d-44c3-bace-56c27ca0573d req-3a52c70e-277b-48c7-8e87-7a07c7cde1a6 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received unexpected event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:46:56 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:46:56 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:46:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=7554MB free_disk=24.14197540283203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1672aa9f-be6f-4357-877f-a48f62119df4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a836678e-240d-4ead-b0b5-64d146910a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9517c681-ed2b-49c2-94a6-aa2181b4b62f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 8396ca48-c47c-41b1-9872-24dbb0b9f526 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 2e89032a-0f74-4116-867e-a3b46fd20a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 50505a95-da00-4238-966d-c0a1e188b25c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 7ee743f1-9611-4165-838e-54fccb332f1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance ffc4da0b-3aad-4e7b-a093-97bd2eb1103a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG nova.network.neutron [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Updating instance_info_cache with network_info: [{"id": "27d47d21-922e-43da-8dee-8d62f45edd64", "address": "fa:16:3e:5c:73:20", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d47d21-92", "ovs_interfaceid": "27d47d21-922e-43da-8dee-8d62f45edd64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:46:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Releasing lock "refresh_cache-7ee743f1-9611-4165-838e-54fccb332f1a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:46:57 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:46:57 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:46:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:57 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:46:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.613s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:57 user nova-compute[73258]: DEBUG nova.compute.manager [req-036e1646-4c1a-427b-b31b-b87a9c1df9e7 req-487069f7-4780-4d4c-a9fc-57a91ccf9943 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received event network-vif-unplugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-036e1646-4c1a-427b-b31b-b87a9c1df9e7 req-487069f7-4780-4d4c-a9fc-57a91ccf9943 service nova] Acquiring lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-036e1646-4c1a-427b-b31b-b87a9c1df9e7 req-487069f7-4780-4d4c-a9fc-57a91ccf9943 service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-036e1646-4c1a-427b-b31b-b87a9c1df9e7 req-487069f7-4780-4d4c-a9fc-57a91ccf9943 service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:57 user nova-compute[73258]: DEBUG nova.compute.manager [req-036e1646-4c1a-427b-b31b-b87a9c1df9e7 req-487069f7-4780-4d4c-a9fc-57a91ccf9943 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] No waiting events found dispatching network-vif-unplugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:46:57 user nova-compute[73258]: WARNING nova.compute.manager [req-036e1646-4c1a-427b-b31b-b87a9c1df9e7 req-487069f7-4780-4d4c-a9fc-57a91ccf9943 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received unexpected event network-vif-unplugged-27d47d21-922e-43da-8dee-8d62f45edd64 for instance with vm_state active and task_state rescuing.
Aug 27 06:46:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:57 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Instance destroyed successfully.
Aug 27 06:46:57 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Attempting a stable device rescue
Aug 27 06:46:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73258) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 06:46:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Instance directory exists: not creating {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 06:46:57 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Creating image(s)
Aug 27 06:46:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ee743f1-9611-4165-838e-54fccb332f1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "/opt/stack/data/nova/instances/7ee743f1-9611-4165-838e-54fccb332f1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "/opt/stack/data/nova/instances/7ee743f1-9611-4165-838e-54fccb332f1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:57 user nova-compute[73258]: DEBUG nova.objects.instance [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7ee743f1-9611-4165-838e-54fccb332f1a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:46:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "6865daee479109107a6b910250f800196ee2c601" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "6865daee479109107a6b910250f800196ee2c601" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6865daee479109107a6b910250f800196ee2c601.part --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG nova.compute.manager [req-0e190bdc-5f84-4b25-bbf1-f4446629cc49 req-a289a122-2136-408d-8394-0d9030cc996d service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0e190bdc-5f84-4b25-bbf1-f4446629cc49 req-a289a122-2136-408d-8394-0d9030cc996d service nova] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0e190bdc-5f84-4b25-bbf1-f4446629cc49 req-a289a122-2136-408d-8394-0d9030cc996d service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0e190bdc-5f84-4b25-bbf1-f4446629cc49 req-a289a122-2136-408d-8394-0d9030cc996d service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG nova.compute.manager [req-0e190bdc-5f84-4b25-bbf1-f4446629cc49 req-a289a122-2136-408d-8394-0d9030cc996d service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] No waiting events found dispatching network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:46:59 user nova-compute[73258]: WARNING nova.compute.manager [req-0e190bdc-5f84-4b25-bbf1-f4446629cc49 req-a289a122-2136-408d-8394-0d9030cc996d service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received unexpected event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:46:59 user nova-compute[73258]: DEBUG nova.compute.manager [None req-374ce9dd-b87a-4d00-bd19-01ca2fbe3b5e tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Removed pending event for 1672aa9f-be6f-4357-877f-a48f62119df4 due to event {{(pid=73258) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118818.6913545, 1672aa9f-be6f-4357-877f-a48f62119df4 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:46:59 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] VM Resumed (Lifecycle Event)
Aug 27 06:46:59 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118818.692353, 1672aa9f-be6f-4357-877f-a48f62119df4 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:46:59 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] VM Started (Lifecycle Event)
Aug 27 06:46:59 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG nova.compute.manager [req-16b63da7-43b9-42f1-9243-beb4c6459188 req-ea6d11b6-3631-4904-ad55-812ce6aad39f service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received event network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-16b63da7-43b9-42f1-9243-beb4c6459188 req-ea6d11b6-3631-4904-ad55-812ce6aad39f service nova] Acquiring lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-16b63da7-43b9-42f1-9243-beb4c6459188 req-ea6d11b6-3631-4904-ad55-812ce6aad39f service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-16b63da7-43b9-42f1-9243-beb4c6459188 req-ea6d11b6-3631-4904-ad55-812ce6aad39f service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG nova.compute.manager [req-16b63da7-43b9-42f1-9243-beb4c6459188 req-ea6d11b6-3631-4904-ad55-812ce6aad39f service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] No waiting events found dispatching network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:46:59 user nova-compute[73258]: WARNING nova.compute.manager [req-16b63da7-43b9-42f1-9243-beb4c6459188 req-ea6d11b6-3631-4904-ad55-812ce6aad39f service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received unexpected event network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 for instance with vm_state active and task_state rescuing.
Aug 27 06:46:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6865daee479109107a6b910250f800196ee2c601.part --force-share --output=json" returned: 0 in 0.201s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG nova.virt.images [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] 3e3d0c3b-1d99-447a-89c5-772d2739bafa was qcow2, converting to raw {{(pid=73258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG nova.privsep.utils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6865daee479109107a6b910250f800196ee2c601.part /opt/stack/data/nova/instances/_base/6865daee479109107a6b910250f800196ee2c601.converted {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6865daee479109107a6b910250f800196ee2c601.part /opt/stack/data/nova/instances/_base/6865daee479109107a6b910250f800196ee2c601.converted" returned: 0 in 0.540s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:46:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6865daee479109107a6b910250f800196ee2c601.converted --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6865daee479109107a6b910250f800196ee2c601.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "6865daee479109107a6b910250f800196ee2c601" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.220s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "6865daee479109107a6b910250f800196ee2c601" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "6865daee479109107a6b910250f800196ee2c601" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6865daee479109107a6b910250f800196ee2c601 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6865daee479109107a6b910250f800196ee2c601 --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6865daee479109107a6b910250f800196ee2c601,backing_fmt=raw /opt/stack/data/nova/instances/7ee743f1-9611-4165-838e-54fccb332f1a/disk.rescue {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6865daee479109107a6b910250f800196ee2c601,backing_fmt=raw /opt/stack/data/nova/instances/7ee743f1-9611-4165-838e-54fccb332f1a/disk.rescue" returned: 0 in 0.053s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "6865daee479109107a6b910250f800196ee2c601" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.objects.instance [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'migration_context' on Instance uuid 7ee743f1-9611-4165-838e-54fccb332f1a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.objects.base [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Object Instance<7ee743f1-9611-4165-838e-54fccb332f1a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Start _get_guest_xml network_info=[{"id": "27d47d21-922e-43da-8dee-8d62f45edd64", "address": "fa:16:3e:5c:73:20", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "vif_mac": "fa:16:3e:5c:73:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d47d21-92", "ovs_interfaceid": "27d47d21-922e-43da-8dee-8d62f45edd64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3e3d0c3b-1d99-447a-89c5-772d2739bafa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKkwYrbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '7ee743f1-9611-4165-838e-54fccb332f1a', 'attached_at': '', 'detached_at': '', 'volume_id': '692b19f7-0f31-49f8-bfb3-fe4ef93542f7', 'serial': '692b19f7-0f31-49f8-bfb3-fe4ef93542f7'}, 'attachment_id': 'f84d1190-d983-47ee-b315-3ad74e228f3c', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.objects.instance [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'resources' on Instance uuid 7ee743f1-9611-4165-838e-54fccb332f1a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.objects.base [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Object Instance<7ee743f1-9611-4165-838e-54fccb332f1a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.objects.instance [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'numa_topology' on Instance uuid 7ee743f1-9611-4165-838e-54fccb332f1a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.objects.base [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Object Instance<7ee743f1-9611-4165-838e-54fccb332f1a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:47:00 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:47:00 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.objects.instance [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7ee743f1-9611-4165-838e-54fccb332f1a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.objects.base [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Object Instance<7ee743f1-9611-4165-838e-54fccb332f1a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKkwYrbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:47:00 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:47:00 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:47:00 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a797cd-4e31-4f6c-80a5-5428493d13e3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = AKkwYrbR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 27 06:47:00 user nova-compute[73258]: node.name = iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7
Aug 27 06:47:00 user nova-compute[73258]: node.tpgt = -1
Aug 27 06:47:00 user nova-compute[73258]: node.startup = automatic
Aug 27 06:47:00 user nova-compute[73258]: node.leading_login = No
Aug 27 06:47:00 user nova-compute[73258]: iface.iscsi_ifacename = default
Aug 27 06:47:00 user nova-compute[73258]: iface.net_ifacename = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.ipaddress = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.prefix_len = 0
Aug 27 06:47:00 user nova-compute[73258]: iface.hwaddress = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.transport_name = tcp
Aug 27 06:47:00 user nova-compute[73258]: iface.initiatorname = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.state = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.vlan_id = 0
Aug 27 06:47:00 user nova-compute[73258]: iface.vlan_priority = 0
Aug 27 06:47:00 user nova-compute[73258]: iface.vlan_state = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.iface_num = 0
Aug 27 06:47:00 user nova-compute[73258]: iface.mtu = 0
Aug 27 06:47:00 user nova-compute[73258]: iface.port = 0
Aug 27 06:47:00 user nova-compute[73258]: iface.bootproto = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.subnet_mask = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.gateway = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.dhcp_alt_client_id_state = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.dhcp_alt_client_id = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.dhcp_dns = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.dhcp_learn_iqn = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.dhcp_req_vendor_id_state = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.dhcp_vendor_id_state = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.dhcp_vendor_id = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.dhcp_slp_da = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.fragmentation = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.gratuitous_arp = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.incoming_forwarding = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.tos_state = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.tos = 0
Aug 27 06:47:00 user nova-compute[73258]: iface.ttl = 0
Aug 27 06:47:00 user nova-compute[73258]: iface.delayed_ack = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.tcp_nagle = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.tcp_wsf_state = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.tcp_wsf = 0
Aug 27 06:47:00 user nova-compute[73258]: iface.tcp_timer_scale = 0
Aug 27 06:47:00 user nova-compute[73258]: iface.tcp_timestamp = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.redirect = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.def_task_mgmt_timeout = 0
Aug 27 06:47:00 user nova-compute[73258]: iface.header_digest = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.data_digest = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.immediate_data = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.initial_r2t = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.data_seq_inorder = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.data_pdu_inorder = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.erl = 0
Aug 27 06:47:00 user nova-compute[73258]: iface.max_receive_data_len = 0
Aug 27 06:47:00 user nova-compute[73258]: iface.first_burst_len = 0
Aug 27 06:47:00 user nova-compute[73258]: iface.max_outstanding_r2t = 0
Aug 27 06:47:00 user nova-compute[73258]: iface.max_burst_len = 0
Aug 27 06:47:00 user nova-compute[73258]: iface.chap_auth = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.bidi_chap = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.strict_login_compliance = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.discovery_auth = <empty>
Aug 27 06:47:00 user nova-compute[73258]: iface.discovery_logout = <empty>
Aug 27 06:47:00 user nova-compute[73258]: node.discovery_address = <empty>
Aug 27 06:47:00 user nova-compute[73258]: node.discovery_port = 0
Aug 27 06:47:00 user nova-compute[73258]: node.discovery_type = static
Aug 27 06:47:00 user nova-compute[73258]: node.session.initial_cmdsn = 0
Aug 27 06:47:00 user nova-compute[73258]: node.session.initial_login_retry_max = 8
Aug 27 06:47:00 user nova-compute[73258]: node.session.xmit_thread_priority = -20
Aug 27 06:47:00 user nova-compute[73258]: node.session.cmds_max = 128
Aug 27 06:47:00 user nova-compute[73258]: node.session.queue_depth = 32
Aug 27 06:47:00 user nova-compute[73258]: node.session.nr_sessions = 1
Aug 27 06:47:00 user nova-compute[73258]: node.session.auth.authmethod = CHAP
Aug 27 06:47:00 user nova-compute[73258]: node.session.auth.username = AKkwYrbR
Aug 27 06:47:00 user nova-compute[73258]: node.session.auth.password = ***
Aug 27 06:47:00 user nova-compute[73258]: node.session.auth.username_in = <empty>
Aug 27 06:47:00 user nova-compute[73258]: node.session.auth.password_in = <empty>
Aug 27 06:47:00 user nova-compute[73258]: node.session.auth.chap_algs = MD5
Aug 27 06:47:00 user nova-compute[73258]: node.session.timeo.replacement_timeout = 120
Aug 27 06:47:00 user nova-compute[73258]: node.session.err_timeo.abort_timeout = 15
Aug 27 06:47:00 user nova-compute[73258]: node.session.err_timeo.lu_reset_timeout = 30
Aug 27 06:47:00 user nova-compute[73258]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 27 06:47:00 user nova-compute[73258]: node.session.err_timeo.host_reset_timeout = 60
Aug 27 06:47:00 user nova-compute[73258]: node.session.iscsi.FastAbort = Yes
Aug 27 06:47:00 user nova-compute[73258]: node.session.iscsi.InitialR2T = No
Aug 27 06:47:00 user nova-compute[73258]: node.session.iscsi.ImmediateData = Yes
Aug 27 06:47:00 user nova-compute[73258]: node.session.iscsi.FirstBurstLength = 262144
Aug 27 06:47:00 user nova-compute[73258]: node.session.iscsi.MaxBurstLength = 16776192
Aug 27 06:47:00 user nova-compute[73258]: node.session.iscsi.DefaultTime2Retain = 0
Aug 27 06:47:00 user nova-compute[73258]: node.session.iscsi.DefaultTime2Wait = 2
Aug 27 06:47:00 user nova-compute[73258]: node.session.iscsi.MaxConnections = 1
Aug 27 06:47:00 user nova-compute[73258]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 27 06:47:00 user nova-compute[73258]: node.session.iscsi.ERL = 0
Aug 27 06:47:00 user nova-compute[73258]: node.session.scan = manual
Aug 27 06:47:00 user nova-compute[73258]: node.session.reopen_max = 0
Aug 27 06:47:00 user nova-compute[73258]: node.conn[0].address = 172.16.0.220
Aug 27 06:47:00 user nova-compute[73258]: node.conn[0].port = 3260
Aug 27 06:47:00 user nova-compute[73258]: node.conn[0].startup = manual
Aug 27 06:47:00 user nova-compute[73258]: node.conn[0].tcp.window_size = 524288
Aug 27 06:47:00 user nova-compute[73258]: node.conn[0].tcp.type_of_service = 0
Aug 27 06:47:00 user nova-compute[73258]: node.conn[0].timeo.logout_timeout = 15
Aug 27 06:47:00 user nova-compute[73258]: node.conn[0].timeo.login_timeout = 15
Aug 27 06:47:00 user nova-compute[73258]: node.conn[0].timeo.auth_timeout = 45
Aug 27 06:47:00 user nova-compute[73258]: node.conn[0].timeo.noop_out_interval = 5
Aug 27 06:47:00 user nova-compute[73258]: node.conn[0].timeo.noop_out_timeout = 5
Aug 27 06:47:00 user nova-compute[73258]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 27 06:47:00 user nova-compute[73258]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 27 06:47:00 user nova-compute[73258]: node.conn[0].iscsi.HeaderDigest = None
Aug 27 06:47:00 user nova-compute[73258]: node.conn[0].iscsi.DataDigest = None
Aug 27 06:47:00 user nova-compute[73258]: node.conn[0].iscsi.IFMarker = No
Aug 27 06:47:00 user nova-compute[73258]: node.conn[0].iscsi.OFMarker = No
Aug 27 06:47:00 user nova-compute[73258]: # END RECORD
Aug 27 06:47:00 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5768ca00-ac2d-4e71-8176-2543af63a0d2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[208aa1b3-0bb9-4dc8-bc24-2406262e5106]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AKkwYrbR {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AKkwYrbR" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4604294f-a11c-49db-8083-f1ade0b3d6d0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AKkwYrbR'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f06502-8de5-4b6f-96a5-189321abf6dc]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[907b587b-7530-4f26-8417-a780a990d48b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:47:00 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:47:00 user nova-compute[73258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c (non-flash)
Aug 27 06:47:00 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:47:00 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:47:00 user nova-compute[73258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c (non-flash)
Aug 27 06:47:00 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.165s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] HCTL ('36', '0', '0', 0) found on session 24 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3841a4cd-e360-4537-a449-0461a313a342]: (4, ('0 0 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Searching for a device in session 24 and hctl ('36', '0', '0', 0) yield: sde {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKkwYrbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.192s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] <== connect_volume: return (194ms) {'type': 'block', 'scsi_wwn': '23532303464613439', 'path': '/dev/sde'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532303464613439', 'path': '/dev/sde'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:45:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2132461241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2132461241',id=26,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:45:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81cf34590d8d4b8b89b9626c6e150df6',ramdisk_id='',reservation_id='r-tebfip5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:45:31Z,user_data=None,user_id='36c0faed29a446aa9fa6ff8692581aba',uuid=7ee743f1-9611-4165-838e-54fccb332f1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27d47d21-922e-43da-8dee-8d62f45edd64", "address": "fa:16:3e:5c:73:20", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "vif_mac": "fa:16:3e:5c:73:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d47d21-92", "ovs_interfaceid": "27d47d21-922e-43da-8dee-8d62f45edd64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converting VIF {"id": "27d47d21-922e-43da-8dee-8d62f45edd64", "address": "fa:16:3e:5c:73:20", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "vif_mac": "fa:16:3e:5c:73:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d47d21-92", "ovs_interfaceid": "27d47d21-922e-43da-8dee-8d62f45edd64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:73:20,bridge_name='br-int',has_traffic_filtering=True,id=27d47d21-922e-43da-8dee-8d62f45edd64,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d47d21-92') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.objects.instance [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ee743f1-9611-4165-838e-54fccb332f1a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.objects.base [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Object Instance<7ee743f1-9611-4165-838e-54fccb332f1a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:47:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:47:00 user nova-compute[73258]:   <uuid>7ee743f1-9611-4165-838e-54fccb332f1a</uuid>
Aug 27 06:47:00 user nova-compute[73258]:   <name>instance-0000001a</name>
Aug 27 06:47:00 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:47:00 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:47:00 user nova-compute[73258]:   <metadata>
Aug 27 06:47:00 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:47:00 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:47:00 user nova-compute[73258]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2132461241</nova:name>
Aug 27 06:47:00 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:47:00</nova:creationTime>
Aug 27 06:47:00 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:47:00 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:47:00 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:47:00 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:47:00 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:47:00 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:47:00 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:47:00 user nova-compute[73258]:       <nova:owner>
Aug 27 06:47:00 user nova-compute[73258]:         <nova:user uuid="36c0faed29a446aa9fa6ff8692581aba">tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member</nova:user>
Aug 27 06:47:00 user nova-compute[73258]:         <nova:project uuid="81cf34590d8d4b8b89b9626c6e150df6">tempest-ServerBootFromVolumeStableRescueTest-1306655557</nova:project>
Aug 27 06:47:00 user nova-compute[73258]:       </nova:owner>
Aug 27 06:47:00 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:47:00 user nova-compute[73258]:       <nova:ports>
Aug 27 06:47:00 user nova-compute[73258]:         <nova:port uuid="27d47d21-922e-43da-8dee-8d62f45edd64">
Aug 27 06:47:00 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 06:47:00 user nova-compute[73258]:         </nova:port>
Aug 27 06:47:00 user nova-compute[73258]:       </nova:ports>
Aug 27 06:47:00 user nova-compute[73258]:     </nova:instance>
Aug 27 06:47:00 user nova-compute[73258]:   </metadata>
Aug 27 06:47:00 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:47:00 user nova-compute[73258]:     <system>
Aug 27 06:47:00 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:47:00 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:47:00 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:47:00 user nova-compute[73258]:       <entry name="serial">7ee743f1-9611-4165-838e-54fccb332f1a</entry>
Aug 27 06:47:00 user nova-compute[73258]:       <entry name="uuid">7ee743f1-9611-4165-838e-54fccb332f1a</entry>
Aug 27 06:47:00 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:47:00 user nova-compute[73258]:     </system>
Aug 27 06:47:00 user nova-compute[73258]:   </sysinfo>
Aug 27 06:47:00 user nova-compute[73258]:   <os>
Aug 27 06:47:00 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:47:00 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:47:00 user nova-compute[73258]:   </os>
Aug 27 06:47:00 user nova-compute[73258]:   <features>
Aug 27 06:47:00 user nova-compute[73258]:     <acpi/>
Aug 27 06:47:00 user nova-compute[73258]:     <apic/>
Aug 27 06:47:00 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:47:00 user nova-compute[73258]:   </features>
Aug 27 06:47:00 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:47:00 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:47:00 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:47:00 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:47:00 user nova-compute[73258]:   </clock>
Aug 27 06:47:00 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:47:00 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:47:00 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:47:00 user nova-compute[73258]:   </cpu>
Aug 27 06:47:00 user nova-compute[73258]:   <devices>
Aug 27 06:47:00 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:47:00 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:47:00 user nova-compute[73258]:       <source dev="/dev/sde"/>
Aug 27 06:47:00 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:47:00 user nova-compute[73258]:       <serial>692b19f7-0f31-49f8-bfb3-fe4ef93542f7</serial>
Aug 27 06:47:00 user nova-compute[73258]:     </disk>
Aug 27 06:47:00 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:47:00 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:47:00 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/7ee743f1-9611-4165-838e-54fccb332f1a/disk.rescue"/>
Aug 27 06:47:00 user nova-compute[73258]:       <target dev="vdb" bus="virtio"/>
Aug 27 06:47:00 user nova-compute[73258]:       <boot order="1"/>
Aug 27 06:47:00 user nova-compute[73258]:     </disk>
Aug 27 06:47:00 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:47:00 user nova-compute[73258]:       <mac address="fa:16:3e:5c:73:20"/>
Aug 27 06:47:00 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:47:00 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:47:00 user nova-compute[73258]:       <target dev="tap27d47d21-92"/>
Aug 27 06:47:00 user nova-compute[73258]:     </interface>
Aug 27 06:47:00 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:47:00 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/7ee743f1-9611-4165-838e-54fccb332f1a/console.log" append="off"/>
Aug 27 06:47:00 user nova-compute[73258]:     </serial>
Aug 27 06:47:00 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:47:00 user nova-compute[73258]:     <video>
Aug 27 06:47:00 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:47:00 user nova-compute[73258]:     </video>
Aug 27 06:47:00 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:47:00 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:47:00 user nova-compute[73258]:     </rng>
Aug 27 06:47:00 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:47:00 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:47:00 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:47:00 user nova-compute[73258]:     </memballoon>
Aug 27 06:47:00 user nova-compute[73258]:   </devices>
Aug 27 06:47:00 user nova-compute[73258]: </domain>
Aug 27 06:47:00 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:47:00 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Instance destroyed successfully.
Aug 27 06:47:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:47:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:47:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] No VIF found with MAC fa:16:3e:5c:73:20, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:47:01 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118806.621037, af558a1a-7bee-46b9-8b00-ff5f5a545e8e => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:47:01 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] VM Stopped (Lifecycle Event)
Aug 27 06:47:01 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3dddadb5-139a-4175-b08d-fdf3afa4aa31 None None] [instance: af558a1a-7bee-46b9-8b00-ff5f5a545e8e] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:47:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:02 user nova-compute[73258]: DEBUG nova.compute.manager [req-ddd89023-499a-45ac-9630-cc69903b9970 req-716ef7c2-6973-4c30-aaa2-578eb33c2bdc service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received event network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:47:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ddd89023-499a-45ac-9630-cc69903b9970 req-716ef7c2-6973-4c30-aaa2-578eb33c2bdc service nova] Acquiring lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:47:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ddd89023-499a-45ac-9630-cc69903b9970 req-716ef7c2-6973-4c30-aaa2-578eb33c2bdc service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:47:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ddd89023-499a-45ac-9630-cc69903b9970 req-716ef7c2-6973-4c30-aaa2-578eb33c2bdc service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:47:02 user nova-compute[73258]: DEBUG nova.compute.manager [req-ddd89023-499a-45ac-9630-cc69903b9970 req-716ef7c2-6973-4c30-aaa2-578eb33c2bdc service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] No waiting events found dispatching network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:47:02 user nova-compute[73258]: WARNING nova.compute.manager [req-ddd89023-499a-45ac-9630-cc69903b9970 req-716ef7c2-6973-4c30-aaa2-578eb33c2bdc service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received unexpected event network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 for instance with vm_state active and task_state rescuing.
Aug 27 06:47:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Removed pending event for 7ee743f1-9611-4165-838e-54fccb332f1a due to event {{(pid=73258) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 06:47:04 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118824.8850827, 7ee743f1-9611-4165-838e-54fccb332f1a => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:47:04 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] VM Resumed (Lifecycle Event)
Aug 27 06:47:04 user nova-compute[73258]: DEBUG nova.compute.manager [req-b7ec6b45-4fe4-49a9-acc2-38f50e89ba7a req-511c76e8-b810-477c-8b8e-65f4c0b409cf service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received event network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:47:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b7ec6b45-4fe4-49a9-acc2-38f50e89ba7a req-511c76e8-b810-477c-8b8e-65f4c0b409cf service nova] Acquiring lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:47:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b7ec6b45-4fe4-49a9-acc2-38f50e89ba7a req-511c76e8-b810-477c-8b8e-65f4c0b409cf service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:47:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b7ec6b45-4fe4-49a9-acc2-38f50e89ba7a req-511c76e8-b810-477c-8b8e-65f4c0b409cf service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:47:04 user nova-compute[73258]: DEBUG nova.compute.manager [req-b7ec6b45-4fe4-49a9-acc2-38f50e89ba7a req-511c76e8-b810-477c-8b8e-65f4c0b409cf service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] No waiting events found dispatching network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:47:04 user nova-compute[73258]: WARNING nova.compute.manager [req-b7ec6b45-4fe4-49a9-acc2-38f50e89ba7a req-511c76e8-b810-477c-8b8e-65f4c0b409cf service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received unexpected event network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 for instance with vm_state active and task_state rescuing.
Aug 27 06:47:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:47:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-2fff24bc-a0b8-4aee-855c-a313435d677a tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:47:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:47:04 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 06:47:04 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118824.886534, 7ee743f1-9611-4165-838e-54fccb332f1a => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:47:04 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] VM Started (Lifecycle Event)
Aug 27 06:47:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:47:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:47:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:13 user nova-compute[73258]: DEBUG nova.objects.instance [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'flavor' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:47:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "refresh_cache-9517c681-ed2b-49c2-94a6-aa2181b4b62f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:47:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquired lock "refresh_cache-9517c681-ed2b-49c2-94a6-aa2181b4b62f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:47:13 user nova-compute[73258]: DEBUG nova.network.neutron [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:47:13 user nova-compute[73258]: DEBUG nova.objects.instance [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'info_cache' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:47:13 user nova-compute[73258]: DEBUG nova.objects.base [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Object Instance<9517c681-ed2b-49c2-94a6-aa2181b4b62f> lazy-loaded attributes: flavor,info_cache {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:47:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.network.neutron [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Updating instance_info_cache with network_info: [{"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Releasing lock "refresh_cache-9517c681-ed2b-49c2-94a6-aa2181b4b62f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:47:14 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Instance destroyed successfully.
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.objects.instance [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'resources' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.objects.base [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Object Instance<9517c681-ed2b-49c2-94a6-aa2181b4b62f> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:43:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1573525836',display_name='tempest-AttachVolumeTestJSON-server-1573525836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1573525836',id=20,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuhlWzl340MR8vuL4wDTAkmN5hCJUdQIIyuqJCteVnLZ+c/yoSQsUNeq9gc2CsDlviPIALHDhlmzrpmhT0dESkXG7J9YKzWGCIInu7/GNC69QhJ+6s+eSD+zVfJ71qniA==',key_name='tempest-keypair-2145652813',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:43:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='191ca81ae335419aa935b1b7576b12ff',ramdisk_id='',reservation_id='r-nh0b3aah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1777325696',owner_user_name='tempest-AttachVolumeTestJSON-1777325696-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:45:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e3b8e4e749b4d039b4d5ebdc6469151',uuid=9517c681-ed2b-49c2-94a6-aa2181b4b62f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converting VIF {"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_vif [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b4375ea-f7, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:47:14 user nova-compute[73258]: INFO os_vif [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7')
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGxhdLjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:47:14 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89ee3eb-211f-475b-905f-43f15e540439]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c728b5-0736-43c6-8a37-65c5cd501fb1]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:47:14 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:47:14 user nova-compute[73258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c (non-flash)
Aug 27 06:47:14 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:47:14 user nova-compute[73258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:47:14 user nova-compute[73258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c (non-flash)
Aug 27 06:47:14 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4105c8b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e'): ({'sdc'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Removing single pathed devices sdc {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b699319-2c8d-4842-9e7e-a199de137e00]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[47eace0d-770e-40b3-87d8-cc25ff338429]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Flushing IO for device /dev/sdc {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d425f5-f905-41c9-981f-7626f2273e1b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a504c48-8448-4b74-87de-fb17cfdad94d]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[943b95e9-bd74-44e3-a27f-813e7f0234f2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb483183-4725-4d8c-ba87-b06860e267a1]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e, portal: 172.16.0.220,3260]
Aug 27 06:47:14 user nova-compute[73258]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e, portal: 172.16.0.220,3260] successful.
Aug 27 06:47:14 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53c52e9-9efd-4152-a4db-4a7dc96aa5c6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] <== disconnect_volume: return (290ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Start _get_guest_xml network_info=[{"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGxhdLjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '9517c681-ed2b-49c2-94a6-aa2181b4b62f', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb06556d-be68-45c0-ad6d-7b516b1d9f7e', 'serial': 'eb06556d-be68-45c0-ad6d-7b516b1d9f7e'}, 'attachment_id': 'b408e360-9f2f-4c21-b657-4375aa2f8743', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.objects.instance [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'numa_topology' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.objects.base [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Object Instance<9517c681-ed2b-49c2-94a6-aa2181b4b62f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:47:14 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:47:14 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.objects.instance [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.objects.base [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Object Instance<9517c681-ed2b-49c2-94a6-aa2181b4b62f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGxhdLjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:47:14 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:47:14 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:47:14 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[91402152-4d8b-49d6-b9df-9f4b932e655a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:47:14 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c1dfdf-44bc-49ef-8466-bad00118692f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e] added
Aug 27 06:47:14 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bec360-b2e2-40c3-a355-81c40a7f6d28]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb684c0-c109-456a-81d1-e0bd75f5abd2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JGxhdLjf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JGxhdLjf" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b546f55b-999f-489e-a04c-3733c327a314]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JGxhdLjf'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4c29b5-bd26-4d6a-a6ec-d8f990bdccc6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecef7bc-f809-4d5d-87df-c18d355a2b96]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:47:14 user nova-compute[73258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c (non-flash)
Aug 27 06:47:14 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:47:14 user nova-compute[73258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c (non-flash)
Aug 27 06:47:14 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[479ee039-a81d-4d9a-85de-d3e0bceee22c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e, portal: 172.16.0.220,3260]
Aug 27 06:47:14 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e, portal: 172.16.0.220,3260] successful.
Aug 27 06:47:14 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2826599c-49bb-403d-8bf0-d1e72619cd21]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:47:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:15 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dcfab8-b56d-448c-8ce4-333bc2ae5725]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:47:15 user nova-compute[73258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c (non-flash)
Aug 27 06:47:15 user nova-compute[73258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:47:15 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:47:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:47:15 user nova-compute[73258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c (non-flash)
Aug 27 06:47:15 user nova-compute[73258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:47:15 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:47:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:47:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:47:15 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:47:15 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:47:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:15 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[035e639c-c654-482b-a563-e1c2bdbddfe9]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:15 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:47:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGxhdLjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23162393531343935', 'path': '/dev/sdc'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162393531343935', 'path': '/dev/sdc'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:43:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1573525836',display_name='tempest-AttachVolumeTestJSON-server-1573525836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1573525836',id=20,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuhlWzl340MR8vuL4wDTAkmN5hCJUdQIIyuqJCteVnLZ+c/yoSQsUNeq9gc2CsDlviPIALHDhlmzrpmhT0dESkXG7J9YKzWGCIInu7/GNC69QhJ+6s+eSD+zVfJ71qniA==',key_name='tempest-keypair-2145652813',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:43:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='191ca81ae335419aa935b1b7576b12ff',ramdisk_id='',reservation_id='r-nh0b3aah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1777325696',owner_user_name='tempest-AttachVolumeTestJSON-1777325696-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:45:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e3b8e4e749b4d039b4d5ebdc6469151',uuid=9517c681-ed2b-49c2-94a6-aa2181b4b62f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converting VIF {"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG nova.objects.instance [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'pci_devices' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG nova.objects.base [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Object Instance<9517c681-ed2b-49c2-94a6-aa2181b4b62f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:47:16 user nova-compute[73258]:   <uuid>9517c681-ed2b-49c2-94a6-aa2181b4b62f</uuid>
Aug 27 06:47:16 user nova-compute[73258]:   <name>instance-00000014</name>
Aug 27 06:47:16 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:47:16 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:47:16 user nova-compute[73258]:   <metadata>
Aug 27 06:47:16 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:47:16 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:47:16 user nova-compute[73258]:       <nova:name>tempest-AttachVolumeTestJSON-server-1573525836</nova:name>
Aug 27 06:47:16 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:47:14</nova:creationTime>
Aug 27 06:47:16 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:47:16 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:47:16 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:47:16 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:47:16 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:47:16 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:47:16 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:47:16 user nova-compute[73258]:       <nova:owner>
Aug 27 06:47:16 user nova-compute[73258]:         <nova:user uuid="9e3b8e4e749b4d039b4d5ebdc6469151">tempest-AttachVolumeTestJSON-1777325696-project-member</nova:user>
Aug 27 06:47:16 user nova-compute[73258]:         <nova:project uuid="191ca81ae335419aa935b1b7576b12ff">tempest-AttachVolumeTestJSON-1777325696</nova:project>
Aug 27 06:47:16 user nova-compute[73258]:       </nova:owner>
Aug 27 06:47:16 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:47:16 user nova-compute[73258]:       <nova:ports>
Aug 27 06:47:16 user nova-compute[73258]:         <nova:port uuid="7b4375ea-f74b-4677-a768-97e96029c237">
Aug 27 06:47:16 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 06:47:16 user nova-compute[73258]:         </nova:port>
Aug 27 06:47:16 user nova-compute[73258]:       </nova:ports>
Aug 27 06:47:16 user nova-compute[73258]:     </nova:instance>
Aug 27 06:47:16 user nova-compute[73258]:   </metadata>
Aug 27 06:47:16 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:47:16 user nova-compute[73258]:     <system>
Aug 27 06:47:16 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:47:16 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:47:16 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:47:16 user nova-compute[73258]:       <entry name="serial">9517c681-ed2b-49c2-94a6-aa2181b4b62f</entry>
Aug 27 06:47:16 user nova-compute[73258]:       <entry name="uuid">9517c681-ed2b-49c2-94a6-aa2181b4b62f</entry>
Aug 27 06:47:16 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:47:16 user nova-compute[73258]:     </system>
Aug 27 06:47:16 user nova-compute[73258]:   </sysinfo>
Aug 27 06:47:16 user nova-compute[73258]:   <os>
Aug 27 06:47:16 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:47:16 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:47:16 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:47:16 user nova-compute[73258]:   </os>
Aug 27 06:47:16 user nova-compute[73258]:   <features>
Aug 27 06:47:16 user nova-compute[73258]:     <acpi/>
Aug 27 06:47:16 user nova-compute[73258]:     <apic/>
Aug 27 06:47:16 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:47:16 user nova-compute[73258]:   </features>
Aug 27 06:47:16 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:47:16 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:47:16 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:47:16 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:47:16 user nova-compute[73258]:   </clock>
Aug 27 06:47:16 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:47:16 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:47:16 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:47:16 user nova-compute[73258]:   </cpu>
Aug 27 06:47:16 user nova-compute[73258]:   <devices>
Aug 27 06:47:16 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:47:16 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:47:16 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk"/>
Aug 27 06:47:16 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:47:16 user nova-compute[73258]:     </disk>
Aug 27 06:47:16 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:47:16 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:47:16 user nova-compute[73258]:       <source dev="/dev/sdc"/>
Aug 27 06:47:16 user nova-compute[73258]:       <target dev="vdb" bus="virtio"/>
Aug 27 06:47:16 user nova-compute[73258]:       <serial>eb06556d-be68-45c0-ad6d-7b516b1d9f7e</serial>
Aug 27 06:47:16 user nova-compute[73258]:     </disk>
Aug 27 06:47:16 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:47:16 user nova-compute[73258]:       <mac address="fa:16:3e:f5:fe:36"/>
Aug 27 06:47:16 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:47:16 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:47:16 user nova-compute[73258]:       <target dev="tap7b4375ea-f7"/>
Aug 27 06:47:16 user nova-compute[73258]:     </interface>
Aug 27 06:47:16 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:47:16 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/console.log" append="off"/>
Aug 27 06:47:16 user nova-compute[73258]:     </serial>
Aug 27 06:47:16 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:47:16 user nova-compute[73258]:     <video>
Aug 27 06:47:16 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:47:16 user nova-compute[73258]:     </video>
Aug 27 06:47:16 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:47:16 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:47:16 user nova-compute[73258]:     </rng>
Aug 27 06:47:16 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:47:16 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:47:16 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:47:16 user nova-compute[73258]:     </memballoon>
Aug 27 06:47:16 user nova-compute[73258]:   </devices>
Aug 27 06:47:16 user nova-compute[73258]: </domain>
Aug 27 06:47:16 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG nova.objects.instance [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG nova.objects.base [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Object Instance<9517c681-ed2b-49c2-94a6-aa2181b4b62f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.171s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Cannot resize image /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG nova.objects.instance [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'migration_context' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG nova.objects.base [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Object Instance<9517c681-ed2b-49c2-94a6-aa2181b4b62f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:43:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1573525836',display_name='tempest-AttachVolumeTestJSON-server-1573525836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1573525836',id=20,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuhlWzl340MR8vuL4wDTAkmN5hCJUdQIIyuqJCteVnLZ+c/yoSQsUNeq9gc2CsDlviPIALHDhlmzrpmhT0dESkXG7J9YKzWGCIInu7/GNC69QhJ+6s+eSD+zVfJ71qniA==',key_name='tempest-keypair-2145652813',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:43:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='191ca81ae335419aa935b1b7576b12ff',ramdisk_id='',reservation_id='r-nh0b3aah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1777325696',owner_user_name='tempest-AttachVolumeTestJSON-1777325696-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:45:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e3b8e4e749b4d039b4d5ebdc6469151',uuid=9517c681-ed2b-49c2-94a6-aa2181b4b62f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converting VIF {"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG os_vif [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b4375ea-f7, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7b4375ea-f7, col_values=(('external_ids', {'iface-id': '7b4375ea-f74b-4677-a768-97e96029c237', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:fe:36', 'vm-uuid': '9517c681-ed2b-49c2-94a6-aa2181b4b62f'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:47:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:16 user nova-compute[73258]: INFO os_vif [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7')
Aug 27 06:47:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-21af55bb-caaa-43ba-ab74-4ee9f56bd32d req-2ba41557-a373-4baf-abe5-8646a19effbb service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:47:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-21af55bb-caaa-43ba-ab74-4ee9f56bd32d req-2ba41557-a373-4baf-abe5-8646a19effbb service nova] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:47:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-21af55bb-caaa-43ba-ab74-4ee9f56bd32d req-2ba41557-a373-4baf-abe5-8646a19effbb service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:47:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-21af55bb-caaa-43ba-ab74-4ee9f56bd32d req-2ba41557-a373-4baf-abe5-8646a19effbb service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:47:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-21af55bb-caaa-43ba-ab74-4ee9f56bd32d req-2ba41557-a373-4baf-abe5-8646a19effbb service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] No waiting events found dispatching network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:47:18 user nova-compute[73258]: WARNING nova.compute.manager [req-21af55bb-caaa-43ba-ab74-4ee9f56bd32d req-2ba41557-a373-4baf-abe5-8646a19effbb service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received unexpected event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 for instance with vm_state stopped and task_state powering-on.
Aug 27 06:47:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:20 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118840.7205417, 9517c681-ed2b-49c2-94a6-aa2181b4b62f => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:47:20 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] VM Resumed (Lifecycle Event)
Aug 27 06:47:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:47:20 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Instance rebooted successfully.
Aug 27 06:47:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-d0d72061-7e56-4385-9c5c-8d9a579fb0d0 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:47:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:47:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:47:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-507885cc-6b96-4d96-9ef4-c86a2407e2bd req-bfba19fc-c7b1-42f8-91b8-27ad8b20d0ca service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:47:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-507885cc-6b96-4d96-9ef4-c86a2407e2bd req-bfba19fc-c7b1-42f8-91b8-27ad8b20d0ca service nova] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:47:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-507885cc-6b96-4d96-9ef4-c86a2407e2bd req-bfba19fc-c7b1-42f8-91b8-27ad8b20d0ca service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:47:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-507885cc-6b96-4d96-9ef4-c86a2407e2bd req-bfba19fc-c7b1-42f8-91b8-27ad8b20d0ca service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:47:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-507885cc-6b96-4d96-9ef4-c86a2407e2bd req-bfba19fc-c7b1-42f8-91b8-27ad8b20d0ca service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] No waiting events found dispatching network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:47:20 user nova-compute[73258]: WARNING nova.compute.manager [req-507885cc-6b96-4d96-9ef4-c86a2407e2bd req-bfba19fc-c7b1-42f8-91b8-27ad8b20d0ca service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received unexpected event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 for instance with vm_state stopped and task_state powering-on.
Aug 27 06:47:20 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 27 06:47:20 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118840.7247314, 9517c681-ed2b-49c2-94a6-aa2181b4b62f => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:47:20 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] VM Started (Lifecycle Event)
Aug 27 06:47:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:47:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:47:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:33 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:47:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 06:47:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:38 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:47:38 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:47:38 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 06:47:38 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:47:38 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:47:38 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:47:38 user nova-compute[73258]: DEBUG nova.objects.instance [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lazy-loading 'info_cache' on Instance uuid 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:47:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:39 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Updating instance_info_cache with network_info: [{"id": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "address": "fa:16:3e:82:0b:22", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f7670e-c9", "ovs_interfaceid": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:47:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:47:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:47:39 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:47:40 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:47:41 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:47:41 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:47:41 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:47:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:42 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:47:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 06:47:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] There are 0 instances to clean {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 06:47:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:47:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:44 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:47:44 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:47:44 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:47:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "50505a95-da00-4238-966d-c0a1e188b25c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:47:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "50505a95-da00-4238-966d-c0a1e188b25c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:47:45 user nova-compute[73258]: INFO nova.compute.manager [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Detaching volume 738d1fa4-5c20-472d-8b10-d7324321863c
Aug 27 06:47:45 user nova-compute[73258]: INFO nova.virt.block_device [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Attempting to driver detach volume 738d1fa4-5c20-472d-8b10-d7324321863c from mountpoint /dev/vdb
Aug 27 06:47:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Attempting to detach device vdb from instance 50505a95-da00-4238-966d-c0a1e188b25c from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:47:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:47:45 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:47:45 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:47:45 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:47:45 user nova-compute[73258]:   <serial>738d1fa4-5c20-472d-8b10-d7324321863c</serial>
Aug 27 06:47:45 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:47:45 user nova-compute[73258]: </disk>
Aug 27 06:47:45 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:47:45 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Successfully detached device vdb from instance 50505a95-da00-4238-966d-c0a1e188b25c from the persistent domain config.
Aug 27 06:47:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 50505a95-da00-4238-966d-c0a1e188b25c from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:47:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:47:45 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:47:45 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:47:45 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:47:45 user nova-compute[73258]:   <serial>738d1fa4-5c20-472d-8b10-d7324321863c</serial>
Aug 27 06:47:45 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:47:45 user nova-compute[73258]: </disk>
Aug 27 06:47:45 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "50505a95-da00-4238-966d-c0a1e188b25c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693118866.1617887, 50505a95-da00-4238-966d-c0a1e188b25c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 50505a95-da00-4238-966d-c0a1e188b25c {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:47:46 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Successfully detached device vdb from instance 50505a95-da00-4238-966d-c0a1e188b25c from the live domain config.
Aug 27 06:47:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwOZSxVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:47:46 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:47:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd24f8c4-5055-4be0-9afc-7942d31c8d08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6232051e-d9f2-467c-a990-8d5003480fa5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:47:46 user nova-compute[73258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c (non-flash)
Aug 27 06:47:46 user nova-compute[73258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:47:46 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:47:46 user nova-compute[73258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c (non-flash)
Aug 27 06:47:46 user nova-compute[73258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:47:46 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4107b9630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfe3a05-43a2-4152-868e-7510aa8a578d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[241119d6-db51-46d2-a1fd-b7ce01e62297]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c6c301-069d-4e84-8774-740ede9fa64f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e73c89b-b7ea-48e9-afb2-638c3c346a84]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[df01308b-d8ed-43e7-adba-987972a2cfc4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[924e0706-5c58-49a1-a69b-6563c97c707f]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c, portal: 172.16.0.220,3260]
Aug 27 06:47:46 user nova-compute[73258]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c, portal: 172.16.0.220,3260] successful.
Aug 27 06:47:46 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccafc8c-a236-4f3e-bc23-2ef3b1f8c506]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] <== disconnect_volume: return (298ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:47:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:47 user nova-compute[73258]: DEBUG nova.objects.instance [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lazy-loading 'flavor' on Instance uuid 50505a95-da00-4238-966d-c0a1e188b25c {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:47:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-09f66f40-4665-4c77-8727-ed405c848bce tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "50505a95-da00-4238-966d-c0a1e188b25c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.789s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:47:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "50505a95-da00-4238-966d-c0a1e188b25c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.354s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:47:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "50505a95-da00-4238-966d-c0a1e188b25c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:47:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "50505a95-da00-4238-966d-c0a1e188b25c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:47:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "50505a95-da00-4238-966d-c0a1e188b25c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:47:47 user nova-compute[73258]: INFO nova.compute.manager [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Terminating instance
Aug 27 06:47:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:47:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:47 user nova-compute[73258]: DEBUG nova.compute.manager [req-359d11c2-e1b8-4020-acd2-96f8d209b24c req-9c3a54c0-70d2-48cd-bb4e-de97a1e5c821 service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Received event network-vif-unplugged-13b80966-4283-4438-ae88-8c0a770c1c55 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:47:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-359d11c2-e1b8-4020-acd2-96f8d209b24c req-9c3a54c0-70d2-48cd-bb4e-de97a1e5c821 service nova] Acquiring lock "50505a95-da00-4238-966d-c0a1e188b25c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:47:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-359d11c2-e1b8-4020-acd2-96f8d209b24c req-9c3a54c0-70d2-48cd-bb4e-de97a1e5c821 service nova] Lock "50505a95-da00-4238-966d-c0a1e188b25c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:47:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-359d11c2-e1b8-4020-acd2-96f8d209b24c req-9c3a54c0-70d2-48cd-bb4e-de97a1e5c821 service nova] Lock "50505a95-da00-4238-966d-c0a1e188b25c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:47:47 user nova-compute[73258]: DEBUG nova.compute.manager [req-359d11c2-e1b8-4020-acd2-96f8d209b24c req-9c3a54c0-70d2-48cd-bb4e-de97a1e5c821 service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] No waiting events found dispatching network-vif-unplugged-13b80966-4283-4438-ae88-8c0a770c1c55 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:47:47 user nova-compute[73258]: DEBUG nova.compute.manager [req-359d11c2-e1b8-4020-acd2-96f8d209b24c req-9c3a54c0-70d2-48cd-bb4e-de97a1e5c821 service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Received event network-vif-unplugged-13b80966-4283-4438-ae88-8c0a770c1c55 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:48 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Instance destroyed successfully.
Aug 27 06:47:48 user nova-compute[73258]: DEBUG nova.objects.instance [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lazy-loading 'resources' on Instance uuid 50505a95-da00-4238-966d-c0a1e188b25c {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:44:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1969656533',display_name='tempest-VolumesSnapshotTestJSON-instance-1969656533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1969656533',id=23,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaBUcc+fl48JvwZrb7uzwVRGl1d4zh4BV2X0LLHzHmApOrJX8yWRvbT7YOHHUt2OtZD1+vCdP2eKy1U0C0E+EHcwnxQUNSwOiFDuTprSn689HYcjAprywFMBUtq8IhkiQ==',key_name='tempest-keypair-453956977',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:44:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2900acc4299f427fa7152d2f039e026f',ramdisk_id='',reservation_id='r-g39n2rip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-993486304',owner_user_name='tempest-VolumesSnapshotTestJSON-993486304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:44:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e39b42a04fd64685ac7382cd16dc7285',uuid=50505a95-da00-4238-966d-c0a1e188b25c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13b80966-4283-4438-ae88-8c0a770c1c55", "address": "fa:16:3e:07:c3:72", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b80966-42", "ovs_interfaceid": "13b80966-4283-4438-ae88-8c0a770c1c55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Converting VIF {"id": "13b80966-4283-4438-ae88-8c0a770c1c55", "address": "fa:16:3e:07:c3:72", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b80966-42", "ovs_interfaceid": "13b80966-4283-4438-ae88-8c0a770c1c55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:c3:72,bridge_name='br-int',has_traffic_filtering=True,id=13b80966-4283-4438-ae88-8c0a770c1c55,network=Network(82b73052-3c5c-4f8f-b938-b4423125eae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b80966-42') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG os_vif [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:c3:72,bridge_name='br-int',has_traffic_filtering=True,id=13b80966-4283-4438-ae88-8c0a770c1c55,network=Network(82b73052-3c5c-4f8f-b938-b4423125eae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b80966-42') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13b80966-42, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:47:48 user nova-compute[73258]: INFO os_vif [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:c3:72,bridge_name='br-int',has_traffic_filtering=True,id=13b80966-4283-4438-ae88-8c0a770c1c55,network=Network(82b73052-3c5c-4f8f-b938-b4423125eae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b80966-42')
Aug 27 06:47:48 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwOZSxVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:47:48 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:47:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:738d1fa4-5c20-472d-8b10-d7324321863c', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[73987389-dd2e-42a4-8eff-1ab2d98bd382]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d8c6c9-bade-4d7e-ba56-10d2b331a900]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:47:48 user nova-compute[73258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:47:48 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:47:48 user nova-compute[73258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:47:48 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa430323c70>, {}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Disconnecting from: [] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.056s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] <== disconnect_volume: return (57ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:47:48 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Deleting instance files /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c_del
Aug 27 06:47:48 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Deletion of /opt/stack/data/nova/instances/50505a95-da00-4238-966d-c0a1e188b25c_del complete
Aug 27 06:47:48 user nova-compute[73258]: INFO nova.compute.manager [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 27 06:47:48 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:47:48 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:47:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:49 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:47:49 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Took 1.08 seconds to deallocate network for instance.
Aug 27 06:47:49 user nova-compute[73258]: WARNING nova.volume.cinder [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Attachment 3569d793-6896-4e03-be17-e2f1fbc96287 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3569d793-6896-4e03-be17-e2f1fbc96287. (HTTP 404) (Request-ID: req-5086a143-c88a-49ad-ad28-89d1a3dd018b)
Aug 27 06:47:49 user nova-compute[73258]: INFO nova.compute.manager [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Took 0.03 seconds to detach 1 volumes for instance.
Aug 27 06:47:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:47:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:47:49 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Refreshing inventories for resource provider 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 06:47:49 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Updating ProviderTree inventory for provider 13f05024-5078-4590-94a5-110d29d864c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 06:47:49 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Updating inventory in ProviderTree for provider 13f05024-5078-4590-94a5-110d29d864c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 06:47:49 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Refreshing aggregate associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, aggregates: None {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 06:47:49 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Refreshing trait associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 06:47:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-764ca6c4-19b7-409e-82be-0c72c88ca1bf req-9b27bccb-c775-46e6-9d8f-e6ef6720edde service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Received event network-vif-plugged-13b80966-4283-4438-ae88-8c0a770c1c55 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:47:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-764ca6c4-19b7-409e-82be-0c72c88ca1bf req-9b27bccb-c775-46e6-9d8f-e6ef6720edde service nova] Acquiring lock "50505a95-da00-4238-966d-c0a1e188b25c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:47:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-764ca6c4-19b7-409e-82be-0c72c88ca1bf req-9b27bccb-c775-46e6-9d8f-e6ef6720edde service nova] Lock "50505a95-da00-4238-966d-c0a1e188b25c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:47:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-764ca6c4-19b7-409e-82be-0c72c88ca1bf req-9b27bccb-c775-46e6-9d8f-e6ef6720edde service nova] Lock "50505a95-da00-4238-966d-c0a1e188b25c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:47:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-764ca6c4-19b7-409e-82be-0c72c88ca1bf req-9b27bccb-c775-46e6-9d8f-e6ef6720edde service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] No waiting events found dispatching network-vif-plugged-13b80966-4283-4438-ae88-8c0a770c1c55 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:47:49 user nova-compute[73258]: WARNING nova.compute.manager [req-764ca6c4-19b7-409e-82be-0c72c88ca1bf req-9b27bccb-c775-46e6-9d8f-e6ef6720edde service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Received unexpected event network-vif-plugged-13b80966-4283-4438-ae88-8c0a770c1c55 for instance with vm_state deleted and task_state None.
Aug 27 06:47:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-764ca6c4-19b7-409e-82be-0c72c88ca1bf req-9b27bccb-c775-46e6-9d8f-e6ef6720edde service nova] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Received event network-vif-deleted-13b80966-4283-4438-ae88-8c0a770c1c55 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:47:50 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:47:50 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:47:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.625s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:47:50 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Deleted allocations for instance 50505a95-da00-4238-966d-c0a1e188b25c
Aug 27 06:47:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-380ad727-c827-4ec8-bdaf-8e5722b59b48 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "50505a95-da00-4238-966d-c0a1e188b25c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.841s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:47:51 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:47:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:47:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:47:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:47:51 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:47:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:47:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:47:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee743f1-9611-4165-838e-54fccb332f1a/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee743f1-9611-4165-838e-54fccb332f1a/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee743f1-9611-4165-838e-54fccb332f1a/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ee743f1-9611-4165-838e-54fccb332f1a/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:56 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:47:56 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:47:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=7272MB free_disk=24.032974243164062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:47:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:47:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:47:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:47:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1672aa9f-be6f-4357-877f-a48f62119df4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:47:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:47:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a836678e-240d-4ead-b0b5-64d146910a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:47:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9517c681-ed2b-49c2-94a6-aa2181b4b62f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:47:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 8396ca48-c47c-41b1-9872-24dbb0b9f526 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:47:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 2e89032a-0f74-4116-867e-a3b46fd20a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:47:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 7ee743f1-9611-4165-838e-54fccb332f1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:47:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance ffc4da0b-3aad-4e7b-a093-97bd2eb1103a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:47:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:47:56 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:47:56 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:47:56 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:47:57 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:47:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:47:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:47:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:47:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:47:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:47:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:47:58 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:47:58 user nova-compute[73258]: INFO nova.compute.claims [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Claim successful on node user
Aug 27 06:47:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:58 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:47:58 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:47:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:47:58 user nova-compute[73258]: DEBUG nova.compute.manager [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:47:58 user nova-compute[73258]: DEBUG nova.compute.manager [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:47:58 user nova-compute[73258]: DEBUG nova.network.neutron [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:47:58 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:47:58 user nova-compute[73258]: DEBUG nova.compute.manager [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:47:58 user nova-compute[73258]: DEBUG nova.policy [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ec7b0ff818840ab9d77576254aaf89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf1d43b7929c4f60a9948f0d9ed35fce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:47:58 user nova-compute[73258]: DEBUG nova.compute.manager [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:47:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:47:58 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Creating image(s)
Aug 27 06:47:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:47:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "/opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:47:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "/opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:47:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.178s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:47:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:47:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:47:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.228s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk 1073741824" returned: 0 in 0.053s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:47:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:59 user nova-compute[73258]: DEBUG nova.network.neutron [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Successfully created port: c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:47:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.229s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:59 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:47:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:47:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:47:59 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Cannot resize image /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:47:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:47:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Ensure instance console log exists: /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:47:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:47:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:47:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.network.neutron [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Successfully updated port: c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquired lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.network.neutron [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.compute.manager [req-01fd5768-1511-4397-9736-2c70b0da49d0 req-6402856d-b803-4b90-9fba-1e251fd69ca5 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received event network-changed-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.compute.manager [req-01fd5768-1511-4397-9736-2c70b0da49d0 req-6402856d-b803-4b90-9fba-1e251fd69ca5 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Refreshing instance network info cache due to event network-changed-c8024bd0-329f-4c9e-8974-4881fc97ada9. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-01fd5768-1511-4397-9736-2c70b0da49d0 req-6402856d-b803-4b90-9fba-1e251fd69ca5 service nova] Acquiring lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.network.neutron [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.network.neutron [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Updating instance_info_cache with network_info: [{"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Releasing lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.compute.manager [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Instance network_info: |[{"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-01fd5768-1511-4397-9736-2c70b0da49d0 req-6402856d-b803-4b90-9fba-1e251fd69ca5 service nova] Acquired lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.network.neutron [req-01fd5768-1511-4397-9736-2c70b0da49d0 req-6402856d-b803-4b90-9fba-1e251fd69ca5 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Refreshing network info cache for port c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Start _get_guest_xml network_info=[{"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:48:00 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:48:00 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1707767622',display_name='tempest-ServerActionsTestOtherB-server-1707767622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1707767622',id=28,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCup9tVy/ES6sbgueL/45Bba8K9LkjKsB0AzSdwXqHLd/SJJd00ZmJLNSvj/I/yfKqYtF7c1wkGM0pTAca7U7ASXDTxzPj0yMtlZAbKBP15oOn8TvN1fkhhoEIFexZqUw==',key_name='tempest-keypair-903561007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf1d43b7929c4f60a9948f0d9ed35fce',ramdisk_id='',reservation_id='r-rpya4ij3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-895910456',owner_user_name='tempest-ServerActionsTestOtherB-895910456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:47:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ec7b0ff818840ab9d77576254aaf89e',uuid=bc3cebb3-0e29-4899-94aa-d13a2a9ca86a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Converting VIF {"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.objects.instance [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lazy-loading 'pci_devices' on Instance uuid bc3cebb3-0e29-4899-94aa-d13a2a9ca86a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:48:00 user nova-compute[73258]:   <uuid>bc3cebb3-0e29-4899-94aa-d13a2a9ca86a</uuid>
Aug 27 06:48:00 user nova-compute[73258]:   <name>instance-0000001c</name>
Aug 27 06:48:00 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:48:00 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:48:00 user nova-compute[73258]:   <metadata>
Aug 27 06:48:00 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:48:00 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:48:00 user nova-compute[73258]:       <nova:name>tempest-ServerActionsTestOtherB-server-1707767622</nova:name>
Aug 27 06:48:00 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:48:00</nova:creationTime>
Aug 27 06:48:00 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:48:00 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:48:00 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:48:00 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:48:00 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:48:00 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:48:00 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:48:00 user nova-compute[73258]:       <nova:owner>
Aug 27 06:48:00 user nova-compute[73258]:         <nova:user uuid="6ec7b0ff818840ab9d77576254aaf89e">tempest-ServerActionsTestOtherB-895910456-project-member</nova:user>
Aug 27 06:48:00 user nova-compute[73258]:         <nova:project uuid="cf1d43b7929c4f60a9948f0d9ed35fce">tempest-ServerActionsTestOtherB-895910456</nova:project>
Aug 27 06:48:00 user nova-compute[73258]:       </nova:owner>
Aug 27 06:48:00 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:48:00 user nova-compute[73258]:       <nova:ports>
Aug 27 06:48:00 user nova-compute[73258]:         <nova:port uuid="c8024bd0-329f-4c9e-8974-4881fc97ada9">
Aug 27 06:48:00 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 06:48:00 user nova-compute[73258]:         </nova:port>
Aug 27 06:48:00 user nova-compute[73258]:       </nova:ports>
Aug 27 06:48:00 user nova-compute[73258]:     </nova:instance>
Aug 27 06:48:00 user nova-compute[73258]:   </metadata>
Aug 27 06:48:00 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:48:00 user nova-compute[73258]:     <system>
Aug 27 06:48:00 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:48:00 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:48:00 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:48:00 user nova-compute[73258]:       <entry name="serial">bc3cebb3-0e29-4899-94aa-d13a2a9ca86a</entry>
Aug 27 06:48:00 user nova-compute[73258]:       <entry name="uuid">bc3cebb3-0e29-4899-94aa-d13a2a9ca86a</entry>
Aug 27 06:48:00 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:48:00 user nova-compute[73258]:     </system>
Aug 27 06:48:00 user nova-compute[73258]:   </sysinfo>
Aug 27 06:48:00 user nova-compute[73258]:   <os>
Aug 27 06:48:00 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:48:00 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:48:00 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:48:00 user nova-compute[73258]:   </os>
Aug 27 06:48:00 user nova-compute[73258]:   <features>
Aug 27 06:48:00 user nova-compute[73258]:     <acpi/>
Aug 27 06:48:00 user nova-compute[73258]:     <apic/>
Aug 27 06:48:00 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:48:00 user nova-compute[73258]:   </features>
Aug 27 06:48:00 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:48:00 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:48:00 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:48:00 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:48:00 user nova-compute[73258]:   </clock>
Aug 27 06:48:00 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:48:00 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:48:00 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:48:00 user nova-compute[73258]:   </cpu>
Aug 27 06:48:00 user nova-compute[73258]:   <devices>
Aug 27 06:48:00 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:48:00 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:48:00 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk"/>
Aug 27 06:48:00 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:48:00 user nova-compute[73258]:     </disk>
Aug 27 06:48:00 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:48:00 user nova-compute[73258]:       <mac address="fa:16:3e:6d:e9:55"/>
Aug 27 06:48:00 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:48:00 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:48:00 user nova-compute[73258]:       <target dev="tapc8024bd0-32"/>
Aug 27 06:48:00 user nova-compute[73258]:     </interface>
Aug 27 06:48:00 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:48:00 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/console.log" append="off"/>
Aug 27 06:48:00 user nova-compute[73258]:     </serial>
Aug 27 06:48:00 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:48:00 user nova-compute[73258]:     <video>
Aug 27 06:48:00 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:48:00 user nova-compute[73258]:     </video>
Aug 27 06:48:00 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:48:00 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:48:00 user nova-compute[73258]:     </rng>
Aug 27 06:48:00 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:48:00 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:48:00 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:48:00 user nova-compute[73258]:     </memballoon>
Aug 27 06:48:00 user nova-compute[73258]:   </devices>
Aug 27 06:48:00 user nova-compute[73258]: </domain>
Aug 27 06:48:00 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1707767622',display_name='tempest-ServerActionsTestOtherB-server-1707767622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1707767622',id=28,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCup9tVy/ES6sbgueL/45Bba8K9LkjKsB0AzSdwXqHLd/SJJd00ZmJLNSvj/I/yfKqYtF7c1wkGM0pTAca7U7ASXDTxzPj0yMtlZAbKBP15oOn8TvN1fkhhoEIFexZqUw==',key_name='tempest-keypair-903561007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf1d43b7929c4f60a9948f0d9ed35fce',ramdisk_id='',reservation_id='r-rpya4ij3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-895910456',owner_user_name='tempest-ServerActionsTestOtherB-895910456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:47:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ec7b0ff818840ab9d77576254aaf89e',uuid=bc3cebb3-0e29-4899-94aa-d13a2a9ca86a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Converting VIF {"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG os_vif [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8024bd0-32, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8024bd0-32, col_values=(('external_ids', {'iface-id': 'c8024bd0-329f-4c9e-8974-4881fc97ada9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:e9:55', 'vm-uuid': 'bc3cebb3-0e29-4899-94aa-d13a2a9ca86a'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:00 user nova-compute[73258]: INFO os_vif [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32')
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:48:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] No VIF found with MAC fa:16:3e:6d:e9:55, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:48:01 user nova-compute[73258]: DEBUG nova.network.neutron [req-01fd5768-1511-4397-9736-2c70b0da49d0 req-6402856d-b803-4b90-9fba-1e251fd69ca5 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Updated VIF entry in instance network info cache for port c8024bd0-329f-4c9e-8974-4881fc97ada9. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:48:01 user nova-compute[73258]: DEBUG nova.network.neutron [req-01fd5768-1511-4397-9736-2c70b0da49d0 req-6402856d-b803-4b90-9fba-1e251fd69ca5 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Updating instance_info_cache with network_info: [{"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:48:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-01fd5768-1511-4397-9736-2c70b0da49d0 req-6402856d-b803-4b90-9fba-1e251fd69ca5 service nova] Releasing lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:48:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:02 user nova-compute[73258]: DEBUG nova.compute.manager [req-5b1ffcbf-2845-4ee7-a288-f030b45c6a6d req-c15b9895-04d2-4625-8776-d99062121351 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received event network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5b1ffcbf-2845-4ee7-a288-f030b45c6a6d req-c15b9895-04d2-4625-8776-d99062121351 service nova] Acquiring lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5b1ffcbf-2845-4ee7-a288-f030b45c6a6d req-c15b9895-04d2-4625-8776-d99062121351 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5b1ffcbf-2845-4ee7-a288-f030b45c6a6d req-c15b9895-04d2-4625-8776-d99062121351 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:02 user nova-compute[73258]: DEBUG nova.compute.manager [req-5b1ffcbf-2845-4ee7-a288-f030b45c6a6d req-c15b9895-04d2-4625-8776-d99062121351 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] No waiting events found dispatching network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:48:02 user nova-compute[73258]: WARNING nova.compute.manager [req-5b1ffcbf-2845-4ee7-a288-f030b45c6a6d req-c15b9895-04d2-4625-8776-d99062121351 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received unexpected event network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 for instance with vm_state building and task_state spawning.
Aug 27 06:48:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:03 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118868.1341863, 50505a95-da00-4238-966d-c0a1e188b25c => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:48:03 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] VM Stopped (Lifecycle Event)
Aug 27 06:48:03 user nova-compute[73258]: DEBUG nova.compute.manager [None req-54de6638-9a6c-440a-8d74-b6d77f242183 None None] [instance: 50505a95-da00-4238-966d-c0a1e188b25c] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:48:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:04 user nova-compute[73258]: DEBUG nova.compute.manager [req-7541a64a-6aa4-483c-8c8d-4ce3113952db req-a4544ce7-3ee6-421c-875d-e6ccba2b52c7 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received event network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7541a64a-6aa4-483c-8c8d-4ce3113952db req-a4544ce7-3ee6-421c-875d-e6ccba2b52c7 service nova] Acquiring lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7541a64a-6aa4-483c-8c8d-4ce3113952db req-a4544ce7-3ee6-421c-875d-e6ccba2b52c7 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7541a64a-6aa4-483c-8c8d-4ce3113952db req-a4544ce7-3ee6-421c-875d-e6ccba2b52c7 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:04 user nova-compute[73258]: DEBUG nova.compute.manager [req-7541a64a-6aa4-483c-8c8d-4ce3113952db req-a4544ce7-3ee6-421c-875d-e6ccba2b52c7 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] No waiting events found dispatching network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:48:04 user nova-compute[73258]: WARNING nova.compute.manager [req-7541a64a-6aa4-483c-8c8d-4ce3113952db req-a4544ce7-3ee6-421c-875d-e6ccba2b52c7 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received unexpected event network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 for instance with vm_state building and task_state spawning.
Aug 27 06:48:04 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118884.802752, bc3cebb3-0e29-4899-94aa-d13a2a9ca86a => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:48:04 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] VM Resumed (Lifecycle Event)
Aug 27 06:48:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:48:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:48:04 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Instance spawned successfully.
Aug 27 06:48:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:48:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:48:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:48:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:48:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:48:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:48:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:48:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:48:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:48:04 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:48:04 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118884.8078933, bc3cebb3-0e29-4899-94aa-d13a2a9ca86a => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:48:04 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] VM Started (Lifecycle Event)
Aug 27 06:48:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:48:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:48:04 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:48:04 user nova-compute[73258]: INFO nova.compute.manager [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Took 6.27 seconds to spawn the instance on the hypervisor.
Aug 27 06:48:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:48:05 user nova-compute[73258]: INFO nova.compute.manager [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Took 7.01 seconds to build instance.
Aug 27 06:48:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5ecb57d0-e124-4e63-a228-8c3c38fa3792 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.103s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:48:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 06:48:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:48:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:48:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:21 user nova-compute[73258]: INFO nova.compute.manager [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Unshelving
Aug 27 06:48:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:21 user nova-compute[73258]: DEBUG nova.objects.instance [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'pci_requests' on Instance uuid e6e96ad8-e34e-4970-b3a6-c06df0c6d994 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:48:21 user nova-compute[73258]: DEBUG nova.objects.instance [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'numa_topology' on Instance uuid e6e96ad8-e34e-4970-b3a6-c06df0c6d994 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:48:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:48:21 user nova-compute[73258]: INFO nova.compute.claims [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Claim successful on node user
Aug 27 06:48:21 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:48:21 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:48:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:21 user nova-compute[73258]: INFO nova.network.neutron [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Updating port fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 27 06:48:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:48:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquired lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:48:22 user nova-compute[73258]: DEBUG nova.network.neutron [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:48:22 user nova-compute[73258]: DEBUG nova.compute.manager [req-10737858-9407-4ea0-847e-a8dae90fd8ed req-ebe2111b-7d73-4443-8cf9-f76cc55837bd service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received event network-changed-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:22 user nova-compute[73258]: DEBUG nova.compute.manager [req-10737858-9407-4ea0-847e-a8dae90fd8ed req-ebe2111b-7d73-4443-8cf9-f76cc55837bd service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Refreshing instance network info cache due to event network-changed-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:48:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-10737858-9407-4ea0-847e-a8dae90fd8ed req-ebe2111b-7d73-4443-8cf9-f76cc55837bd service nova] Acquiring lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:48:23 user nova-compute[73258]: DEBUG nova.network.neutron [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Updating instance_info_cache with network_info: [{"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:48:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Releasing lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:48:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:48:23 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Creating image(s)
Aug 27 06:48:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "/opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "/opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:23 user nova-compute[73258]: DEBUG nova.objects.instance [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'trusted_certs' on Instance uuid e6e96ad8-e34e-4970-b3a6-c06df0c6d994 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:48:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-10737858-9407-4ea0-847e-a8dae90fd8ed req-ebe2111b-7d73-4443-8cf9-f76cc55837bd service nova] Acquired lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:48:23 user nova-compute[73258]: DEBUG nova.network.neutron [req-10737858-9407-4ea0-847e-a8dae90fd8ed req-ebe2111b-7d73-4443-8cf9-f76cc55837bd service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Refreshing network info cache for port fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:48:23 user nova-compute[73258]: DEBUG nova.objects.base [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Object Instance<e6e96ad8-e34e-4970-b3a6-c06df0c6d994> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:48:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934.part --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934.part --force-share --output=json" returned: 0 in 0.190s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:24 user nova-compute[73258]: DEBUG nova.virt.images [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] 7a60ed71-cdc5-4fd9-9ff8-4ccd463b649b was qcow2, converting to raw {{(pid=73258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 06:48:24 user nova-compute[73258]: DEBUG nova.privsep.utils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 06:48:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934.part /opt/stack/data/nova/instances/_base/e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934.converted {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:24 user nova-compute[73258]: DEBUG nova.network.neutron [req-10737858-9407-4ea0-847e-a8dae90fd8ed req-ebe2111b-7d73-4443-8cf9-f76cc55837bd service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Updated VIF entry in instance network info cache for port fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:48:24 user nova-compute[73258]: DEBUG nova.network.neutron [req-10737858-9407-4ea0-847e-a8dae90fd8ed req-ebe2111b-7d73-4443-8cf9-f76cc55837bd service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Updating instance_info_cache with network_info: [{"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:48:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-10737858-9407-4ea0-847e-a8dae90fd8ed req-ebe2111b-7d73-4443-8cf9-f76cc55837bd service nova] Releasing lock "refresh_cache-e6e96ad8-e34e-4970-b3a6-c06df0c6d994" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:48:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934.part /opt/stack/data/nova/instances/_base/e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934.converted" returned: 0 in 0.481s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934.converted --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.083s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934 --force-share --output=json" returned: 0 in 0.172s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934 --force-share --output=json" returned: 0 in 0.169s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934,backing_fmt=raw /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934,backing_fmt=raw /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk 1073741824" returned: 0 in 0.129s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934 --force-share --output=json" returned: 0 in 0.170s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:26 user nova-compute[73258]: DEBUG nova.objects.instance [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'migration_context' on Instance uuid e6e96ad8-e34e-4970-b3a6-c06df0c6d994 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:48:26 user nova-compute[73258]: DEBUG nova.objects.base [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Object Instance<e6e96ad8-e34e-4970-b3a6-c06df0c6d994> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:48:26 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Rebasing disk image.
Aug 27 06:48:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.176s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 -F raw /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 -F raw /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk" returned: 0 in 2.246s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Ensure instance console log exists: /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Start _get_guest_xml network_info=[{"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='00b158fcd27b3b929bfb3c5302b1e1ce',container_format='bare',created_at=2023-08-27T06:46:28Z,direct_url=<?>,disk_format='qcow2',id=7a60ed71-cdc5-4fd9-9ff8-4ccd463b649b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-133269916-shelved',owner='235a4f958e494352aaa119a4d44a52c5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T06:46:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:48:28 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:48:28 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='00b158fcd27b3b929bfb3c5302b1e1ce',container_format='bare',created_at=2023-08-27T06:46:28Z,direct_url=<?>,disk_format='qcow2',id=7a60ed71-cdc5-4fd9-9ff8-4ccd463b649b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-133269916-shelved',owner='235a4f958e494352aaa119a4d44a52c5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T06:46:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.objects.instance [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6e96ad8-e34e-4970-b3a6-c06df0c6d994 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.objects.base [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Object Instance<e6e96ad8-e34e-4970-b3a6-c06df0c6d994> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T06:44:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-133269916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-133269916',id=24,image_ref='7a60ed71-cdc5-4fd9-9ff8-4ccd463b649b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-45658026',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:44:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='235a4f958e494352aaa119a4d44a52c5',ramdisk_id='',reservation_id='r-qf0qib1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1261077306',owner_user_name='tempest-AttachVolumeShelveTestJSON-1261077306-project-member',shelved_at='2023-08-27T06:46:33.236167',shelved_host='user',shelved_image_id='7a60ed71-cdc5-4fd9-9ff8-4ccd463b649b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:48:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff1f51bb7163499c94ebbc93a051b4df',uuid=e6e96ad8-e34e-4970-b3a6-c06df0c6d994,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converting VIF {"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:ae:e2,bridge_name='br-int',has_traffic_filtering=True,id=fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4351a6-f0') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.objects.instance [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'pci_devices' on Instance uuid e6e96ad8-e34e-4970-b3a6-c06df0c6d994 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.objects.base [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Object Instance<e6e96ad8-e34e-4970-b3a6-c06df0c6d994> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:48:28 user nova-compute[73258]:   <uuid>e6e96ad8-e34e-4970-b3a6-c06df0c6d994</uuid>
Aug 27 06:48:28 user nova-compute[73258]:   <name>instance-00000018</name>
Aug 27 06:48:28 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:48:28 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:48:28 user nova-compute[73258]:   <metadata>
Aug 27 06:48:28 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:48:28 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:48:28 user nova-compute[73258]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-133269916</nova:name>
Aug 27 06:48:28 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:48:28</nova:creationTime>
Aug 27 06:48:28 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:48:28 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:48:28 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:48:28 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:48:28 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:48:28 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:48:28 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:48:28 user nova-compute[73258]:       <nova:owner>
Aug 27 06:48:28 user nova-compute[73258]:         <nova:user uuid="ff1f51bb7163499c94ebbc93a051b4df">tempest-AttachVolumeShelveTestJSON-1261077306-project-member</nova:user>
Aug 27 06:48:28 user nova-compute[73258]:         <nova:project uuid="235a4f958e494352aaa119a4d44a52c5">tempest-AttachVolumeShelveTestJSON-1261077306</nova:project>
Aug 27 06:48:28 user nova-compute[73258]:       </nova:owner>
Aug 27 06:48:28 user nova-compute[73258]:       <nova:root type="image" uuid="7a60ed71-cdc5-4fd9-9ff8-4ccd463b649b"/>
Aug 27 06:48:28 user nova-compute[73258]:       <nova:ports>
Aug 27 06:48:28 user nova-compute[73258]:         <nova:port uuid="fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7">
Aug 27 06:48:28 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 06:48:28 user nova-compute[73258]:         </nova:port>
Aug 27 06:48:28 user nova-compute[73258]:       </nova:ports>
Aug 27 06:48:28 user nova-compute[73258]:     </nova:instance>
Aug 27 06:48:28 user nova-compute[73258]:   </metadata>
Aug 27 06:48:28 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:48:28 user nova-compute[73258]:     <system>
Aug 27 06:48:28 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:48:28 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:48:28 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:48:28 user nova-compute[73258]:       <entry name="serial">e6e96ad8-e34e-4970-b3a6-c06df0c6d994</entry>
Aug 27 06:48:28 user nova-compute[73258]:       <entry name="uuid">e6e96ad8-e34e-4970-b3a6-c06df0c6d994</entry>
Aug 27 06:48:28 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:48:28 user nova-compute[73258]:     </system>
Aug 27 06:48:28 user nova-compute[73258]:   </sysinfo>
Aug 27 06:48:28 user nova-compute[73258]:   <os>
Aug 27 06:48:28 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:48:28 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:48:28 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:48:28 user nova-compute[73258]:   </os>
Aug 27 06:48:28 user nova-compute[73258]:   <features>
Aug 27 06:48:28 user nova-compute[73258]:     <acpi/>
Aug 27 06:48:28 user nova-compute[73258]:     <apic/>
Aug 27 06:48:28 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:48:28 user nova-compute[73258]:   </features>
Aug 27 06:48:28 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:48:28 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:48:28 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:48:28 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:48:28 user nova-compute[73258]:   </clock>
Aug 27 06:48:28 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:48:28 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:48:28 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:48:28 user nova-compute[73258]:   </cpu>
Aug 27 06:48:28 user nova-compute[73258]:   <devices>
Aug 27 06:48:28 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:48:28 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:48:28 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk"/>
Aug 27 06:48:28 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:48:28 user nova-compute[73258]:     </disk>
Aug 27 06:48:28 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:48:28 user nova-compute[73258]:       <mac address="fa:16:3e:34:ae:e2"/>
Aug 27 06:48:28 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:48:28 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:48:28 user nova-compute[73258]:       <target dev="tapfc4351a6-f0"/>
Aug 27 06:48:28 user nova-compute[73258]:     </interface>
Aug 27 06:48:28 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:48:28 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/console.log" append="off"/>
Aug 27 06:48:28 user nova-compute[73258]:     </serial>
Aug 27 06:48:28 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:48:28 user nova-compute[73258]:     <video>
Aug 27 06:48:28 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:48:28 user nova-compute[73258]:     </video>
Aug 27 06:48:28 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:48:28 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:48:28 user nova-compute[73258]:     </rng>
Aug 27 06:48:28 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:48:28 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:48:28 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:48:28 user nova-compute[73258]:     </memballoon>
Aug 27 06:48:28 user nova-compute[73258]:   </devices>
Aug 27 06:48:28 user nova-compute[73258]: </domain>
Aug 27 06:48:28 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T06:44:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-133269916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-133269916',id=24,image_ref='7a60ed71-cdc5-4fd9-9ff8-4ccd463b649b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-45658026',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:44:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='235a4f958e494352aaa119a4d44a52c5',ramdisk_id='',reservation_id='r-qf0qib1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1261077306',owner_user_name='tempest-AttachVolumeShelveTestJSON-1261077306-project-member',shelved_at='2023-08-27T06:46:33.236167',shelved_host='user',shelved_image_id='7a60ed71-cdc5-4fd9-9ff8-4ccd463b649b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:48:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff1f51bb7163499c94ebbc93a051b4df',uuid=e6e96ad8-e34e-4970-b3a6-c06df0c6d994,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converting VIF {"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:ae:e2,bridge_name='br-int',has_traffic_filtering=True,id=fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4351a6-f0') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG os_vif [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:ae:e2,bridge_name='br-int',has_traffic_filtering=True,id=fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4351a6-f0') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc4351a6-f0, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc4351a6-f0, col_values=(('external_ids', {'iface-id': 'fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:ae:e2', 'vm-uuid': 'e6e96ad8-e34e-4970-b3a6-c06df0c6d994'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:28 user nova-compute[73258]: INFO os_vif [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:ae:e2,bridge_name='br-int',has_traffic_filtering=True,id=fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4351a6-f0')
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:48:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] No VIF found with MAC fa:16:3e:34:ae:e2, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:48:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-3272536b-8d67-4c82-9be6-8e96046a658b req-c0be937a-f40b-4f9b-ba80-c7f124c26ce6 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received event network-vif-plugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3272536b-8d67-4c82-9be6-8e96046a658b req-c0be937a-f40b-4f9b-ba80-c7f124c26ce6 service nova] Acquiring lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3272536b-8d67-4c82-9be6-8e96046a658b req-c0be937a-f40b-4f9b-ba80-c7f124c26ce6 service nova] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3272536b-8d67-4c82-9be6-8e96046a658b req-c0be937a-f40b-4f9b-ba80-c7f124c26ce6 service nova] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-3272536b-8d67-4c82-9be6-8e96046a658b req-c0be937a-f40b-4f9b-ba80-c7f124c26ce6 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] No waiting events found dispatching network-vif-plugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:48:30 user nova-compute[73258]: WARNING nova.compute.manager [req-3272536b-8d67-4c82-9be6-8e96046a658b req-c0be937a-f40b-4f9b-ba80-c7f124c26ce6 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received unexpected event network-vif-plugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 06:48:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquiring lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquiring lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:32 user nova-compute[73258]: INFO nova.compute.manager [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Terminating instance
Aug 27 06:48:32 user nova-compute[73258]: DEBUG nova.compute.manager [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-27bae7d3-96c8-40f2-b7cc-53d5af988596 req-9b14b373-736f-4759-b462-301e12272ac0 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received event network-vif-plugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-27bae7d3-96c8-40f2-b7cc-53d5af988596 req-9b14b373-736f-4759-b462-301e12272ac0 service nova] Acquiring lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-27bae7d3-96c8-40f2-b7cc-53d5af988596 req-9b14b373-736f-4759-b462-301e12272ac0 service nova] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-27bae7d3-96c8-40f2-b7cc-53d5af988596 req-9b14b373-736f-4759-b462-301e12272ac0 service nova] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-27bae7d3-96c8-40f2-b7cc-53d5af988596 req-9b14b373-736f-4759-b462-301e12272ac0 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] No waiting events found dispatching network-vif-plugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:48:32 user nova-compute[73258]: WARNING nova.compute.manager [req-27bae7d3-96c8-40f2-b7cc-53d5af988596 req-9b14b373-736f-4759-b462-301e12272ac0 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received unexpected event network-vif-plugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 06:48:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-3be022ad-d33e-4ec3-8d9f-db0fe5e08750 req-662a1886-8c4e-4174-b4b0-ad1ed7ec79f2 service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Received event network-vif-unplugged-fa0b4d64-3c43-470a-b6ff-b409580fffc3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3be022ad-d33e-4ec3-8d9f-db0fe5e08750 req-662a1886-8c4e-4174-b4b0-ad1ed7ec79f2 service nova] Acquiring lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3be022ad-d33e-4ec3-8d9f-db0fe5e08750 req-662a1886-8c4e-4174-b4b0-ad1ed7ec79f2 service nova] Lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3be022ad-d33e-4ec3-8d9f-db0fe5e08750 req-662a1886-8c4e-4174-b4b0-ad1ed7ec79f2 service nova] Lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-3be022ad-d33e-4ec3-8d9f-db0fe5e08750 req-662a1886-8c4e-4174-b4b0-ad1ed7ec79f2 service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] No waiting events found dispatching network-vif-unplugged-fa0b4d64-3c43-470a-b6ff-b409580fffc3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-3be022ad-d33e-4ec3-8d9f-db0fe5e08750 req-662a1886-8c4e-4174-b4b0-ad1ed7ec79f2 service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Received event network-vif-unplugged-fa0b4d64-3c43-470a-b6ff-b409580fffc3 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118912.734479, e6e96ad8-e34e-4970-b3a6-c06df0c6d994 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:48:32 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] VM Resumed (Lifecycle Event)
Aug 27 06:48:32 user nova-compute[73258]: DEBUG nova.compute.manager [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:48:32 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Instance spawned successfully.
Aug 27 06:48:32 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:48:32 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:48:32 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118912.7346725, e6e96ad8-e34e-4970-b3a6-c06df0c6d994 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:48:32 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] VM Started (Lifecycle Event)
Aug 27 06:48:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:32 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Instance destroyed successfully.
Aug 27 06:48:32 user nova-compute[73258]: DEBUG nova.objects.instance [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lazy-loading 'resources' on Instance uuid ffc4da0b-3aad-4e7b-a093-97bd2eb1103a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:48:32 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:48:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:46:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2028247375',display_name='tempest-VolumesActionsTest-instance-2028247375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2028247375',id=27,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:46:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aeb0b2a4be9946e680a0e65d58f9c4f3',ramdisk_id='',reservation_id='r-t5l6re5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1397322250',owner_user_name='tempest-VolumesActionsTest-1397322250-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:46:48Z,user_data=None,user_id='41ce9c10e4f14e478b5833700a5546cc',uuid=ffc4da0b-3aad-4e7b-a093-97bd2eb1103a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "address": "fa:16:3e:5f:8d:a9", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0b4d64-3c", "ovs_interfaceid": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Converting VIF {"id": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "address": "fa:16:3e:5f:8d:a9", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa0b4d64-3c", "ovs_interfaceid": "fa0b4d64-3c43-470a-b6ff-b409580fffc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:8d:a9,bridge_name='br-int',has_traffic_filtering=True,id=fa0b4d64-3c43-470a-b6ff-b409580fffc3,network=Network(c5f850d2-9a33-4e76-a6fd-54865efe7aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa0b4d64-3c') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG os_vif [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:8d:a9,bridge_name='br-int',has_traffic_filtering=True,id=fa0b4d64-3c43-470a-b6ff-b409580fffc3,network=Network(c5f850d2-9a33-4e76-a6fd-54865efe7aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa0b4d64-3c') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa0b4d64-3c, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:48:32 user nova-compute[73258]: INFO os_vif [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:8d:a9,bridge_name='br-int',has_traffic_filtering=True,id=fa0b4d64-3c43-470a-b6ff-b409580fffc3,network=Network(c5f850d2-9a33-4e76-a6fd-54865efe7aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa0b4d64-3c')
Aug 27 06:48:32 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Deleting instance files /opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a_del
Aug 27 06:48:32 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Deletion of /opt/stack/data/nova/instances/ffc4da0b-3aad-4e7b-a093-97bd2eb1103a_del complete
Aug 27 06:48:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:33 user nova-compute[73258]: INFO nova.compute.manager [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 27 06:48:33 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:48:33 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:48:33 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:48:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:48:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-31206fa4-936d-4acd-8924-10ede9eb2ab5 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.243s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:33 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:48:33 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Took 0.97 seconds to deallocate network for instance.
Aug 27 06:48:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:34 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:48:34 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:48:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:34 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Deleted allocations for instance ffc4da0b-3aad-4e7b-a093-97bd2eb1103a
Aug 27 06:48:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0f46a867-97cb-4e62-a8cf-6b4d4aa62a4c tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.484s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-c8f90191-506d-4469-92bb-b7965ac5aae7 req-bb597335-1ea6-43be-98de-7ba7ec3f40bc service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Received event network-vif-plugged-fa0b4d64-3c43-470a-b6ff-b409580fffc3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8f90191-506d-4469-92bb-b7965ac5aae7 req-bb597335-1ea6-43be-98de-7ba7ec3f40bc service nova] Acquiring lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8f90191-506d-4469-92bb-b7965ac5aae7 req-bb597335-1ea6-43be-98de-7ba7ec3f40bc service nova] Lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8f90191-506d-4469-92bb-b7965ac5aae7 req-bb597335-1ea6-43be-98de-7ba7ec3f40bc service nova] Lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-c8f90191-506d-4469-92bb-b7965ac5aae7 req-bb597335-1ea6-43be-98de-7ba7ec3f40bc service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] No waiting events found dispatching network-vif-plugged-fa0b4d64-3c43-470a-b6ff-b409580fffc3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:48:34 user nova-compute[73258]: WARNING nova.compute.manager [req-c8f90191-506d-4469-92bb-b7965ac5aae7 req-bb597335-1ea6-43be-98de-7ba7ec3f40bc service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Received unexpected event network-vif-plugged-fa0b4d64-3c43-470a-b6ff-b409580fffc3 for instance with vm_state deleted and task_state None.
Aug 27 06:48:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-c8f90191-506d-4469-92bb-b7965ac5aae7 req-bb597335-1ea6-43be-98de-7ba7ec3f40bc service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Received event network-vif-plugged-fa0b4d64-3c43-470a-b6ff-b409580fffc3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8f90191-506d-4469-92bb-b7965ac5aae7 req-bb597335-1ea6-43be-98de-7ba7ec3f40bc service nova] Acquiring lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8f90191-506d-4469-92bb-b7965ac5aae7 req-bb597335-1ea6-43be-98de-7ba7ec3f40bc service nova] Lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8f90191-506d-4469-92bb-b7965ac5aae7 req-bb597335-1ea6-43be-98de-7ba7ec3f40bc service nova] Lock "ffc4da0b-3aad-4e7b-a093-97bd2eb1103a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-c8f90191-506d-4469-92bb-b7965ac5aae7 req-bb597335-1ea6-43be-98de-7ba7ec3f40bc service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] No waiting events found dispatching network-vif-plugged-fa0b4d64-3c43-470a-b6ff-b409580fffc3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:48:34 user nova-compute[73258]: WARNING nova.compute.manager [req-c8f90191-506d-4469-92bb-b7965ac5aae7 req-bb597335-1ea6-43be-98de-7ba7ec3f40bc service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Received unexpected event network-vif-plugged-fa0b4d64-3c43-470a-b6ff-b409580fffc3 for instance with vm_state deleted and task_state None.
Aug 27 06:48:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-c8f90191-506d-4469-92bb-b7965ac5aae7 req-bb597335-1ea6-43be-98de-7ba7ec3f40bc service nova] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Received event network-vif-deleted-fa0b4d64-3c43-470a-b6ff-b409580fffc3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "ede6423b-ad91-4002-91d1-5849c6a4e26b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:40 user nova-compute[73258]: DEBUG nova.compute.manager [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:48:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:40 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:48:40 user nova-compute[73258]: INFO nova.compute.claims [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Claim successful on node user
Aug 27 06:48:40 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:48:40 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:48:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:40 user nova-compute[73258]: DEBUG nova.compute.manager [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:48:40 user nova-compute[73258]: DEBUG nova.compute.manager [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:48:40 user nova-compute[73258]: DEBUG nova.network.neutron [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:48:40 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:48:40 user nova-compute[73258]: DEBUG nova.compute.manager [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:48:40 user nova-compute[73258]: DEBUG nova.policy [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67f8a06ab5634f60b6ed2d1d9b2c342e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57faf7cb6c704c05aba06857a6cdd29f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:48:40 user nova-compute[73258]: INFO nova.virt.block_device [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Booting with volume c199006a-92aa-4e38-8f04-059c7642b550 at /dev/vda
Aug 27 06:48:40 user nova-compute[73258]: DEBUG os_brick.utils [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:48:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:40 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[488413cf-7e21-4992-8fea-2f3520de4730]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:48:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:41 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f914d5-e26b-41a2-9cbf-60fb510478a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:48:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:41 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77ff6be-938a-48a2-a48f-2d8039a3e4a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:48:41 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe30c2ff-50c1-4652-83ae-fd7f3782713d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:48:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:48:41 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:48:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:48:41 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:48:41 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b43cc8c-fd8b-4c57-963c-0d97a8fbd7c8]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:48:41 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:48:41 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:48:41 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:48:41 user nova-compute[73258]: DEBUG os_brick.utils [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:48:41 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Updating existing volume attachment record: 8b3b4e9a-ad45-4908-99e1-6bc2e0aeaa88 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:48:41 user nova-compute[73258]: DEBUG nova.network.neutron [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Successfully created port: 0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:48:42 user nova-compute[73258]: DEBUG nova.network.neutron [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Successfully updated port: 0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:48:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "refresh_cache-ede6423b-ad91-4002-91d1-5849c6a4e26b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:48:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquired lock "refresh_cache-ede6423b-ad91-4002-91d1-5849c6a4e26b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:48:42 user nova-compute[73258]: DEBUG nova.network.neutron [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:48:42 user nova-compute[73258]: DEBUG nova.compute.manager [req-be2a61cb-eb89-4402-9068-f801af71585a req-2e465cfd-96d1-49e0-ac4f-d339a8ae9b71 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Received event network-changed-0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:42 user nova-compute[73258]: DEBUG nova.compute.manager [req-be2a61cb-eb89-4402-9068-f801af71585a req-2e465cfd-96d1-49e0-ac4f-d339a8ae9b71 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Refreshing instance network info cache due to event network-changed-0d7639f1-aadd-4f15-9292-8cef2591ce8d. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:48:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-be2a61cb-eb89-4402-9068-f801af71585a req-2e465cfd-96d1-49e0-ac4f-d339a8ae9b71 service nova] Acquiring lock "refresh_cache-ede6423b-ad91-4002-91d1-5849c6a4e26b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:48:42 user nova-compute[73258]: DEBUG nova.network.neutron [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:48:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:48:43 user nova-compute[73258]: DEBUG nova.network.neutron [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Updating instance_info_cache with network_info: [{"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:48:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Releasing lock "refresh_cache-ede6423b-ad91-4002-91d1-5849c6a4e26b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:48:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Instance network_info: |[{"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:48:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-be2a61cb-eb89-4402-9068-f801af71585a req-2e465cfd-96d1-49e0-ac4f-d339a8ae9b71 service nova] Acquired lock "refresh_cache-ede6423b-ad91-4002-91d1-5849c6a4e26b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:48:43 user nova-compute[73258]: DEBUG nova.network.neutron [req-be2a61cb-eb89-4402-9068-f801af71585a req-2e465cfd-96d1-49e0-ac4f-d339a8ae9b71 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Refreshing network info cache for port 0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:48:43 user nova-compute[73258]: DEBUG nova.network.neutron [req-be2a61cb-eb89-4402-9068-f801af71585a req-2e465cfd-96d1-49e0-ac4f-d339a8ae9b71 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Updated VIF entry in instance network info cache for port 0d7639f1-aadd-4f15-9292-8cef2591ce8d. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:48:43 user nova-compute[73258]: DEBUG nova.network.neutron [req-be2a61cb-eb89-4402-9068-f801af71585a req-2e465cfd-96d1-49e0-ac4f-d339a8ae9b71 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Updating instance_info_cache with network_info: [{"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:48:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-be2a61cb-eb89-4402-9068-f801af71585a req-2e465cfd-96d1-49e0-ac4f-d339a8ae9b71 service nova] Releasing lock "refresh_cache-ede6423b-ad91-4002-91d1-5849c6a4e26b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:48:45 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:48:45 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:48:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:48:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:48:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:48:45 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:48:45 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Updating instance_info_cache with network_info: [{"id": "217b1702-a403-4f3a-bdae-7793382e5f38", "address": "fa:16:3e:5d:4e:76", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217b1702-a4", "ovs_interfaceid": "217b1702-a403-4f3a-bdae-7793382e5f38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:48:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:48:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:48:45 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:48:45 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:48:45 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:48:45 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:48:45 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:48:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:48:46 user nova-compute[73258]: INFO nova.compute.manager [None req-cb688e47-25c7-4ebc-bf41-d400f37e0c89 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Unrescuing
Aug 27 06:48:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cb688e47-25c7-4ebc-bf41-d400f37e0c89 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "refresh_cache-7ee743f1-9611-4165-838e-54fccb332f1a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:48:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cb688e47-25c7-4ebc-bf41-d400f37e0c89 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquired lock "refresh_cache-7ee743f1-9611-4165-838e-54fccb332f1a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:48:46 user nova-compute[73258]: DEBUG nova.network.neutron [None req-cb688e47-25c7-4ebc-bf41-d400f37e0c89 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:48:46 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:48:47 user nova-compute[73258]: DEBUG nova.network.neutron [None req-cb688e47-25c7-4ebc-bf41-d400f37e0c89 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Updating instance_info_cache with network_info: [{"id": "27d47d21-922e-43da-8dee-8d62f45edd64", "address": "fa:16:3e:5c:73:20", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d47d21-92", "ovs_interfaceid": "27d47d21-922e-43da-8dee-8d62f45edd64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:48:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cb688e47-25c7-4ebc-bf41-d400f37e0c89 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Releasing lock "refresh_cache-7ee743f1-9611-4165-838e-54fccb332f1a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:48:47 user nova-compute[73258]: DEBUG nova.objects.instance [None req-cb688e47-25c7-4ebc-bf41-d400f37e0c89 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'flavor' on Instance uuid 7ee743f1-9611-4165-838e-54fccb332f1a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:48:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:47 user nova-compute[73258]: DEBUG nova.compute.manager [req-948bc5f5-b678-46cb-b89d-63e3532f7362 req-126f3b65-5cb4-4871-a8ff-e31a82c782f8 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received event network-vif-unplugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-948bc5f5-b678-46cb-b89d-63e3532f7362 req-126f3b65-5cb4-4871-a8ff-e31a82c782f8 service nova] Acquiring lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-948bc5f5-b678-46cb-b89d-63e3532f7362 req-126f3b65-5cb4-4871-a8ff-e31a82c782f8 service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-948bc5f5-b678-46cb-b89d-63e3532f7362 req-126f3b65-5cb4-4871-a8ff-e31a82c782f8 service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:47 user nova-compute[73258]: DEBUG nova.compute.manager [req-948bc5f5-b678-46cb-b89d-63e3532f7362 req-126f3b65-5cb4-4871-a8ff-e31a82c782f8 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] No waiting events found dispatching network-vif-unplugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:48:47 user nova-compute[73258]: WARNING nova.compute.manager [req-948bc5f5-b678-46cb-b89d-63e3532f7362 req-126f3b65-5cb4-4871-a8ff-e31a82c782f8 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received unexpected event network-vif-unplugged-27d47d21-922e-43da-8dee-8d62f45edd64 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:48:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:47 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118912.892828, ffc4da0b-3aad-4e7b-a093-97bd2eb1103a => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:48:47 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] VM Stopped (Lifecycle Event)
Aug 27 06:48:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-b2b1f681-882a-4f06-86a5-5d300e946f85 None None] [instance: ffc4da0b-3aad-4e7b-a093-97bd2eb1103a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:48:48 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Instance destroyed successfully.
Aug 27 06:48:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-f18aac32-11da-415e-b8d3-6c10aa06db48 req-08e9a92e-35ef-4b38-9003-6dfbbb1967ba service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received event network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f18aac32-11da-415e-b8d3-6c10aa06db48 req-08e9a92e-35ef-4b38-9003-6dfbbb1967ba service nova] Acquiring lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f18aac32-11da-415e-b8d3-6c10aa06db48 req-08e9a92e-35ef-4b38-9003-6dfbbb1967ba service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f18aac32-11da-415e-b8d3-6c10aa06db48 req-08e9a92e-35ef-4b38-9003-6dfbbb1967ba service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-f18aac32-11da-415e-b8d3-6c10aa06db48 req-08e9a92e-35ef-4b38-9003-6dfbbb1967ba service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] No waiting events found dispatching network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:48:49 user nova-compute[73258]: WARNING nova.compute.manager [req-f18aac32-11da-415e-b8d3-6c10aa06db48 req-08e9a92e-35ef-4b38-9003-6dfbbb1967ba service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received unexpected event network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:48:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Removed pending event for 7ee743f1-9611-4165-838e-54fccb332f1a due to event {{(pid=73258) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118931.5702527, 7ee743f1-9611-4165-838e-54fccb332f1a => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:48:51 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] VM Resumed (Lifecycle Event)
Aug 27 06:48:51 user nova-compute[73258]: DEBUG nova.compute.manager [None req-cb688e47-25c7-4ebc-bf41-d400f37e0c89 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:48:51 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 06:48:51 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118931.5768397, 7ee743f1-9611-4165-838e-54fccb332f1a => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:48:51 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] VM Started (Lifecycle Event)
Aug 27 06:48:51 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG nova.compute.manager [req-c541759f-e145-4d2d-a691-432b977affad req-2705a0df-4a05-4a97-9ba1-e45da800c365 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received event network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c541759f-e145-4d2d-a691-432b977affad req-2705a0df-4a05-4a97-9ba1-e45da800c365 service nova] Acquiring lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c541759f-e145-4d2d-a691-432b977affad req-2705a0df-4a05-4a97-9ba1-e45da800c365 service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c541759f-e145-4d2d-a691-432b977affad req-2705a0df-4a05-4a97-9ba1-e45da800c365 service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG nova.compute.manager [req-c541759f-e145-4d2d-a691-432b977affad req-2705a0df-4a05-4a97-9ba1-e45da800c365 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] No waiting events found dispatching network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:48:51 user nova-compute[73258]: WARNING nova.compute.manager [req-c541759f-e145-4d2d-a691-432b977affad req-2705a0df-4a05-4a97-9ba1-e45da800c365 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received unexpected event network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 for instance with vm_state active and task_state None.
Aug 27 06:48:51 user nova-compute[73258]: DEBUG nova.compute.manager [req-c541759f-e145-4d2d-a691-432b977affad req-2705a0df-4a05-4a97-9ba1-e45da800c365 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received event network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c541759f-e145-4d2d-a691-432b977affad req-2705a0df-4a05-4a97-9ba1-e45da800c365 service nova] Acquiring lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c541759f-e145-4d2d-a691-432b977affad req-2705a0df-4a05-4a97-9ba1-e45da800c365 service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c541759f-e145-4d2d-a691-432b977affad req-2705a0df-4a05-4a97-9ba1-e45da800c365 service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG nova.compute.manager [req-c541759f-e145-4d2d-a691-432b977affad req-2705a0df-4a05-4a97-9ba1-e45da800c365 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] No waiting events found dispatching network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:48:51 user nova-compute[73258]: WARNING nova.compute.manager [req-c541759f-e145-4d2d-a691-432b977affad req-2705a0df-4a05-4a97-9ba1-e45da800c365 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received unexpected event network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 for instance with vm_state active and task_state None.
Aug 27 06:48:51 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "b22b7599-5a37-4370-b440-f04e3dc88f98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:51 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:48:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:52 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:48:52 user nova-compute[73258]: INFO nova.compute.claims [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Claim successful on node user
Aug 27 06:48:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk --force-share --output=json" returned: 0 in 0.321s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:52 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:48:52 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:48:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.693s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:48:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:48:52 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:48:52 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:48:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:48:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:48:53 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Creating image(s)
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "/opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "/opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "/opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG nova.policy [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '685859ec81944e3398853037c24673a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6efa67b959a473da5a06f9e0aa8795f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.223s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.216s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk 1073741824" returned: 0 in 0.057s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.202s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Successfully created port: 8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Cannot resize image /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Ensure instance console log exists: /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:54 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Successfully updated port: 8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:48:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:48:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquired lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:48:54 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:48:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:54 user nova-compute[73258]: DEBUG nova.compute.manager [req-862b2c07-f37d-41ef-b287-957b8abd60c0 req-018dcfab-e585-4d87-bbfb-e1abec67311b service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received event network-changed-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:54 user nova-compute[73258]: DEBUG nova.compute.manager [req-862b2c07-f37d-41ef-b287-957b8abd60c0 req-018dcfab-e585-4d87-bbfb-e1abec67311b service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Refreshing instance network info cache due to event network-changed-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:48:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-862b2c07-f37d-41ef-b287-957b8abd60c0 req-018dcfab-e585-4d87-bbfb-e1abec67311b service nova] Acquiring lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:48:54 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Updating instance_info_cache with network_info: [{"id": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "address": "fa:16:3e:2a:36:5c", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e94cae8-ea", "ovs_interfaceid": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Releasing lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Instance network_info: |[{"id": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "address": "fa:16:3e:2a:36:5c", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e94cae8-ea", "ovs_interfaceid": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-862b2c07-f37d-41ef-b287-957b8abd60c0 req-018dcfab-e585-4d87-bbfb-e1abec67311b service nova] Acquired lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.network.neutron [req-862b2c07-f37d-41ef-b287-957b8abd60c0 req-018dcfab-e585-4d87-bbfb-e1abec67311b service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Refreshing network info cache for port 8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Start _get_guest_xml network_info=[{"id": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "address": "fa:16:3e:2a:36:5c", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e94cae8-ea", "ovs_interfaceid": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:55 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:48:55 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:48:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1499776913',display_name='tempest-ServerRescueNegativeTestJSON-server-1499776913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1499776913',id=30,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErbhwcq7aMHPks7Q30Yl1JgTtz86nuYtLPWY4cd1Va/1/xuONf64c83ZqaEqnO0vQM+Iy3jGDNqDWdT2gBJMeVX8g/Qp/6AdHpxWA0fEmnlzHeTG2hi39F3l9DovV+GoA==',key_name='tempest-keypair-1178169413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6efa67b959a473da5a06f9e0aa8795f',ramdisk_id='',reservation_id='r-onwvh0ae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1025141277',owner_user_name='tempest-ServerRescueNegativeTestJSON-1025141277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='685859ec81944e3398853037c24673a4',uuid=b22b7599-5a37-4370-b440-f04e3dc88f98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "address": "fa:16:3e:2a:36:5c", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e94cae8-ea", "ovs_interfaceid": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converting VIF {"id": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "address": "fa:16:3e:2a:36:5c", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e94cae8-ea", "ovs_interfaceid": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:36:5c,bridge_name='br-int',has_traffic_filtering=True,id=8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e94cae8-ea') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.objects.instance [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'pci_devices' on Instance uuid b22b7599-5a37-4370-b440-f04e3dc88f98 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:48:55 user nova-compute[73258]:   <uuid>b22b7599-5a37-4370-b440-f04e3dc88f98</uuid>
Aug 27 06:48:55 user nova-compute[73258]:   <name>instance-0000001e</name>
Aug 27 06:48:55 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:48:55 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:48:55 user nova-compute[73258]:   <metadata>
Aug 27 06:48:55 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:48:55 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:48:55 user nova-compute[73258]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1499776913</nova:name>
Aug 27 06:48:55 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:48:55</nova:creationTime>
Aug 27 06:48:55 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:48:55 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:48:55 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:48:55 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:48:55 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:48:55 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:48:55 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:48:55 user nova-compute[73258]:       <nova:owner>
Aug 27 06:48:55 user nova-compute[73258]:         <nova:user uuid="685859ec81944e3398853037c24673a4">tempest-ServerRescueNegativeTestJSON-1025141277-project-member</nova:user>
Aug 27 06:48:55 user nova-compute[73258]:         <nova:project uuid="f6efa67b959a473da5a06f9e0aa8795f">tempest-ServerRescueNegativeTestJSON-1025141277</nova:project>
Aug 27 06:48:55 user nova-compute[73258]:       </nova:owner>
Aug 27 06:48:55 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:48:55 user nova-compute[73258]:       <nova:ports>
Aug 27 06:48:55 user nova-compute[73258]:         <nova:port uuid="8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9">
Aug 27 06:48:55 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 06:48:55 user nova-compute[73258]:         </nova:port>
Aug 27 06:48:55 user nova-compute[73258]:       </nova:ports>
Aug 27 06:48:55 user nova-compute[73258]:     </nova:instance>
Aug 27 06:48:55 user nova-compute[73258]:   </metadata>
Aug 27 06:48:55 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:48:55 user nova-compute[73258]:     <system>
Aug 27 06:48:55 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:48:55 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:48:55 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:48:55 user nova-compute[73258]:       <entry name="serial">b22b7599-5a37-4370-b440-f04e3dc88f98</entry>
Aug 27 06:48:55 user nova-compute[73258]:       <entry name="uuid">b22b7599-5a37-4370-b440-f04e3dc88f98</entry>
Aug 27 06:48:55 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:48:55 user nova-compute[73258]:     </system>
Aug 27 06:48:55 user nova-compute[73258]:   </sysinfo>
Aug 27 06:48:55 user nova-compute[73258]:   <os>
Aug 27 06:48:55 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:48:55 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:48:55 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:48:55 user nova-compute[73258]:   </os>
Aug 27 06:48:55 user nova-compute[73258]:   <features>
Aug 27 06:48:55 user nova-compute[73258]:     <acpi/>
Aug 27 06:48:55 user nova-compute[73258]:     <apic/>
Aug 27 06:48:55 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:48:55 user nova-compute[73258]:   </features>
Aug 27 06:48:55 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:48:55 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:48:55 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:48:55 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:48:55 user nova-compute[73258]:   </clock>
Aug 27 06:48:55 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:48:55 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:48:55 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:48:55 user nova-compute[73258]:   </cpu>
Aug 27 06:48:55 user nova-compute[73258]:   <devices>
Aug 27 06:48:55 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:48:55 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:48:55 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk"/>
Aug 27 06:48:55 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:48:55 user nova-compute[73258]:     </disk>
Aug 27 06:48:55 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:48:55 user nova-compute[73258]:       <mac address="fa:16:3e:2a:36:5c"/>
Aug 27 06:48:55 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:48:55 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:48:55 user nova-compute[73258]:       <target dev="tap8e94cae8-ea"/>
Aug 27 06:48:55 user nova-compute[73258]:     </interface>
Aug 27 06:48:55 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:48:55 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/console.log" append="off"/>
Aug 27 06:48:55 user nova-compute[73258]:     </serial>
Aug 27 06:48:55 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:48:55 user nova-compute[73258]:     <video>
Aug 27 06:48:55 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:48:55 user nova-compute[73258]:     </video>
Aug 27 06:48:55 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:48:55 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:48:55 user nova-compute[73258]:     </rng>
Aug 27 06:48:55 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:48:55 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:48:55 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:48:55 user nova-compute[73258]:     </memballoon>
Aug 27 06:48:55 user nova-compute[73258]:   </devices>
Aug 27 06:48:55 user nova-compute[73258]: </domain>
Aug 27 06:48:55 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:48:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1499776913',display_name='tempest-ServerRescueNegativeTestJSON-server-1499776913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1499776913',id=30,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErbhwcq7aMHPks7Q30Yl1JgTtz86nuYtLPWY4cd1Va/1/xuONf64c83ZqaEqnO0vQM+Iy3jGDNqDWdT2gBJMeVX8g/Qp/6AdHpxWA0fEmnlzHeTG2hi39F3l9DovV+GoA==',key_name='tempest-keypair-1178169413',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6efa67b959a473da5a06f9e0aa8795f',ramdisk_id='',reservation_id='r-onwvh0ae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1025141277',owner_user_name='tempest-ServerRescueNegativeTestJSON-1025141277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:48:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='685859ec81944e3398853037c24673a4',uuid=b22b7599-5a37-4370-b440-f04e3dc88f98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "address": "fa:16:3e:2a:36:5c", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e94cae8-ea", "ovs_interfaceid": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converting VIF {"id": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "address": "fa:16:3e:2a:36:5c", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e94cae8-ea", "ovs_interfaceid": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:36:5c,bridge_name='br-int',has_traffic_filtering=True,id=8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e94cae8-ea') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG os_vif [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:36:5c,bridge_name='br-int',has_traffic_filtering=True,id=8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e94cae8-ea') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e94cae8-ea, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e94cae8-ea, col_values=(('external_ids', {'iface-id': '8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:36:5c', 'vm-uuid': 'b22b7599-5a37-4370-b440-f04e3dc88f98'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:55 user nova-compute[73258]: INFO os_vif [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:36:5c,bridge_name='br-int',has_traffic_filtering=True,id=8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e94cae8-ea')
Aug 27 06:48:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] No VIF found with MAC fa:16:3e:2a:36:5c, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.network.neutron [req-862b2c07-f37d-41ef-b287-957b8abd60c0 req-018dcfab-e585-4d87-bbfb-e1abec67311b service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Updated VIF entry in instance network info cache for port 8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.network.neutron [req-862b2c07-f37d-41ef-b287-957b8abd60c0 req-018dcfab-e585-4d87-bbfb-e1abec67311b service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Updating instance_info_cache with network_info: [{"id": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "address": "fa:16:3e:2a:36:5c", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e94cae8-ea", "ovs_interfaceid": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-862b2c07-f37d-41ef-b287-957b8abd60c0 req-018dcfab-e585-4d87-bbfb-e1abec67311b service nova] Releasing lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "2e89032a-0f74-4116-867e-a3b46fd20a7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "2e89032a-0f74-4116-867e-a3b46fd20a7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "2e89032a-0f74-4116-867e-a3b46fd20a7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "2e89032a-0f74-4116-867e-a3b46fd20a7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "2e89032a-0f74-4116-867e-a3b46fd20a7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:55 user nova-compute[73258]: INFO nova.compute.manager [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Terminating instance
Aug 27 06:48:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:48:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:48:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:56 user nova-compute[73258]: DEBUG nova.compute.manager [req-8d09d9ac-0add-43d2-8fd4-87680d1773c2 req-b77508dc-c1a9-472f-97d8-e9e1f8387dd6 service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Received event network-vif-unplugged-fe2e1694-c46e-4a27-99ae-695d0394799a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8d09d9ac-0add-43d2-8fd4-87680d1773c2 req-b77508dc-c1a9-472f-97d8-e9e1f8387dd6 service nova] Acquiring lock "2e89032a-0f74-4116-867e-a3b46fd20a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8d09d9ac-0add-43d2-8fd4-87680d1773c2 req-b77508dc-c1a9-472f-97d8-e9e1f8387dd6 service nova] Lock "2e89032a-0f74-4116-867e-a3b46fd20a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8d09d9ac-0add-43d2-8fd4-87680d1773c2 req-b77508dc-c1a9-472f-97d8-e9e1f8387dd6 service nova] Lock "2e89032a-0f74-4116-867e-a3b46fd20a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:56 user nova-compute[73258]: DEBUG nova.compute.manager [req-8d09d9ac-0add-43d2-8fd4-87680d1773c2 req-b77508dc-c1a9-472f-97d8-e9e1f8387dd6 service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] No waiting events found dispatching network-vif-unplugged-fe2e1694-c46e-4a27-99ae-695d0394799a {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:48:56 user nova-compute[73258]: DEBUG nova.compute.manager [req-8d09d9ac-0add-43d2-8fd4-87680d1773c2 req-b77508dc-c1a9-472f-97d8-e9e1f8387dd6 service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Received event network-vif-unplugged-fe2e1694-c46e-4a27-99ae-695d0394799a for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:48:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:48:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118939.4526823, b22b7599-5a37-4370-b440-f04e3dc88f98 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:48:59 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] VM Resumed (Lifecycle Event)
Aug 27 06:48:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.manager [req-23aa61be-39ed-4169-b721-506a031d90f5 req-97f845a8-029a-4a64-8440-19eebf85fd5f service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received event network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-23aa61be-39ed-4169-b721-506a031d90f5 req-97f845a8-029a-4a64-8440-19eebf85fd5f service nova] Acquiring lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-23aa61be-39ed-4169-b721-506a031d90f5 req-97f845a8-029a-4a64-8440-19eebf85fd5f service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-23aa61be-39ed-4169-b721-506a031d90f5 req-97f845a8-029a-4a64-8440-19eebf85fd5f service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.manager [req-23aa61be-39ed-4169-b721-506a031d90f5 req-97f845a8-029a-4a64-8440-19eebf85fd5f service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] No waiting events found dispatching network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:48:59 user nova-compute[73258]: WARNING nova.compute.manager [req-23aa61be-39ed-4169-b721-506a031d90f5 req-97f845a8-029a-4a64-8440-19eebf85fd5f service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received unexpected event network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 for instance with vm_state building and task_state spawning.
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.manager [req-0a170866-952c-47eb-bcd6-3c7e1e09b43d req-7d781716-86eb-4680-a30c-35d1a47dd6a8 service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Received event network-vif-plugged-fe2e1694-c46e-4a27-99ae-695d0394799a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0a170866-952c-47eb-bcd6-3c7e1e09b43d req-7d781716-86eb-4680-a30c-35d1a47dd6a8 service nova] Acquiring lock "2e89032a-0f74-4116-867e-a3b46fd20a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0a170866-952c-47eb-bcd6-3c7e1e09b43d req-7d781716-86eb-4680-a30c-35d1a47dd6a8 service nova] Lock "2e89032a-0f74-4116-867e-a3b46fd20a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0a170866-952c-47eb-bcd6-3c7e1e09b43d req-7d781716-86eb-4680-a30c-35d1a47dd6a8 service nova] Lock "2e89032a-0f74-4116-867e-a3b46fd20a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.manager [req-0a170866-952c-47eb-bcd6-3c7e1e09b43d req-7d781716-86eb-4680-a30c-35d1a47dd6a8 service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] No waiting events found dispatching network-vif-plugged-fe2e1694-c46e-4a27-99ae-695d0394799a {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:48:59 user nova-compute[73258]: WARNING nova.compute.manager [req-0a170866-952c-47eb-bcd6-3c7e1e09b43d req-7d781716-86eb-4680-a30c-35d1a47dd6a8 service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Received unexpected event network-vif-plugged-fe2e1694-c46e-4a27-99ae-695d0394799a for instance with vm_state active and task_state deleting.
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.manager [req-1f2dc80a-fb28-4958-a070-7386c8e7c8a7 req-b3f312be-3e08-4635-b156-24e22bd1eb8c service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received event network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1f2dc80a-fb28-4958-a070-7386c8e7c8a7 req-b3f312be-3e08-4635-b156-24e22bd1eb8c service nova] Acquiring lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1f2dc80a-fb28-4958-a070-7386c8e7c8a7 req-b3f312be-3e08-4635-b156-24e22bd1eb8c service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1f2dc80a-fb28-4958-a070-7386c8e7c8a7 req-b3f312be-3e08-4635-b156-24e22bd1eb8c service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.manager [req-1f2dc80a-fb28-4958-a070-7386c8e7c8a7 req-b3f312be-3e08-4635-b156-24e22bd1eb8c service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] No waiting events found dispatching network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:48:59 user nova-compute[73258]: WARNING nova.compute.manager [req-1f2dc80a-fb28-4958-a070-7386c8e7c8a7 req-b3f312be-3e08-4635-b156-24e22bd1eb8c service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received unexpected event network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 for instance with vm_state building and task_state spawning.
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:48:59 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Instance destroyed successfully.
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.objects.instance [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lazy-loading 'resources' on Instance uuid 2e89032a-0f74-4116-867e-a3b46fd20a7a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:48:59 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:48:59 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=7340MB free_disk=23.995697021484375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:48:59 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Instance spawned successfully.
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:43:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-452335647',display_name='tempest-AttachVolumeNegativeTest-server-452335647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-452335647',id=22,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk9DgsKsKYWVyRIZjKwtBXnc9POMzA2TRV4qFM6W5jcvuUbFrmSyN6kvOv/U7Rbp9xzh9P85XoZAarmIxqp9asAscNKgLuc+d5bqhJr40vVNzkBCPjHOgzFNbk5wt0aXg==',key_name='tempest-keypair-1000528364',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:43:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f43f32eaadfd4f7eacc418385cc5e474',ramdisk_id='',reservation_id='r-ooo7dubj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-537954646',owner_user_name='tempest-AttachVolumeNegativeTest-537954646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:43:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd74559df08d44e298ba6e2ccbaaefae',uuid=2e89032a-0f74-4116-867e-a3b46fd20a7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe2e1694-c46e-4a27-99ae-695d0394799a", "address": "fa:16:3e:0c:40:0b", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e1694-c4", "ovs_interfaceid": "fe2e1694-c46e-4a27-99ae-695d0394799a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converting VIF {"id": "fe2e1694-c46e-4a27-99ae-695d0394799a", "address": "fa:16:3e:0c:40:0b", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2e1694-c4", "ovs_interfaceid": "fe2e1694-c46e-4a27-99ae-695d0394799a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:40:0b,bridge_name='br-int',has_traffic_filtering=True,id=fe2e1694-c46e-4a27-99ae-695d0394799a,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2e1694-c4') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG os_vif [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:40:0b,bridge_name='br-int',has_traffic_filtering=True,id=fe2e1694-c46e-4a27-99ae-695d0394799a,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2e1694-c4') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:48:59 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118939.4528308, b22b7599-5a37-4370-b440-f04e3dc88f98 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:48:59 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] VM Started (Lifecycle Event)
Aug 27 06:48:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe2e1694-c4, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:48:59 user nova-compute[73258]: INFO os_vif [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:40:0b,bridge_name='br-int',has_traffic_filtering=True,id=fe2e1694-c46e-4a27-99ae-695d0394799a,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2e1694-c4')
Aug 27 06:48:59 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Deleting instance files /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a_del
Aug 27 06:48:59 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Deletion of /opt/stack/data/nova/instances/2e89032a-0f74-4116-867e-a3b46fd20a7a_del complete
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:48:59 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:48:59 user nova-compute[73258]: INFO nova.compute.manager [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Took 3.85 seconds to destroy the instance on the hypervisor.
Aug 27 06:48:59 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:48:59 user nova-compute[73258]: INFO nova.compute.manager [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Took 6.74 seconds to spawn the instance on the hypervisor.
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1672aa9f-be6f-4357-877f-a48f62119df4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a836678e-240d-4ead-b0b5-64d146910a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9517c681-ed2b-49c2-94a6-aa2181b4b62f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 8396ca48-c47c-41b1-9872-24dbb0b9f526 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 2e89032a-0f74-4116-867e-a3b46fd20a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 7ee743f1-9611-4165-838e-54fccb332f1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bc3cebb3-0e29-4899-94aa-d13a2a9ca86a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance e6e96ad8-e34e-4970-b3a6-c06df0c6d994 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance ede6423b-ad91-4002-91d1-5849c6a4e26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance b22b7599-5a37-4370-b440-f04e3dc88f98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:48:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:48:59 user nova-compute[73258]: INFO nova.compute.manager [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Took 7.85 seconds to build instance.
Aug 27 06:48:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a40ccb-b4e6-416e-adf9-f1571df57908 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.954s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:00 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:49:00 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:49:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:49:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.662s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:00 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:49:01 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Took 1.23 seconds to deallocate network for instance.
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.compute.manager [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:49:01 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Creating image(s)
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Did not create local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Ensure instance console log exists: /opt/stack/data/nova/instances/ede6423b-ad91-4002-91d1-5849c6a4e26b/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Start _get_guest_xml network_info=[{"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaSCwxVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ede6423b-ad91-4002-91d1-5849c6a4e26b', 'attached_at': '', 'detached_at': '', 'volume_id': 'c199006a-92aa-4e38-8f04-059c7642b550', 'serial': 'c199006a-92aa-4e38-8f04-059c7642b550'}, 'attachment_id': '8b3b4e9a-ad45-4908-99e1-6bc2e0aeaa88', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:49:01 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:49:01 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaSCwxVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:49:01 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:49:01 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:49:01 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c114b2-be83-4c81-bc2d-661850a8c390]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:49:01 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcb42ad-50f3-4f38-abdb-5e988b600cf7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550] added
Aug 27 06:49:01 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3ce581-a6a2-4546-8c37-7790b5abdd3d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd9c9fc-339c-4c46-98e4-b22af959b71e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaSCwxVA {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaSCwxVA" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6403eae1-a0be-4581-956e-945784ea0fcc]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yaSCwxVA'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[44519d57-cd20-43c6-8b0a-74aa8e7fb6fd]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c5192b-d79b-4f24-8098-73ffde282892]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:49:01 user nova-compute[73258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:49:01 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:49:01 user nova-compute[73258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:49:01 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ae9a66-12e4-4bc3-84e7-51ac9f1f3026]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550, portal: 172.16.0.220,3260]
Aug 27 06:49:01 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550, portal: 172.16.0.220,3260] successful.
Aug 27 06:49:01 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a7c652-ed51-4fa3-a368-863a22ab9dd9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.compute.manager [req-857a8c10-42cc-4e43-95d0-7fd2e2851984 req-999d2a3d-2af9-4e50-aeac-46ee3978cac7 service nova] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Received event network-vif-deleted-fe2e1694-c46e-4a27-99ae-695d0394799a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[991716e4-3268-46a5-aa2a-67d3556e8efa]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:49:01 user nova-compute[73258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:49:01 user nova-compute[73258]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:49:01 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:49:01 user nova-compute[73258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:49:01 user nova-compute[73258]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:49:01 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cd04c2-bc9a-4422-8e3b-de4f2a2593b8]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.521s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:49:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaSCwxVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:49:01 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Deleted allocations for instance 2e89032a-0f74-4116-867e-a3b46fd20a7a
Aug 27 06:49:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9980ca7e-38b6-4b39-b797-5472e0b2fd07 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "2e89032a-0f74-4116-867e-a3b46fd20a7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.826s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23432386439373366', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432386439373366', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:48:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-247234727',display_name='tempest-ServerActionsTestOtherA-server-247234727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-247234727',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/KYWUE6gNqqFSSqcTnsAI5+JZTptdXjLfwtgiVKLM8n2N6Y2L8s6Bg81l6XDxMjw3BfYNizv1BnMF+y6NIh1U/xVCMRNK16iGCh/62JzPGiCS6K24meGZJ+ETPM0mnhw==',key_name='tempest-keypair-1255305482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57faf7cb6c704c05aba06857a6cdd29f',ramdisk_id='',reservation_id='r-lb0avote',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1477462030',owner_user_name='tempest-ServerActionsTestOtherA-1477462030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f8a06ab5634f60b6ed2d1d9b2c342e',uuid=ede6423b-ad91-4002-91d1-5849c6a4e26b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converting VIF {"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:da:75,bridge_name='br-int',has_traffic_filtering=True,id=0d7639f1-aadd-4f15-9292-8cef2591ce8d,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7639f1-aa') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG nova.objects.instance [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lazy-loading 'pci_devices' on Instance uuid ede6423b-ad91-4002-91d1-5849c6a4e26b {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:49:02 user nova-compute[73258]:   <uuid>ede6423b-ad91-4002-91d1-5849c6a4e26b</uuid>
Aug 27 06:49:02 user nova-compute[73258]:   <name>instance-0000001d</name>
Aug 27 06:49:02 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:49:02 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:49:02 user nova-compute[73258]:   <metadata>
Aug 27 06:49:02 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:49:02 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:49:02 user nova-compute[73258]:       <nova:name>tempest-ServerActionsTestOtherA-server-247234727</nova:name>
Aug 27 06:49:02 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:49:01</nova:creationTime>
Aug 27 06:49:02 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:49:02 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:49:02 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:49:02 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:49:02 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:49:02 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:49:02 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:49:02 user nova-compute[73258]:       <nova:owner>
Aug 27 06:49:02 user nova-compute[73258]:         <nova:user uuid="67f8a06ab5634f60b6ed2d1d9b2c342e">tempest-ServerActionsTestOtherA-1477462030-project-member</nova:user>
Aug 27 06:49:02 user nova-compute[73258]:         <nova:project uuid="57faf7cb6c704c05aba06857a6cdd29f">tempest-ServerActionsTestOtherA-1477462030</nova:project>
Aug 27 06:49:02 user nova-compute[73258]:       </nova:owner>
Aug 27 06:49:02 user nova-compute[73258]:       <nova:ports>
Aug 27 06:49:02 user nova-compute[73258]:         <nova:port uuid="0d7639f1-aadd-4f15-9292-8cef2591ce8d">
Aug 27 06:49:02 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 06:49:02 user nova-compute[73258]:         </nova:port>
Aug 27 06:49:02 user nova-compute[73258]:       </nova:ports>
Aug 27 06:49:02 user nova-compute[73258]:     </nova:instance>
Aug 27 06:49:02 user nova-compute[73258]:   </metadata>
Aug 27 06:49:02 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:49:02 user nova-compute[73258]:     <system>
Aug 27 06:49:02 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:49:02 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:49:02 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:49:02 user nova-compute[73258]:       <entry name="serial">ede6423b-ad91-4002-91d1-5849c6a4e26b</entry>
Aug 27 06:49:02 user nova-compute[73258]:       <entry name="uuid">ede6423b-ad91-4002-91d1-5849c6a4e26b</entry>
Aug 27 06:49:02 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:49:02 user nova-compute[73258]:     </system>
Aug 27 06:49:02 user nova-compute[73258]:   </sysinfo>
Aug 27 06:49:02 user nova-compute[73258]:   <os>
Aug 27 06:49:02 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:49:02 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:49:02 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:49:02 user nova-compute[73258]:   </os>
Aug 27 06:49:02 user nova-compute[73258]:   <features>
Aug 27 06:49:02 user nova-compute[73258]:     <acpi/>
Aug 27 06:49:02 user nova-compute[73258]:     <apic/>
Aug 27 06:49:02 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:49:02 user nova-compute[73258]:   </features>
Aug 27 06:49:02 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:49:02 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:49:02 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:49:02 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:49:02 user nova-compute[73258]:   </clock>
Aug 27 06:49:02 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:49:02 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:49:02 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:49:02 user nova-compute[73258]:   </cpu>
Aug 27 06:49:02 user nova-compute[73258]:   <devices>
Aug 27 06:49:02 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:49:02 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:49:02 user nova-compute[73258]:       <source dev="/dev/sdb"/>
Aug 27 06:49:02 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:49:02 user nova-compute[73258]:       <serial>c199006a-92aa-4e38-8f04-059c7642b550</serial>
Aug 27 06:49:02 user nova-compute[73258]:     </disk>
Aug 27 06:49:02 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:49:02 user nova-compute[73258]:       <mac address="fa:16:3e:a4:da:75"/>
Aug 27 06:49:02 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:49:02 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:49:02 user nova-compute[73258]:       <target dev="tap0d7639f1-aa"/>
Aug 27 06:49:02 user nova-compute[73258]:     </interface>
Aug 27 06:49:02 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:49:02 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/ede6423b-ad91-4002-91d1-5849c6a4e26b/console.log" append="off"/>
Aug 27 06:49:02 user nova-compute[73258]:     </serial>
Aug 27 06:49:02 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:49:02 user nova-compute[73258]:     <video>
Aug 27 06:49:02 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:49:02 user nova-compute[73258]:     </video>
Aug 27 06:49:02 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:49:02 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:49:02 user nova-compute[73258]:     </rng>
Aug 27 06:49:02 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:49:02 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:49:02 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:49:02 user nova-compute[73258]:     </memballoon>
Aug 27 06:49:02 user nova-compute[73258]:   </devices>
Aug 27 06:49:02 user nova-compute[73258]: </domain>
Aug 27 06:49:02 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:48:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-247234727',display_name='tempest-ServerActionsTestOtherA-server-247234727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-247234727',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/KYWUE6gNqqFSSqcTnsAI5+JZTptdXjLfwtgiVKLM8n2N6Y2L8s6Bg81l6XDxMjw3BfYNizv1BnMF+y6NIh1U/xVCMRNK16iGCh/62JzPGiCS6K24meGZJ+ETPM0mnhw==',key_name='tempest-keypair-1255305482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57faf7cb6c704c05aba06857a6cdd29f',ramdisk_id='',reservation_id='r-lb0avote',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1477462030',owner_user_name='tempest-ServerActionsTestOtherA-1477462030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f8a06ab5634f60b6ed2d1d9b2c342e',uuid=ede6423b-ad91-4002-91d1-5849c6a4e26b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converting VIF {"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:da:75,bridge_name='br-int',has_traffic_filtering=True,id=0d7639f1-aadd-4f15-9292-8cef2591ce8d,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7639f1-aa') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG os_vif [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:da:75,bridge_name='br-int',has_traffic_filtering=True,id=0d7639f1-aadd-4f15-9292-8cef2591ce8d,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7639f1-aa') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d7639f1-aa, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d7639f1-aa, col_values=(('external_ids', {'iface-id': '0d7639f1-aadd-4f15-9292-8cef2591ce8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:da:75', 'vm-uuid': 'ede6423b-ad91-4002-91d1-5849c6a4e26b'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:02 user nova-compute[73258]: INFO os_vif [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:da:75,bridge_name='br-int',has_traffic_filtering=True,id=0d7639f1-aadd-4f15-9292-8cef2591ce8d,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7639f1-aa')
Aug 27 06:49:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:49:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] No VIF found with MAC fa:16:3e:a4:da:75, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:49:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:04 user nova-compute[73258]: DEBUG nova.compute.manager [req-d538056a-2c43-4782-9f01-20ca31d83aeb req-c5202ee0-6458-4227-a65a-1acf9863d8c4 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Received event network-vif-plugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d538056a-2c43-4782-9f01-20ca31d83aeb req-c5202ee0-6458-4227-a65a-1acf9863d8c4 service nova] Acquiring lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d538056a-2c43-4782-9f01-20ca31d83aeb req-c5202ee0-6458-4227-a65a-1acf9863d8c4 service nova] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d538056a-2c43-4782-9f01-20ca31d83aeb req-c5202ee0-6458-4227-a65a-1acf9863d8c4 service nova] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:04 user nova-compute[73258]: DEBUG nova.compute.manager [req-d538056a-2c43-4782-9f01-20ca31d83aeb req-c5202ee0-6458-4227-a65a-1acf9863d8c4 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] No waiting events found dispatching network-vif-plugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:49:04 user nova-compute[73258]: WARNING nova.compute.manager [req-d538056a-2c43-4782-9f01-20ca31d83aeb req-c5202ee0-6458-4227-a65a-1acf9863d8c4 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Received unexpected event network-vif-plugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d for instance with vm_state building and task_state spawning.
Aug 27 06:49:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:05 user nova-compute[73258]: INFO nova.compute.manager [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Detaching volume eb06556d-be68-45c0-ad6d-7b516b1d9f7e
Aug 27 06:49:05 user nova-compute[73258]: INFO nova.virt.block_device [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Attempting to driver detach volume eb06556d-be68-45c0-ad6d-7b516b1d9f7e from mountpoint /dev/vdb
Aug 27 06:49:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Attempting to detach device vdb from instance 9517c681-ed2b-49c2-94a6-aa2181b4b62f from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:49:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:49:05 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:49:05 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 06:49:05 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:49:05 user nova-compute[73258]:   <serial>eb06556d-be68-45c0-ad6d-7b516b1d9f7e</serial>
Aug 27 06:49:05 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 06:49:05 user nova-compute[73258]: </disk>
Aug 27 06:49:05 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:49:05 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Successfully detached device vdb from instance 9517c681-ed2b-49c2-94a6-aa2181b4b62f from the persistent domain config.
Aug 27 06:49:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9517c681-ed2b-49c2-94a6-aa2181b4b62f from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:49:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:49:05 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:49:05 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 06:49:05 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:49:05 user nova-compute[73258]:   <serial>eb06556d-be68-45c0-ad6d-7b516b1d9f7e</serial>
Aug 27 06:49:05 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 06:49:05 user nova-compute[73258]: </disk>
Aug 27 06:49:05 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693118946.298384, 9517c681-ed2b-49c2-94a6-aa2181b4b62f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:49:06 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Successfully detached device vdb from instance 9517c681-ed2b-49c2-94a6-aa2181b4b62f from the live domain config.
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGxhdLjf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:49:06 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:49:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5908189b-ba32-4d40-b7fc-fc9892fa6876]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec95acfc-db48-4713-a9c0-c446c5fcd7c3]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:49:06 user nova-compute[73258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:49:06 user nova-compute[73258]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:49:06 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:49:06 user nova-compute[73258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e (non-flash)
Aug 27 06:49:06 user nova-compute[73258]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:49:06 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4305120e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e'): ({'sdc'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Removing single pathed devices sdc {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8395d053-6c20-436b-91b3-98d8aaa9f274]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6c386a-6555-4a25-b19a-8c642fafd9e8]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Flushing IO for device /dev/sdc {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[964c370a-9c08-401b-a4a4-64adddfee9ca]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fbd3e5-6408-41e4-9a12-3b1509085228]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.compute.manager [req-b801874a-c684-4af8-85c3-b9df959b0bcb req-c6d496b9-22a2-4fce-9968-0d64f2369940 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Received event network-vif-plugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b801874a-c684-4af8-85c3-b9df959b0bcb req-c6d496b9-22a2-4fce-9968-0d64f2369940 service nova] Acquiring lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b801874a-c684-4af8-85c3-b9df959b0bcb req-c6d496b9-22a2-4fce-9968-0d64f2369940 service nova] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b801874a-c684-4af8-85c3-b9df959b0bcb req-c6d496b9-22a2-4fce-9968-0d64f2369940 service nova] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.compute.manager [req-b801874a-c684-4af8-85c3-b9df959b0bcb req-c6d496b9-22a2-4fce-9968-0d64f2369940 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] No waiting events found dispatching network-vif-plugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:49:06 user nova-compute[73258]: WARNING nova.compute.manager [req-b801874a-c684-4af8-85c3-b9df959b0bcb req-c6d496b9-22a2-4fce-9968-0d64f2369940 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Received unexpected event network-vif-plugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d for instance with vm_state building and task_state spawning.
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b16ed6a-b65c-4948-a559-a136fd36f3bf]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d513f347-193b-4ea8-acf4-0c33587cd713]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e, portal: 172.16.0.220,3260]
Aug 27 06:49:06 user nova-compute[73258]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e, portal: 172.16.0.220,3260] successful.
Aug 27 06:49:06 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb06556d-be68-45c0-ad6d-7b516b1d9f7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[240d0652-084f-4b74-a60d-99f9433762c5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] <== disconnect_volume: return (321ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118946.7044158, ede6423b-ad91-4002-91d1-5849c6a4e26b => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:49:06 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] VM Resumed (Lifecycle Event)
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:49:06 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Instance spawned successfully.
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:49:06 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118946.7091064, ede6423b-ad91-4002-91d1-5849c6a4e26b => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:49:06 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] VM Started (Lifecycle Event)
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:49:06 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:49:06 user nova-compute[73258]: INFO nova.compute.manager [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Took 5.78 seconds to spawn the instance on the hypervisor.
Aug 27 06:49:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:49:07 user nova-compute[73258]: INFO nova.compute.manager [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Took 26.91 seconds to build instance.
Aug 27 06:49:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-420fc169-d95c-42ca-843c-33fe310f5246 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.012s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:07 user nova-compute[73258]: DEBUG nova.objects.instance [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'flavor' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:49:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-99465aca-f621-4ec7-92b4-bb0efd58c15e tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.059s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1042de32-23bc-41a6-8a99-aeeca5a42030 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1042de32-23bc-41a6-8a99-aeeca5a42030 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:08 user nova-compute[73258]: DEBUG nova.compute.manager [None req-1042de32-23bc-41a6-8a99-aeeca5a42030 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:49:08 user nova-compute[73258]: DEBUG nova.compute.manager [None req-1042de32-23bc-41a6-8a99-aeeca5a42030 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73258) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 27 06:49:08 user nova-compute[73258]: DEBUG nova.objects.instance [None req-1042de32-23bc-41a6-8a99-aeeca5a42030 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'flavor' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:49:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-5d430c9b-c7ac-421a-9f02-ec0c3e34cc72 req-9d2dfeba-a624-4c37-93ec-89695846b432 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-vif-unplugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5d430c9b-c7ac-421a-9f02-ec0c3e34cc72 req-9d2dfeba-a624-4c37-93ec-89695846b432 service nova] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5d430c9b-c7ac-421a-9f02-ec0c3e34cc72 req-9d2dfeba-a624-4c37-93ec-89695846b432 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5d430c9b-c7ac-421a-9f02-ec0c3e34cc72 req-9d2dfeba-a624-4c37-93ec-89695846b432 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-5d430c9b-c7ac-421a-9f02-ec0c3e34cc72 req-9d2dfeba-a624-4c37-93ec-89695846b432 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] No waiting events found dispatching network-vif-unplugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:49:08 user nova-compute[73258]: WARNING nova.compute.manager [req-5d430c9b-c7ac-421a-9f02-ec0c3e34cc72 req-9d2dfeba-a624-4c37-93ec-89695846b432 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received unexpected event network-vif-unplugged-7b4375ea-f74b-4677-a768-97e96029c237 for instance with vm_state active and task_state powering-off.
Aug 27 06:49:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:08 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Instance destroyed successfully.
Aug 27 06:49:08 user nova-compute[73258]: DEBUG nova.compute.manager [None req-1042de32-23bc-41a6-8a99-aeeca5a42030 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:49:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1042de32-23bc-41a6-8a99-aeeca5a42030 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.985s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] No waiting events found dispatching network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:49:10 user nova-compute[73258]: WARNING nova.compute.manager [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received unexpected event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 for instance with vm_state stopped and task_state None.
Aug 27 06:49:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] No waiting events found dispatching network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:49:10 user nova-compute[73258]: WARNING nova.compute.manager [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received unexpected event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 for instance with vm_state stopped and task_state None.
Aug 27 06:49:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] No waiting events found dispatching network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:49:10 user nova-compute[73258]: WARNING nova.compute.manager [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received unexpected event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 for instance with vm_state stopped and task_state None.
Aug 27 06:49:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-vif-unplugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] No waiting events found dispatching network-vif-unplugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:49:10 user nova-compute[73258]: WARNING nova.compute.manager [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received unexpected event network-vif-unplugged-7b4375ea-f74b-4677-a768-97e96029c237 for instance with vm_state stopped and task_state None.
Aug 27 06:49:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] No waiting events found dispatching network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:49:10 user nova-compute[73258]: WARNING nova.compute.manager [req-7fd6d0dd-25b1-47b9-b708-8e1bc636f11b req-81118e11-d320-43d4-87b7-0ba948240777 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received unexpected event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 for instance with vm_state stopped and task_state None.
Aug 27 06:49:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:14 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118937.1169198, 2e89032a-0f74-4116-867e-a3b46fd20a7a => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:49:14 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] VM Stopped (Lifecycle Event)
Aug 27 06:49:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-d537685d-5791-4cff-9cf6-e4187e7211ee None None] [instance: 2e89032a-0f74-4116-867e-a3b46fd20a7a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:49:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:17 user nova-compute[73258]: DEBUG nova.compute.manager [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:49:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:17 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:49:17 user nova-compute[73258]: INFO nova.compute.claims [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Claim successful on node user
Aug 27 06:49:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:17 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:49:17 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:49:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:17 user nova-compute[73258]: DEBUG nova.compute.manager [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:49:17 user nova-compute[73258]: DEBUG nova.compute.manager [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:49:17 user nova-compute[73258]: DEBUG nova.network.neutron [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:49:17 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:49:17 user nova-compute[73258]: DEBUG nova.compute.manager [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:49:17 user nova-compute[73258]: DEBUG nova.policy [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e39b42a04fd64685ac7382cd16dc7285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2900acc4299f427fa7152d2f039e026f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG nova.compute.manager [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:49:18 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Creating image(s)
Aug 27 06:49:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "/opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "/opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.207s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk 1073741824" returned: 0 in 0.053s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG nova.network.neutron [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Successfully created port: 45fb1201-3985-41b3-9c75-fecb5fcbd4ae {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.199s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Cannot resize image /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Ensure instance console log exists: /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:19 user nova-compute[73258]: DEBUG nova.network.neutron [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Successfully updated port: 45fb1201-3985-41b3-9c75-fecb5fcbd4ae {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:49:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "refresh_cache-3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:49:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquired lock "refresh_cache-3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:49:19 user nova-compute[73258]: DEBUG nova.network.neutron [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:49:19 user nova-compute[73258]: DEBUG nova.network.neutron [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:49:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-975f5716-7cc6-4b52-8de9-423543d675d9 req-9f6a426c-9b86-4cf9-99cc-afe8f425a267 service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Received event network-changed-45fb1201-3985-41b3-9c75-fecb5fcbd4ae {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-975f5716-7cc6-4b52-8de9-423543d675d9 req-9f6a426c-9b86-4cf9-99cc-afe8f425a267 service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Refreshing instance network info cache due to event network-changed-45fb1201-3985-41b3-9c75-fecb5fcbd4ae. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:49:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-975f5716-7cc6-4b52-8de9-423543d675d9 req-9f6a426c-9b86-4cf9-99cc-afe8f425a267 service nova] Acquiring lock "refresh_cache-3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.network.neutron [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Updating instance_info_cache with network_info: [{"id": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "address": "fa:16:3e:00:c8:7d", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45fb1201-39", "ovs_interfaceid": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Releasing lock "refresh_cache-3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Instance network_info: |[{"id": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "address": "fa:16:3e:00:c8:7d", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45fb1201-39", "ovs_interfaceid": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-975f5716-7cc6-4b52-8de9-423543d675d9 req-9f6a426c-9b86-4cf9-99cc-afe8f425a267 service nova] Acquired lock "refresh_cache-3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.network.neutron [req-975f5716-7cc6-4b52-8de9-423543d675d9 req-9f6a426c-9b86-4cf9-99cc-afe8f425a267 service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Refreshing network info cache for port 45fb1201-3985-41b3-9c75-fecb5fcbd4ae {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Start _get_guest_xml network_info=[{"id": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "address": "fa:16:3e:00:c8:7d", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45fb1201-39", "ovs_interfaceid": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:49:20 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:49:20 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1267693825',display_name='tempest-VolumesSnapshotTestJSON-instance-1267693825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1267693825',id=31,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJ0NqSDzU9mJJxf2KI9nJFS+/egVxE/xnOfyNVhm2JmIYcKnFP3hKi0OQ/cb0YZuB7vbVtBtjjTJ/mkrhPm3w1UFxv2rwIIxcWgKOamloypmgTU3BXSjP4nOby6p0SAuw==',key_name='tempest-keypair-632012971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2900acc4299f427fa7152d2f039e026f',ramdisk_id='',reservation_id='r-cx3unj61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-993486304',owner_user_name='tempest-VolumesSnapshotTestJSON-993486304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:49:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e39b42a04fd64685ac7382cd16dc7285',uuid=3cd7bb27-7b3b-4540-ab38-f085d6a6e5df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "address": "fa:16:3e:00:c8:7d", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45fb1201-39", "ovs_interfaceid": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Converting VIF {"id": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "address": "fa:16:3e:00:c8:7d", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45fb1201-39", "ovs_interfaceid": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:c8:7d,bridge_name='br-int',has_traffic_filtering=True,id=45fb1201-3985-41b3-9c75-fecb5fcbd4ae,network=Network(82b73052-3c5c-4f8f-b938-b4423125eae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45fb1201-39') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.objects.instance [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:49:20 user nova-compute[73258]:   <uuid>3cd7bb27-7b3b-4540-ab38-f085d6a6e5df</uuid>
Aug 27 06:49:20 user nova-compute[73258]:   <name>instance-0000001f</name>
Aug 27 06:49:20 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:49:20 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:49:20 user nova-compute[73258]:   <metadata>
Aug 27 06:49:20 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:49:20 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:49:20 user nova-compute[73258]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1267693825</nova:name>
Aug 27 06:49:20 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:49:20</nova:creationTime>
Aug 27 06:49:20 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:49:20 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:49:20 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:49:20 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:49:20 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:49:20 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:49:20 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:49:20 user nova-compute[73258]:       <nova:owner>
Aug 27 06:49:20 user nova-compute[73258]:         <nova:user uuid="e39b42a04fd64685ac7382cd16dc7285">tempest-VolumesSnapshotTestJSON-993486304-project-member</nova:user>
Aug 27 06:49:20 user nova-compute[73258]:         <nova:project uuid="2900acc4299f427fa7152d2f039e026f">tempest-VolumesSnapshotTestJSON-993486304</nova:project>
Aug 27 06:49:20 user nova-compute[73258]:       </nova:owner>
Aug 27 06:49:20 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:49:20 user nova-compute[73258]:       <nova:ports>
Aug 27 06:49:20 user nova-compute[73258]:         <nova:port uuid="45fb1201-3985-41b3-9c75-fecb5fcbd4ae">
Aug 27 06:49:20 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 06:49:20 user nova-compute[73258]:         </nova:port>
Aug 27 06:49:20 user nova-compute[73258]:       </nova:ports>
Aug 27 06:49:20 user nova-compute[73258]:     </nova:instance>
Aug 27 06:49:20 user nova-compute[73258]:   </metadata>
Aug 27 06:49:20 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:49:20 user nova-compute[73258]:     <system>
Aug 27 06:49:20 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:49:20 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:49:20 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:49:20 user nova-compute[73258]:       <entry name="serial">3cd7bb27-7b3b-4540-ab38-f085d6a6e5df</entry>
Aug 27 06:49:20 user nova-compute[73258]:       <entry name="uuid">3cd7bb27-7b3b-4540-ab38-f085d6a6e5df</entry>
Aug 27 06:49:20 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:49:20 user nova-compute[73258]:     </system>
Aug 27 06:49:20 user nova-compute[73258]:   </sysinfo>
Aug 27 06:49:20 user nova-compute[73258]:   <os>
Aug 27 06:49:20 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:49:20 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:49:20 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:49:20 user nova-compute[73258]:   </os>
Aug 27 06:49:20 user nova-compute[73258]:   <features>
Aug 27 06:49:20 user nova-compute[73258]:     <acpi/>
Aug 27 06:49:20 user nova-compute[73258]:     <apic/>
Aug 27 06:49:20 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:49:20 user nova-compute[73258]:   </features>
Aug 27 06:49:20 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:49:20 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:49:20 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:49:20 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:49:20 user nova-compute[73258]:   </clock>
Aug 27 06:49:20 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:49:20 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:49:20 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:49:20 user nova-compute[73258]:   </cpu>
Aug 27 06:49:20 user nova-compute[73258]:   <devices>
Aug 27 06:49:20 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:49:20 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:49:20 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk"/>
Aug 27 06:49:20 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:49:20 user nova-compute[73258]:     </disk>
Aug 27 06:49:20 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:49:20 user nova-compute[73258]:       <mac address="fa:16:3e:00:c8:7d"/>
Aug 27 06:49:20 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:49:20 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:49:20 user nova-compute[73258]:       <target dev="tap45fb1201-39"/>
Aug 27 06:49:20 user nova-compute[73258]:     </interface>
Aug 27 06:49:20 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:49:20 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/console.log" append="off"/>
Aug 27 06:49:20 user nova-compute[73258]:     </serial>
Aug 27 06:49:20 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:49:20 user nova-compute[73258]:     <video>
Aug 27 06:49:20 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:49:20 user nova-compute[73258]:     </video>
Aug 27 06:49:20 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:49:20 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:49:20 user nova-compute[73258]:     </rng>
Aug 27 06:49:20 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:49:20 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:49:20 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:49:20 user nova-compute[73258]:     </memballoon>
Aug 27 06:49:20 user nova-compute[73258]:   </devices>
Aug 27 06:49:20 user nova-compute[73258]: </domain>
Aug 27 06:49:20 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1267693825',display_name='tempest-VolumesSnapshotTestJSON-instance-1267693825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1267693825',id=31,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJ0NqSDzU9mJJxf2KI9nJFS+/egVxE/xnOfyNVhm2JmIYcKnFP3hKi0OQ/cb0YZuB7vbVtBtjjTJ/mkrhPm3w1UFxv2rwIIxcWgKOamloypmgTU3BXSjP4nOby6p0SAuw==',key_name='tempest-keypair-632012971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2900acc4299f427fa7152d2f039e026f',ramdisk_id='',reservation_id='r-cx3unj61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-993486304',owner_user_name='tempest-VolumesSnapshotTestJSON-993486304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:49:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e39b42a04fd64685ac7382cd16dc7285',uuid=3cd7bb27-7b3b-4540-ab38-f085d6a6e5df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "address": "fa:16:3e:00:c8:7d", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45fb1201-39", "ovs_interfaceid": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Converting VIF {"id": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "address": "fa:16:3e:00:c8:7d", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45fb1201-39", "ovs_interfaceid": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:c8:7d,bridge_name='br-int',has_traffic_filtering=True,id=45fb1201-3985-41b3-9c75-fecb5fcbd4ae,network=Network(82b73052-3c5c-4f8f-b938-b4423125eae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45fb1201-39') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG os_vif [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:c8:7d,bridge_name='br-int',has_traffic_filtering=True,id=45fb1201-3985-41b3-9c75-fecb5fcbd4ae,network=Network(82b73052-3c5c-4f8f-b938-b4423125eae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45fb1201-39') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45fb1201-39, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap45fb1201-39, col_values=(('external_ids', {'iface-id': '45fb1201-3985-41b3-9c75-fecb5fcbd4ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:c8:7d', 'vm-uuid': '3cd7bb27-7b3b-4540-ab38-f085d6a6e5df'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:20 user nova-compute[73258]: INFO os_vif [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:c8:7d,bridge_name='br-int',has_traffic_filtering=True,id=45fb1201-3985-41b3-9c75-fecb5fcbd4ae,network=Network(82b73052-3c5c-4f8f-b938-b4423125eae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45fb1201-39')
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] No VIF found with MAC fa:16:3e:00:c8:7d, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.network.neutron [req-975f5716-7cc6-4b52-8de9-423543d675d9 req-9f6a426c-9b86-4cf9-99cc-afe8f425a267 service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Updated VIF entry in instance network info cache for port 45fb1201-3985-41b3-9c75-fecb5fcbd4ae. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG nova.network.neutron [req-975f5716-7cc6-4b52-8de9-423543d675d9 req-9f6a426c-9b86-4cf9-99cc-afe8f425a267 service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Updating instance_info_cache with network_info: [{"id": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "address": "fa:16:3e:00:c8:7d", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45fb1201-39", "ovs_interfaceid": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:49:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-975f5716-7cc6-4b52-8de9-423543d675d9 req-9f6a426c-9b86-4cf9-99cc-afe8f425a267 service nova] Releasing lock "refresh_cache-3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:49:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:21 user nova-compute[73258]: DEBUG nova.compute.manager [req-7ca4d625-ff10-4e8c-aa46-c470baba5d2c req-8af54053-d9af-4851-b053-16b13ce9e9ad service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Received event network-vif-plugged-45fb1201-3985-41b3-9c75-fecb5fcbd4ae {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7ca4d625-ff10-4e8c-aa46-c470baba5d2c req-8af54053-d9af-4851-b053-16b13ce9e9ad service nova] Acquiring lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7ca4d625-ff10-4e8c-aa46-c470baba5d2c req-8af54053-d9af-4851-b053-16b13ce9e9ad service nova] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7ca4d625-ff10-4e8c-aa46-c470baba5d2c req-8af54053-d9af-4851-b053-16b13ce9e9ad service nova] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:21 user nova-compute[73258]: DEBUG nova.compute.manager [req-7ca4d625-ff10-4e8c-aa46-c470baba5d2c req-8af54053-d9af-4851-b053-16b13ce9e9ad service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] No waiting events found dispatching network-vif-plugged-45fb1201-3985-41b3-9c75-fecb5fcbd4ae {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:49:21 user nova-compute[73258]: WARNING nova.compute.manager [req-7ca4d625-ff10-4e8c-aa46-c470baba5d2c req-8af54053-d9af-4851-b053-16b13ce9e9ad service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Received unexpected event network-vif-plugged-45fb1201-3985-41b3-9c75-fecb5fcbd4ae for instance with vm_state building and task_state spawning.
Aug 27 06:49:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:23 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693118948.8673787, 9517c681-ed2b-49c2-94a6-aa2181b4b62f => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:49:23 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] VM Stopped (Lifecycle Event)
Aug 27 06:49:23 user nova-compute[73258]: DEBUG nova.compute.manager [None req-fa8e3cb4-a1d7-4186-8e31-f42f9f718523 None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:49:23 user nova-compute[73258]: DEBUG nova.compute.manager [None req-fa8e3cb4-a1d7-4186-8e31-f42f9f718523 None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:49:23 user nova-compute[73258]: DEBUG nova.compute.manager [req-a69259bd-8463-43cc-8c12-d1697d5ae25d req-2e2e0c78-8d08-4451-a582-41a14f46262c service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Received event network-vif-plugged-45fb1201-3985-41b3-9c75-fecb5fcbd4ae {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a69259bd-8463-43cc-8c12-d1697d5ae25d req-2e2e0c78-8d08-4451-a582-41a14f46262c service nova] Acquiring lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a69259bd-8463-43cc-8c12-d1697d5ae25d req-2e2e0c78-8d08-4451-a582-41a14f46262c service nova] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a69259bd-8463-43cc-8c12-d1697d5ae25d req-2e2e0c78-8d08-4451-a582-41a14f46262c service nova] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:23 user nova-compute[73258]: DEBUG nova.compute.manager [req-a69259bd-8463-43cc-8c12-d1697d5ae25d req-2e2e0c78-8d08-4451-a582-41a14f46262c service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] No waiting events found dispatching network-vif-plugged-45fb1201-3985-41b3-9c75-fecb5fcbd4ae {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:49:23 user nova-compute[73258]: WARNING nova.compute.manager [req-a69259bd-8463-43cc-8c12-d1697d5ae25d req-2e2e0c78-8d08-4451-a582-41a14f46262c service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Received unexpected event network-vif-plugged-45fb1201-3985-41b3-9c75-fecb5fcbd4ae for instance with vm_state building and task_state spawning.
Aug 27 06:49:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquiring lock "1324fcba-2b2b-4406-8527-c1585642dd94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "1324fcba-2b2b-4406-8527-c1585642dd94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:49:24 user nova-compute[73258]: INFO nova.compute.claims [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Claim successful on node user
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118964.4319644, 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:49:24 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] VM Resumed (Lifecycle Event)
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:49:24 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Instance spawned successfully.
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:49:24 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118964.433207, 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:49:24 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] VM Started (Lifecycle Event)
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:49:24 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:49:24 user nova-compute[73258]: INFO nova.compute.manager [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Took 6.46 seconds to spawn the instance on the hypervisor.
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:49:24 user nova-compute[73258]: INFO nova.compute.manager [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Took 7.37 seconds to build instance.
Aug 27 06:49:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-13b4ffa8-b2fd-4997-8c96-b5d7bbb1b03f tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.479s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.network.neutron [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:49:24 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:49:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG nova.compute.manager [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:49:25 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Creating image(s)
Aug 27 06:49:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquiring lock "/opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "/opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "/opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG nova.policy [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41ce9c10e4f14e478b5833700a5546cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb0b2a4be9946e680a0e65d58f9c4f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.193s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.183s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/disk 1073741824" returned: 0 in 0.066s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.208s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Cannot resize image /opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Ensure instance console log exists: /opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:26 user nova-compute[73258]: DEBUG nova.network.neutron [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Successfully created port: cef77cbb-9e3c-4b8a-a42c-50ff43e0d444 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.network.neutron [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Successfully updated port: cef77cbb-9e3c-4b8a-a42c-50ff43e0d444 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquiring lock "refresh_cache-1324fcba-2b2b-4406-8527-c1585642dd94" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquired lock "refresh_cache-1324fcba-2b2b-4406-8527-c1585642dd94" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.network.neutron [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.compute.manager [req-8c2b809d-b22d-4691-8706-59b0876cd4a0 req-42e1a121-858f-47d4-8a73-a92083ad14ca service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Received event network-changed-cef77cbb-9e3c-4b8a-a42c-50ff43e0d444 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.compute.manager [req-8c2b809d-b22d-4691-8706-59b0876cd4a0 req-42e1a121-858f-47d4-8a73-a92083ad14ca service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Refreshing instance network info cache due to event network-changed-cef77cbb-9e3c-4b8a-a42c-50ff43e0d444. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8c2b809d-b22d-4691-8706-59b0876cd4a0 req-42e1a121-858f-47d4-8a73-a92083ad14ca service nova] Acquiring lock "refresh_cache-1324fcba-2b2b-4406-8527-c1585642dd94" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.network.neutron [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.network.neutron [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Updating instance_info_cache with network_info: [{"id": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "address": "fa:16:3e:5a:22:36", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef77cbb-9e", "ovs_interfaceid": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Releasing lock "refresh_cache-1324fcba-2b2b-4406-8527-c1585642dd94" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.compute.manager [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Instance network_info: |[{"id": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "address": "fa:16:3e:5a:22:36", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef77cbb-9e", "ovs_interfaceid": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8c2b809d-b22d-4691-8706-59b0876cd4a0 req-42e1a121-858f-47d4-8a73-a92083ad14ca service nova] Acquired lock "refresh_cache-1324fcba-2b2b-4406-8527-c1585642dd94" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.network.neutron [req-8c2b809d-b22d-4691-8706-59b0876cd4a0 req-42e1a121-858f-47d4-8a73-a92083ad14ca service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Refreshing network info cache for port cef77cbb-9e3c-4b8a-a42c-50ff43e0d444 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Start _get_guest_xml network_info=[{"id": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "address": "fa:16:3e:5a:22:36", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef77cbb-9e", "ovs_interfaceid": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:49:27 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:49:27 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-411495519',display_name='tempest-VolumesActionsTest-instance-411495519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-411495519',id=32,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeb0b2a4be9946e680a0e65d58f9c4f3',ramdisk_id='',reservation_id='r-4a0ekiy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1397322250',owner_user_name='tempest-VolumesActionsTest-1397322250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:49:25Z,user_data=None,user_id='41ce9c10e4f14e478b5833700a5546cc',uuid=1324fcba-2b2b-4406-8527-c1585642dd94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "address": "fa:16:3e:5a:22:36", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef77cbb-9e", "ovs_interfaceid": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Converting VIF {"id": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "address": "fa:16:3e:5a:22:36", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef77cbb-9e", "ovs_interfaceid": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:22:36,bridge_name='br-int',has_traffic_filtering=True,id=cef77cbb-9e3c-4b8a-a42c-50ff43e0d444,network=Network(c5f850d2-9a33-4e76-a6fd-54865efe7aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcef77cbb-9e') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.objects.instance [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lazy-loading 'pci_devices' on Instance uuid 1324fcba-2b2b-4406-8527-c1585642dd94 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:49:27 user nova-compute[73258]:   <uuid>1324fcba-2b2b-4406-8527-c1585642dd94</uuid>
Aug 27 06:49:27 user nova-compute[73258]:   <name>instance-00000020</name>
Aug 27 06:49:27 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:49:27 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:49:27 user nova-compute[73258]:   <metadata>
Aug 27 06:49:27 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:49:27 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:49:27 user nova-compute[73258]:       <nova:name>tempest-VolumesActionsTest-instance-411495519</nova:name>
Aug 27 06:49:27 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:49:27</nova:creationTime>
Aug 27 06:49:27 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:49:27 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:49:27 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:49:27 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:49:27 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:49:27 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:49:27 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:49:27 user nova-compute[73258]:       <nova:owner>
Aug 27 06:49:27 user nova-compute[73258]:         <nova:user uuid="41ce9c10e4f14e478b5833700a5546cc">tempest-VolumesActionsTest-1397322250-project-member</nova:user>
Aug 27 06:49:27 user nova-compute[73258]:         <nova:project uuid="aeb0b2a4be9946e680a0e65d58f9c4f3">tempest-VolumesActionsTest-1397322250</nova:project>
Aug 27 06:49:27 user nova-compute[73258]:       </nova:owner>
Aug 27 06:49:27 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:49:27 user nova-compute[73258]:       <nova:ports>
Aug 27 06:49:27 user nova-compute[73258]:         <nova:port uuid="cef77cbb-9e3c-4b8a-a42c-50ff43e0d444">
Aug 27 06:49:27 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 06:49:27 user nova-compute[73258]:         </nova:port>
Aug 27 06:49:27 user nova-compute[73258]:       </nova:ports>
Aug 27 06:49:27 user nova-compute[73258]:     </nova:instance>
Aug 27 06:49:27 user nova-compute[73258]:   </metadata>
Aug 27 06:49:27 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:49:27 user nova-compute[73258]:     <system>
Aug 27 06:49:27 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:49:27 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:49:27 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:49:27 user nova-compute[73258]:       <entry name="serial">1324fcba-2b2b-4406-8527-c1585642dd94</entry>
Aug 27 06:49:27 user nova-compute[73258]:       <entry name="uuid">1324fcba-2b2b-4406-8527-c1585642dd94</entry>
Aug 27 06:49:27 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:49:27 user nova-compute[73258]:     </system>
Aug 27 06:49:27 user nova-compute[73258]:   </sysinfo>
Aug 27 06:49:27 user nova-compute[73258]:   <os>
Aug 27 06:49:27 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:49:27 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:49:27 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:49:27 user nova-compute[73258]:   </os>
Aug 27 06:49:27 user nova-compute[73258]:   <features>
Aug 27 06:49:27 user nova-compute[73258]:     <acpi/>
Aug 27 06:49:27 user nova-compute[73258]:     <apic/>
Aug 27 06:49:27 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:49:27 user nova-compute[73258]:   </features>
Aug 27 06:49:27 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:49:27 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:49:27 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:49:27 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:49:27 user nova-compute[73258]:   </clock>
Aug 27 06:49:27 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:49:27 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:49:27 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:49:27 user nova-compute[73258]:   </cpu>
Aug 27 06:49:27 user nova-compute[73258]:   <devices>
Aug 27 06:49:27 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:49:27 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:49:27 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/disk"/>
Aug 27 06:49:27 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:49:27 user nova-compute[73258]:     </disk>
Aug 27 06:49:27 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:49:27 user nova-compute[73258]:       <mac address="fa:16:3e:5a:22:36"/>
Aug 27 06:49:27 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:49:27 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:49:27 user nova-compute[73258]:       <target dev="tapcef77cbb-9e"/>
Aug 27 06:49:27 user nova-compute[73258]:     </interface>
Aug 27 06:49:27 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:49:27 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/console.log" append="off"/>
Aug 27 06:49:27 user nova-compute[73258]:     </serial>
Aug 27 06:49:27 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:49:27 user nova-compute[73258]:     <video>
Aug 27 06:49:27 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:49:27 user nova-compute[73258]:     </video>
Aug 27 06:49:27 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:49:27 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:49:27 user nova-compute[73258]:     </rng>
Aug 27 06:49:27 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:49:27 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:49:27 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:49:27 user nova-compute[73258]:     </memballoon>
Aug 27 06:49:27 user nova-compute[73258]:   </devices>
Aug 27 06:49:27 user nova-compute[73258]: </domain>
Aug 27 06:49:27 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-411495519',display_name='tempest-VolumesActionsTest-instance-411495519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-411495519',id=32,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeb0b2a4be9946e680a0e65d58f9c4f3',ramdisk_id='',reservation_id='r-4a0ekiy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1397322250',owner_user_name='tempest-VolumesActionsTest-1397322250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:49:25Z,user_data=None,user_id='41ce9c10e4f14e478b5833700a5546cc',uuid=1324fcba-2b2b-4406-8527-c1585642dd94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "address": "fa:16:3e:5a:22:36", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef77cbb-9e", "ovs_interfaceid": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Converting VIF {"id": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "address": "fa:16:3e:5a:22:36", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef77cbb-9e", "ovs_interfaceid": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:22:36,bridge_name='br-int',has_traffic_filtering=True,id=cef77cbb-9e3c-4b8a-a42c-50ff43e0d444,network=Network(c5f850d2-9a33-4e76-a6fd-54865efe7aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcef77cbb-9e') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG os_vif [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:22:36,bridge_name='br-int',has_traffic_filtering=True,id=cef77cbb-9e3c-4b8a-a42c-50ff43e0d444,network=Network(c5f850d2-9a33-4e76-a6fd-54865efe7aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcef77cbb-9e') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcef77cbb-9e, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcef77cbb-9e, col_values=(('external_ids', {'iface-id': 'cef77cbb-9e3c-4b8a-a42c-50ff43e0d444', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:22:36', 'vm-uuid': '1324fcba-2b2b-4406-8527-c1585642dd94'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:27 user nova-compute[73258]: INFO os_vif [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:22:36,bridge_name='br-int',has_traffic_filtering=True,id=cef77cbb-9e3c-4b8a-a42c-50ff43e0d444,network=Network(c5f850d2-9a33-4e76-a6fd-54865efe7aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcef77cbb-9e')
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:49:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] No VIF found with MAC fa:16:3e:5a:22:36, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:49:28 user nova-compute[73258]: DEBUG nova.network.neutron [req-8c2b809d-b22d-4691-8706-59b0876cd4a0 req-42e1a121-858f-47d4-8a73-a92083ad14ca service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Updated VIF entry in instance network info cache for port cef77cbb-9e3c-4b8a-a42c-50ff43e0d444. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:49:28 user nova-compute[73258]: DEBUG nova.network.neutron [req-8c2b809d-b22d-4691-8706-59b0876cd4a0 req-42e1a121-858f-47d4-8a73-a92083ad14ca service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Updating instance_info_cache with network_info: [{"id": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "address": "fa:16:3e:5a:22:36", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef77cbb-9e", "ovs_interfaceid": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:49:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8c2b809d-b22d-4691-8706-59b0876cd4a0 req-42e1a121-858f-47d4-8a73-a92083ad14ca service nova] Releasing lock "refresh_cache-1324fcba-2b2b-4406-8527-c1585642dd94" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:49:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-873b688d-e47a-4fa8-97f4-24146b2cf0fb req-c5d60de6-5a0e-4173-9340-fce4582028cc service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Received event network-vif-plugged-cef77cbb-9e3c-4b8a-a42c-50ff43e0d444 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-873b688d-e47a-4fa8-97f4-24146b2cf0fb req-c5d60de6-5a0e-4173-9340-fce4582028cc service nova] Acquiring lock "1324fcba-2b2b-4406-8527-c1585642dd94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-873b688d-e47a-4fa8-97f4-24146b2cf0fb req-c5d60de6-5a0e-4173-9340-fce4582028cc service nova] Lock "1324fcba-2b2b-4406-8527-c1585642dd94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-873b688d-e47a-4fa8-97f4-24146b2cf0fb req-c5d60de6-5a0e-4173-9340-fce4582028cc service nova] Lock "1324fcba-2b2b-4406-8527-c1585642dd94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-873b688d-e47a-4fa8-97f4-24146b2cf0fb req-c5d60de6-5a0e-4173-9340-fce4582028cc service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] No waiting events found dispatching network-vif-plugged-cef77cbb-9e3c-4b8a-a42c-50ff43e0d444 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:49:30 user nova-compute[73258]: WARNING nova.compute.manager [req-873b688d-e47a-4fa8-97f4-24146b2cf0fb req-c5d60de6-5a0e-4173-9340-fce4582028cc service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Received unexpected event network-vif-plugged-cef77cbb-9e3c-4b8a-a42c-50ff43e0d444 for instance with vm_state building and task_state spawning.
Aug 27 06:49:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:31 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118971.9358342, 1324fcba-2b2b-4406-8527-c1585642dd94 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:49:31 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] VM Resumed (Lifecycle Event)
Aug 27 06:49:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:49:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:49:31 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Instance spawned successfully.
Aug 27 06:49:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:49:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:49:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:49:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:31 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:49:31 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118971.9360182, 1324fcba-2b2b-4406-8527-c1585642dd94 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:49:31 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] VM Started (Lifecycle Event)
Aug 27 06:49:32 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:49:32 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:49:32 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:49:32 user nova-compute[73258]: INFO nova.compute.manager [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Took 6.99 seconds to spawn the instance on the hypervisor.
Aug 27 06:49:32 user nova-compute[73258]: DEBUG nova.compute.manager [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:49:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-de3dcf87-2c3e-4d65-9272-5596be547f65 req-a77d41df-568a-4fbe-99cd-49d9e35d0d64 service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Received event network-vif-plugged-cef77cbb-9e3c-4b8a-a42c-50ff43e0d444 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-de3dcf87-2c3e-4d65-9272-5596be547f65 req-a77d41df-568a-4fbe-99cd-49d9e35d0d64 service nova] Acquiring lock "1324fcba-2b2b-4406-8527-c1585642dd94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-de3dcf87-2c3e-4d65-9272-5596be547f65 req-a77d41df-568a-4fbe-99cd-49d9e35d0d64 service nova] Lock "1324fcba-2b2b-4406-8527-c1585642dd94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-de3dcf87-2c3e-4d65-9272-5596be547f65 req-a77d41df-568a-4fbe-99cd-49d9e35d0d64 service nova] Lock "1324fcba-2b2b-4406-8527-c1585642dd94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-de3dcf87-2c3e-4d65-9272-5596be547f65 req-a77d41df-568a-4fbe-99cd-49d9e35d0d64 service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] No waiting events found dispatching network-vif-plugged-cef77cbb-9e3c-4b8a-a42c-50ff43e0d444 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:49:32 user nova-compute[73258]: WARNING nova.compute.manager [req-de3dcf87-2c3e-4d65-9272-5596be547f65 req-a77d41df-568a-4fbe-99cd-49d9e35d0d64 service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Received unexpected event network-vif-plugged-cef77cbb-9e3c-4b8a-a42c-50ff43e0d444 for instance with vm_state building and task_state spawning.
Aug 27 06:49:32 user nova-compute[73258]: INFO nova.compute.manager [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Took 7.92 seconds to build instance.
Aug 27 06:49:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-035f79ae-84e8-432d-b421-b71e3f563777 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "1324fcba-2b2b-4406-8527-c1585642dd94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.026s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:39 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:49:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:49:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-9acc81d9-12bc-46d6-8af9-2fc3106de2b2" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:49:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-9acc81d9-12bc-46d6-8af9-2fc3106de2b2" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:49:39 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:49:40 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Updating instance_info_cache with network_info: [{"id": "f177246f-1def-438b-8ac0-08f4e9cfed50", "address": "fa:16:3e:76:c0:d7", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf177246f-1d", "ovs_interfaceid": "f177246f-1def-438b-8ac0-08f4e9cfed50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:49:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-9acc81d9-12bc-46d6-8af9-2fc3106de2b2" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:49:40 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:49:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "d409b021-ab98-4f9f-a80d-99fe05de7b69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:49:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:43 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:49:43 user nova-compute[73258]: INFO nova.compute.claims [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Claim successful on node user
Aug 27 06:49:43 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:49:43 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:49:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:49:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:49:43 user nova-compute[73258]: DEBUG nova.network.neutron [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:49:43 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:49:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:49:43 user nova-compute[73258]: DEBUG nova.policy [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c44464f6e84417cb8823d01c7aa669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72f7bfc1fb284defb6f92a77be8821e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:49:43 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:49:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:49:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:49:43 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Creating image(s)
Aug 27 06:49:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "/opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "/opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "/opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.106s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.200s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk 1073741824" returned: 0 in 0.064s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG nova.network.neutron [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Successfully created port: a1f85e16-bf92-403d-bd6d-2300dfc481d7 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Cannot resize image /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Ensure instance console log exists: /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:45 user nova-compute[73258]: DEBUG nova.network.neutron [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Successfully updated port: a1f85e16-bf92-403d-bd6d-2300dfc481d7 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:49:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "refresh_cache-d409b021-ab98-4f9f-a80d-99fe05de7b69" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:49:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquired lock "refresh_cache-d409b021-ab98-4f9f-a80d-99fe05de7b69" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:49:45 user nova-compute[73258]: DEBUG nova.network.neutron [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:49:45 user nova-compute[73258]: DEBUG nova.compute.manager [req-0705a78f-c30c-455d-9e49-5886621adb31 req-dc762cf9-af34-4e0b-9bbc-88a6b2a6a394 service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Received event network-changed-a1f85e16-bf92-403d-bd6d-2300dfc481d7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:45 user nova-compute[73258]: DEBUG nova.compute.manager [req-0705a78f-c30c-455d-9e49-5886621adb31 req-dc762cf9-af34-4e0b-9bbc-88a6b2a6a394 service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Refreshing instance network info cache due to event network-changed-a1f85e16-bf92-403d-bd6d-2300dfc481d7. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:49:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0705a78f-c30c-455d-9e49-5886621adb31 req-dc762cf9-af34-4e0b-9bbc-88a6b2a6a394 service nova] Acquiring lock "refresh_cache-d409b021-ab98-4f9f-a80d-99fe05de7b69" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:49:45 user nova-compute[73258]: DEBUG nova.network.neutron [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:49:45 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.network.neutron [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Updating instance_info_cache with network_info: [{"id": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "address": "fa:16:3e:52:49:8c", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f85e16-bf", "ovs_interfaceid": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Releasing lock "refresh_cache-d409b021-ab98-4f9f-a80d-99fe05de7b69" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Instance network_info: |[{"id": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "address": "fa:16:3e:52:49:8c", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f85e16-bf", "ovs_interfaceid": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0705a78f-c30c-455d-9e49-5886621adb31 req-dc762cf9-af34-4e0b-9bbc-88a6b2a6a394 service nova] Acquired lock "refresh_cache-d409b021-ab98-4f9f-a80d-99fe05de7b69" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.network.neutron [req-0705a78f-c30c-455d-9e49-5886621adb31 req-dc762cf9-af34-4e0b-9bbc-88a6b2a6a394 service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Refreshing network info cache for port a1f85e16-bf92-403d-bd6d-2300dfc481d7 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Start _get_guest_xml network_info=[{"id": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "address": "fa:16:3e:52:49:8c", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f85e16-bf", "ovs_interfaceid": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:49:46 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:49:46 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1387683302',display_name='tempest-TestStampPattern-server-1387683302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1387683302',id=33,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwYZxibBAc2nvlcafNqnemngRCXIz90U4I2XLhwZXxc9YEXEO2YKFZ69eY+zmysXtc6kSJDnPSsSYt70Y3+IiQVuHG0DIaBJdVBu3sgT92WAEQ0yFaQ4/zUiXf3G0XH5w==',key_name='tempest-TestStampPattern-1276587428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72f7bfc1fb284defb6f92a77be8821e5',ramdisk_id='',reservation_id='r-jzflwlei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-873602452',owner_user_name='tempest-TestStampPattern-873602452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:49:44Z,user_data=None,user_id='7c44464f6e84417cb8823d01c7aa669f',uuid=d409b021-ab98-4f9f-a80d-99fe05de7b69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "address": "fa:16:3e:52:49:8c", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f85e16-bf", "ovs_interfaceid": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Converting VIF {"id": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "address": "fa:16:3e:52:49:8c", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f85e16-bf", "ovs_interfaceid": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:49:8c,bridge_name='br-int',has_traffic_filtering=True,id=a1f85e16-bf92-403d-bd6d-2300dfc481d7,network=Network(d52cca87-60dc-45ab-b7fe-f5a26a33e0ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f85e16-bf') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.objects.instance [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lazy-loading 'pci_devices' on Instance uuid d409b021-ab98-4f9f-a80d-99fe05de7b69 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:49:46 user nova-compute[73258]:   <uuid>d409b021-ab98-4f9f-a80d-99fe05de7b69</uuid>
Aug 27 06:49:46 user nova-compute[73258]:   <name>instance-00000021</name>
Aug 27 06:49:46 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:49:46 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:49:46 user nova-compute[73258]:   <metadata>
Aug 27 06:49:46 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:49:46 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:49:46 user nova-compute[73258]:       <nova:name>tempest-TestStampPattern-server-1387683302</nova:name>
Aug 27 06:49:46 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:49:46</nova:creationTime>
Aug 27 06:49:46 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:49:46 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:49:46 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:49:46 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:49:46 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:49:46 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:49:46 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:49:46 user nova-compute[73258]:       <nova:owner>
Aug 27 06:49:46 user nova-compute[73258]:         <nova:user uuid="7c44464f6e84417cb8823d01c7aa669f">tempest-TestStampPattern-873602452-project-member</nova:user>
Aug 27 06:49:46 user nova-compute[73258]:         <nova:project uuid="72f7bfc1fb284defb6f92a77be8821e5">tempest-TestStampPattern-873602452</nova:project>
Aug 27 06:49:46 user nova-compute[73258]:       </nova:owner>
Aug 27 06:49:46 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:49:46 user nova-compute[73258]:       <nova:ports>
Aug 27 06:49:46 user nova-compute[73258]:         <nova:port uuid="a1f85e16-bf92-403d-bd6d-2300dfc481d7">
Aug 27 06:49:46 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 06:49:46 user nova-compute[73258]:         </nova:port>
Aug 27 06:49:46 user nova-compute[73258]:       </nova:ports>
Aug 27 06:49:46 user nova-compute[73258]:     </nova:instance>
Aug 27 06:49:46 user nova-compute[73258]:   </metadata>
Aug 27 06:49:46 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:49:46 user nova-compute[73258]:     <system>
Aug 27 06:49:46 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:49:46 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:49:46 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:49:46 user nova-compute[73258]:       <entry name="serial">d409b021-ab98-4f9f-a80d-99fe05de7b69</entry>
Aug 27 06:49:46 user nova-compute[73258]:       <entry name="uuid">d409b021-ab98-4f9f-a80d-99fe05de7b69</entry>
Aug 27 06:49:46 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:49:46 user nova-compute[73258]:     </system>
Aug 27 06:49:46 user nova-compute[73258]:   </sysinfo>
Aug 27 06:49:46 user nova-compute[73258]:   <os>
Aug 27 06:49:46 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:49:46 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:49:46 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:49:46 user nova-compute[73258]:   </os>
Aug 27 06:49:46 user nova-compute[73258]:   <features>
Aug 27 06:49:46 user nova-compute[73258]:     <acpi/>
Aug 27 06:49:46 user nova-compute[73258]:     <apic/>
Aug 27 06:49:46 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:49:46 user nova-compute[73258]:   </features>
Aug 27 06:49:46 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:49:46 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:49:46 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:49:46 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:49:46 user nova-compute[73258]:   </clock>
Aug 27 06:49:46 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:49:46 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:49:46 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:49:46 user nova-compute[73258]:   </cpu>
Aug 27 06:49:46 user nova-compute[73258]:   <devices>
Aug 27 06:49:46 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:49:46 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:49:46 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk"/>
Aug 27 06:49:46 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:49:46 user nova-compute[73258]:     </disk>
Aug 27 06:49:46 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:49:46 user nova-compute[73258]:       <mac address="fa:16:3e:52:49:8c"/>
Aug 27 06:49:46 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:49:46 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:49:46 user nova-compute[73258]:       <target dev="tapa1f85e16-bf"/>
Aug 27 06:49:46 user nova-compute[73258]:     </interface>
Aug 27 06:49:46 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:49:46 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/console.log" append="off"/>
Aug 27 06:49:46 user nova-compute[73258]:     </serial>
Aug 27 06:49:46 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:49:46 user nova-compute[73258]:     <video>
Aug 27 06:49:46 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:49:46 user nova-compute[73258]:     </video>
Aug 27 06:49:46 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:49:46 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:49:46 user nova-compute[73258]:     </rng>
Aug 27 06:49:46 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:49:46 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:49:46 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:49:46 user nova-compute[73258]:     </memballoon>
Aug 27 06:49:46 user nova-compute[73258]:   </devices>
Aug 27 06:49:46 user nova-compute[73258]: </domain>
Aug 27 06:49:46 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1387683302',display_name='tempest-TestStampPattern-server-1387683302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1387683302',id=33,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwYZxibBAc2nvlcafNqnemngRCXIz90U4I2XLhwZXxc9YEXEO2YKFZ69eY+zmysXtc6kSJDnPSsSYt70Y3+IiQVuHG0DIaBJdVBu3sgT92WAEQ0yFaQ4/zUiXf3G0XH5w==',key_name='tempest-TestStampPattern-1276587428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72f7bfc1fb284defb6f92a77be8821e5',ramdisk_id='',reservation_id='r-jzflwlei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-873602452',owner_user_name='tempest-TestStampPattern-873602452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:49:44Z,user_data=None,user_id='7c44464f6e84417cb8823d01c7aa669f',uuid=d409b021-ab98-4f9f-a80d-99fe05de7b69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "address": "fa:16:3e:52:49:8c", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f85e16-bf", "ovs_interfaceid": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Converting VIF {"id": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "address": "fa:16:3e:52:49:8c", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f85e16-bf", "ovs_interfaceid": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:49:8c,bridge_name='br-int',has_traffic_filtering=True,id=a1f85e16-bf92-403d-bd6d-2300dfc481d7,network=Network(d52cca87-60dc-45ab-b7fe-f5a26a33e0ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f85e16-bf') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG os_vif [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:49:8c,bridge_name='br-int',has_traffic_filtering=True,id=a1f85e16-bf92-403d-bd6d-2300dfc481d7,network=Network(d52cca87-60dc-45ab-b7fe-f5a26a33e0ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f85e16-bf') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1f85e16-bf, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa1f85e16-bf, col_values=(('external_ids', {'iface-id': 'a1f85e16-bf92-403d-bd6d-2300dfc481d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:49:8c', 'vm-uuid': 'd409b021-ab98-4f9f-a80d-99fe05de7b69'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:46 user nova-compute[73258]: INFO os_vif [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:49:8c,bridge_name='br-int',has_traffic_filtering=True,id=a1f85e16-bf92-403d-bd6d-2300dfc481d7,network=Network(d52cca87-60dc-45ab-b7fe-f5a26a33e0ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f85e16-bf')
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] No VIF found with MAC fa:16:3e:52:49:8c, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.network.neutron [req-0705a78f-c30c-455d-9e49-5886621adb31 req-dc762cf9-af34-4e0b-9bbc-88a6b2a6a394 service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Updated VIF entry in instance network info cache for port a1f85e16-bf92-403d-bd6d-2300dfc481d7. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG nova.network.neutron [req-0705a78f-c30c-455d-9e49-5886621adb31 req-dc762cf9-af34-4e0b-9bbc-88a6b2a6a394 service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Updating instance_info_cache with network_info: [{"id": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "address": "fa:16:3e:52:49:8c", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f85e16-bf", "ovs_interfaceid": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0705a78f-c30c-455d-9e49-5886621adb31 req-dc762cf9-af34-4e0b-9bbc-88a6b2a6a394 service nova] Releasing lock "refresh_cache-d409b021-ab98-4f9f-a80d-99fe05de7b69" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:49:46 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:49:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:47 user nova-compute[73258]: DEBUG nova.compute.manager [req-0007c578-bd8e-46fd-a641-a9ad975e23c7 req-5252b2ca-be97-4fdf-a095-bab1f4d1c9ba service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Received event network-vif-plugged-a1f85e16-bf92-403d-bd6d-2300dfc481d7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0007c578-bd8e-46fd-a641-a9ad975e23c7 req-5252b2ca-be97-4fdf-a095-bab1f4d1c9ba service nova] Acquiring lock "d409b021-ab98-4f9f-a80d-99fe05de7b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0007c578-bd8e-46fd-a641-a9ad975e23c7 req-5252b2ca-be97-4fdf-a095-bab1f4d1c9ba service nova] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0007c578-bd8e-46fd-a641-a9ad975e23c7 req-5252b2ca-be97-4fdf-a095-bab1f4d1c9ba service nova] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:47 user nova-compute[73258]: DEBUG nova.compute.manager [req-0007c578-bd8e-46fd-a641-a9ad975e23c7 req-5252b2ca-be97-4fdf-a095-bab1f4d1c9ba service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] No waiting events found dispatching network-vif-plugged-a1f85e16-bf92-403d-bd6d-2300dfc481d7 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:49:47 user nova-compute[73258]: WARNING nova.compute.manager [req-0007c578-bd8e-46fd-a641-a9ad975e23c7 req-5252b2ca-be97-4fdf-a095-bab1f4d1c9ba service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Received unexpected event network-vif-plugged-a1f85e16-bf92-403d-bd6d-2300dfc481d7 for instance with vm_state building and task_state spawning.
Aug 27 06:49:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-fa6d6d2a-3e96-43c2-84cb-46fd5e3da8c0 req-3c50f3bf-c2ac-4118-9582-dc948b2225a6 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received event network-changed-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-fa6d6d2a-3e96-43c2-84cb-46fd5e3da8c0 req-3c50f3bf-c2ac-4118-9582-dc948b2225a6 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Refreshing instance network info cache due to event network-changed-c8024bd0-329f-4c9e-8974-4881fc97ada9. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fa6d6d2a-3e96-43c2-84cb-46fd5e3da8c0 req-3c50f3bf-c2ac-4118-9582-dc948b2225a6 service nova] Acquiring lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fa6d6d2a-3e96-43c2-84cb-46fd5e3da8c0 req-3c50f3bf-c2ac-4118-9582-dc948b2225a6 service nova] Acquired lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.network.neutron [req-fa6d6d2a-3e96-43c2-84cb-46fd5e3da8c0 req-3c50f3bf-c2ac-4118-9582-dc948b2225a6 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Refreshing network info cache for port c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118989.7566395, d409b021-ab98-4f9f-a80d-99fe05de7b69 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:49:49 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] VM Resumed (Lifecycle Event)
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:49:49 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Instance spawned successfully.
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.network.neutron [req-fa6d6d2a-3e96-43c2-84cb-46fd5e3da8c0 req-3c50f3bf-c2ac-4118-9582-dc948b2225a6 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Updated VIF entry in instance network info cache for port c8024bd0-329f-4c9e-8974-4881fc97ada9. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.network.neutron [req-fa6d6d2a-3e96-43c2-84cb-46fd5e3da8c0 req-3c50f3bf-c2ac-4118-9582-dc948b2225a6 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Updating instance_info_cache with network_info: [{"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:49:49 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118989.7582564, d409b021-ab98-4f9f-a80d-99fe05de7b69 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:49:49 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] VM Started (Lifecycle Event)
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fa6d6d2a-3e96-43c2-84cb-46fd5e3da8c0 req-3c50f3bf-c2ac-4118-9582-dc948b2225a6 service nova] Releasing lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-49b494e0-7ffc-4f5a-a988-cf13fb0abda6 req-9d37dab7-a3b3-4898-9411-8918d6b50f0b service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Received event network-vif-plugged-a1f85e16-bf92-403d-bd6d-2300dfc481d7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-49b494e0-7ffc-4f5a-a988-cf13fb0abda6 req-9d37dab7-a3b3-4898-9411-8918d6b50f0b service nova] Acquiring lock "d409b021-ab98-4f9f-a80d-99fe05de7b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-49b494e0-7ffc-4f5a-a988-cf13fb0abda6 req-9d37dab7-a3b3-4898-9411-8918d6b50f0b service nova] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-49b494e0-7ffc-4f5a-a988-cf13fb0abda6 req-9d37dab7-a3b3-4898-9411-8918d6b50f0b service nova] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-49b494e0-7ffc-4f5a-a988-cf13fb0abda6 req-9d37dab7-a3b3-4898-9411-8918d6b50f0b service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] No waiting events found dispatching network-vif-plugged-a1f85e16-bf92-403d-bd6d-2300dfc481d7 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:49:49 user nova-compute[73258]: WARNING nova.compute.manager [req-49b494e0-7ffc-4f5a-a988-cf13fb0abda6 req-9d37dab7-a3b3-4898-9411-8918d6b50f0b service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Received unexpected event network-vif-plugged-a1f85e16-bf92-403d-bd6d-2300dfc481d7 for instance with vm_state building and task_state spawning.
Aug 27 06:49:49 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:49:49 user nova-compute[73258]: INFO nova.compute.manager [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Took 5.93 seconds to spawn the instance on the hypervisor.
Aug 27 06:49:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:49:49 user nova-compute[73258]: INFO nova.compute.manager [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Took 6.90 seconds to build instance.
Aug 27 06:49:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3ad56ab4-ecef-49ec-a898-76d710f38191 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.028s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "bcd29636-071b-4699-8360-e0d189df3f95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "bcd29636-071b-4699-8360-e0d189df3f95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:50 user nova-compute[73258]: DEBUG nova.compute.manager [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:49:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:50 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:49:50 user nova-compute[73258]: INFO nova.compute.claims [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Claim successful on node user
Aug 27 06:49:50 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:49:50 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.634s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG nova.compute.manager [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG nova.compute.manager [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG nova.network.neutron [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:49:51 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:49:51 user nova-compute[73258]: DEBUG nova.compute.manager [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG nova.policy [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd74559df08d44e298ba6e2ccbaaefae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43f32eaadfd4f7eacc418385cc5e474', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG nova.compute.manager [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:49:51 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Creating image(s)
Aug 27 06:49:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "/opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "/opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "/opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.177s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.177s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk 1073741824" returned: 0 in 0.052s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG nova.network.neutron [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Successfully created port: 97648bc4-126c-428e-9802-98a196d6bdb6 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.189s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:49:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Cannot resize image /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Ensure instance console log exists: /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG nova.network.neutron [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Successfully updated port: 97648bc4-126c-428e-9802-98a196d6bdb6 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "refresh_cache-bcd29636-071b-4699-8360-e0d189df3f95" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquired lock "refresh_cache-bcd29636-071b-4699-8360-e0d189df3f95" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG nova.network.neutron [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG nova.compute.manager [req-303f3b14-3b38-4c3f-99af-4ea720ca9020 req-925c1f50-bcf2-4883-a33f-c778ba165c6a service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Received event network-changed-97648bc4-126c-428e-9802-98a196d6bdb6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG nova.compute.manager [req-303f3b14-3b38-4c3f-99af-4ea720ca9020 req-925c1f50-bcf2-4883-a33f-c778ba165c6a service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Refreshing instance network info cache due to event network-changed-97648bc4-126c-428e-9802-98a196d6bdb6. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-303f3b14-3b38-4c3f-99af-4ea720ca9020 req-925c1f50-bcf2-4883-a33f-c778ba165c6a service nova] Acquiring lock "refresh_cache-bcd29636-071b-4699-8360-e0d189df3f95" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG nova.network.neutron [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:52 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.network.neutron [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Updating instance_info_cache with network_info: [{"id": "97648bc4-126c-428e-9802-98a196d6bdb6", "address": "fa:16:3e:9f:26:af", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97648bc4-12", "ovs_interfaceid": "97648bc4-126c-428e-9802-98a196d6bdb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Releasing lock "refresh_cache-bcd29636-071b-4699-8360-e0d189df3f95" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Instance network_info: |[{"id": "97648bc4-126c-428e-9802-98a196d6bdb6", "address": "fa:16:3e:9f:26:af", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97648bc4-12", "ovs_interfaceid": "97648bc4-126c-428e-9802-98a196d6bdb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-303f3b14-3b38-4c3f-99af-4ea720ca9020 req-925c1f50-bcf2-4883-a33f-c778ba165c6a service nova] Acquired lock "refresh_cache-bcd29636-071b-4699-8360-e0d189df3f95" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.network.neutron [req-303f3b14-3b38-4c3f-99af-4ea720ca9020 req-925c1f50-bcf2-4883-a33f-c778ba165c6a service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Refreshing network info cache for port 97648bc4-126c-428e-9802-98a196d6bdb6 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Start _get_guest_xml network_info=[{"id": "97648bc4-126c-428e-9802-98a196d6bdb6", "address": "fa:16:3e:9f:26:af", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97648bc4-12", "ovs_interfaceid": "97648bc4-126c-428e-9802-98a196d6bdb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:49:53 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:49:53 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-963997122',display_name='tempest-AttachVolumeNegativeTest-server-963997122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-963997122',id=34,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNs5L+ew4n+dqHz4V1PvhcRY8wpZzZ3h4WCmMJVaAm1WHc2PR36LS4xicrUuNI5xRtOWpk6PGkM2dPLgfe+o2CMIFkhbFDPCBvrWQ/Ly94J7/TSJ8yCeoKZIq4s+N59XGg==',key_name='tempest-keypair-1858747133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f43f32eaadfd4f7eacc418385cc5e474',ramdisk_id='',reservation_id='r-0z7o1imn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-537954646',owner_user_name='tempest-AttachVolumeNegativeTest-537954646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:49:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd74559df08d44e298ba6e2ccbaaefae',uuid=bcd29636-071b-4699-8360-e0d189df3f95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97648bc4-126c-428e-9802-98a196d6bdb6", "address": "fa:16:3e:9f:26:af", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97648bc4-12", "ovs_interfaceid": "97648bc4-126c-428e-9802-98a196d6bdb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converting VIF {"id": "97648bc4-126c-428e-9802-98a196d6bdb6", "address": "fa:16:3e:9f:26:af", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97648bc4-12", "ovs_interfaceid": "97648bc4-126c-428e-9802-98a196d6bdb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:26:af,bridge_name='br-int',has_traffic_filtering=True,id=97648bc4-126c-428e-9802-98a196d6bdb6,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97648bc4-12') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.objects.instance [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lazy-loading 'pci_devices' on Instance uuid bcd29636-071b-4699-8360-e0d189df3f95 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:49:53 user nova-compute[73258]:   <uuid>bcd29636-071b-4699-8360-e0d189df3f95</uuid>
Aug 27 06:49:53 user nova-compute[73258]:   <name>instance-00000022</name>
Aug 27 06:49:53 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:49:53 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:49:53 user nova-compute[73258]:   <metadata>
Aug 27 06:49:53 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:49:53 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:49:53 user nova-compute[73258]:       <nova:name>tempest-AttachVolumeNegativeTest-server-963997122</nova:name>
Aug 27 06:49:53 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:49:53</nova:creationTime>
Aug 27 06:49:53 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:49:53 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:49:53 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:49:53 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:49:53 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:49:53 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:49:53 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:49:53 user nova-compute[73258]:       <nova:owner>
Aug 27 06:49:53 user nova-compute[73258]:         <nova:user uuid="fd74559df08d44e298ba6e2ccbaaefae">tempest-AttachVolumeNegativeTest-537954646-project-member</nova:user>
Aug 27 06:49:53 user nova-compute[73258]:         <nova:project uuid="f43f32eaadfd4f7eacc418385cc5e474">tempest-AttachVolumeNegativeTest-537954646</nova:project>
Aug 27 06:49:53 user nova-compute[73258]:       </nova:owner>
Aug 27 06:49:53 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:49:53 user nova-compute[73258]:       <nova:ports>
Aug 27 06:49:53 user nova-compute[73258]:         <nova:port uuid="97648bc4-126c-428e-9802-98a196d6bdb6">
Aug 27 06:49:53 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 06:49:53 user nova-compute[73258]:         </nova:port>
Aug 27 06:49:53 user nova-compute[73258]:       </nova:ports>
Aug 27 06:49:53 user nova-compute[73258]:     </nova:instance>
Aug 27 06:49:53 user nova-compute[73258]:   </metadata>
Aug 27 06:49:53 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:49:53 user nova-compute[73258]:     <system>
Aug 27 06:49:53 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:49:53 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:49:53 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:49:53 user nova-compute[73258]:       <entry name="serial">bcd29636-071b-4699-8360-e0d189df3f95</entry>
Aug 27 06:49:53 user nova-compute[73258]:       <entry name="uuid">bcd29636-071b-4699-8360-e0d189df3f95</entry>
Aug 27 06:49:53 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:49:53 user nova-compute[73258]:     </system>
Aug 27 06:49:53 user nova-compute[73258]:   </sysinfo>
Aug 27 06:49:53 user nova-compute[73258]:   <os>
Aug 27 06:49:53 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:49:53 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:49:53 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:49:53 user nova-compute[73258]:   </os>
Aug 27 06:49:53 user nova-compute[73258]:   <features>
Aug 27 06:49:53 user nova-compute[73258]:     <acpi/>
Aug 27 06:49:53 user nova-compute[73258]:     <apic/>
Aug 27 06:49:53 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:49:53 user nova-compute[73258]:   </features>
Aug 27 06:49:53 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:49:53 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:49:53 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:49:53 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:49:53 user nova-compute[73258]:   </clock>
Aug 27 06:49:53 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:49:53 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:49:53 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:49:53 user nova-compute[73258]:   </cpu>
Aug 27 06:49:53 user nova-compute[73258]:   <devices>
Aug 27 06:49:53 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:49:53 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:49:53 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk"/>
Aug 27 06:49:53 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:49:53 user nova-compute[73258]:     </disk>
Aug 27 06:49:53 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:49:53 user nova-compute[73258]:       <mac address="fa:16:3e:9f:26:af"/>
Aug 27 06:49:53 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:49:53 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:49:53 user nova-compute[73258]:       <target dev="tap97648bc4-12"/>
Aug 27 06:49:53 user nova-compute[73258]:     </interface>
Aug 27 06:49:53 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:49:53 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/console.log" append="off"/>
Aug 27 06:49:53 user nova-compute[73258]:     </serial>
Aug 27 06:49:53 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:49:53 user nova-compute[73258]:     <video>
Aug 27 06:49:53 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:49:53 user nova-compute[73258]:     </video>
Aug 27 06:49:53 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:49:53 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:49:53 user nova-compute[73258]:     </rng>
Aug 27 06:49:53 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:49:53 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:49:53 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:49:53 user nova-compute[73258]:     </memballoon>
Aug 27 06:49:53 user nova-compute[73258]:   </devices>
Aug 27 06:49:53 user nova-compute[73258]: </domain>
Aug 27 06:49:53 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-963997122',display_name='tempest-AttachVolumeNegativeTest-server-963997122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-963997122',id=34,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNs5L+ew4n+dqHz4V1PvhcRY8wpZzZ3h4WCmMJVaAm1WHc2PR36LS4xicrUuNI5xRtOWpk6PGkM2dPLgfe+o2CMIFkhbFDPCBvrWQ/Ly94J7/TSJ8yCeoKZIq4s+N59XGg==',key_name='tempest-keypair-1858747133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f43f32eaadfd4f7eacc418385cc5e474',ramdisk_id='',reservation_id='r-0z7o1imn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-537954646',owner_user_name='tempest-AttachVolumeNegativeTest-537954646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:49:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd74559df08d44e298ba6e2ccbaaefae',uuid=bcd29636-071b-4699-8360-e0d189df3f95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97648bc4-126c-428e-9802-98a196d6bdb6", "address": "fa:16:3e:9f:26:af", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97648bc4-12", "ovs_interfaceid": "97648bc4-126c-428e-9802-98a196d6bdb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converting VIF {"id": "97648bc4-126c-428e-9802-98a196d6bdb6", "address": "fa:16:3e:9f:26:af", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97648bc4-12", "ovs_interfaceid": "97648bc4-126c-428e-9802-98a196d6bdb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:26:af,bridge_name='br-int',has_traffic_filtering=True,id=97648bc4-126c-428e-9802-98a196d6bdb6,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97648bc4-12') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG os_vif [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:26:af,bridge_name='br-int',has_traffic_filtering=True,id=97648bc4-126c-428e-9802-98a196d6bdb6,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97648bc4-12') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97648bc4-12, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap97648bc4-12, col_values=(('external_ids', {'iface-id': '97648bc4-126c-428e-9802-98a196d6bdb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:26:af', 'vm-uuid': 'bcd29636-071b-4699-8360-e0d189df3f95'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:53 user nova-compute[73258]: INFO os_vif [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:26:af,bridge_name='br-int',has_traffic_filtering=True,id=97648bc4-126c-428e-9802-98a196d6bdb6,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97648bc4-12')
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] No VIF found with MAC fa:16:3e:9f:26:af, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.network.neutron [req-303f3b14-3b38-4c3f-99af-4ea720ca9020 req-925c1f50-bcf2-4883-a33f-c778ba165c6a service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Updated VIF entry in instance network info cache for port 97648bc4-126c-428e-9802-98a196d6bdb6. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.network.neutron [req-303f3b14-3b38-4c3f-99af-4ea720ca9020 req-925c1f50-bcf2-4883-a33f-c778ba165c6a service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Updating instance_info_cache with network_info: [{"id": "97648bc4-126c-428e-9802-98a196d6bdb6", "address": "fa:16:3e:9f:26:af", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97648bc4-12", "ovs_interfaceid": "97648bc4-126c-428e-9802-98a196d6bdb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-303f3b14-3b38-4c3f-99af-4ea720ca9020 req-925c1f50-bcf2-4883-a33f-c778ba165c6a service nova] Releasing lock "refresh_cache-bcd29636-071b-4699-8360-e0d189df3f95" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:49:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG nova.compute.manager [req-0a7dd132-e983-4228-89a7-8399e4bb9ac1 req-f62160fd-2783-4380-a67c-9db45daf69b7 service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Received event network-vif-plugged-97648bc4-126c-428e-9802-98a196d6bdb6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0a7dd132-e983-4228-89a7-8399e4bb9ac1 req-f62160fd-2783-4380-a67c-9db45daf69b7 service nova] Acquiring lock "bcd29636-071b-4699-8360-e0d189df3f95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0a7dd132-e983-4228-89a7-8399e4bb9ac1 req-f62160fd-2783-4380-a67c-9db45daf69b7 service nova] Lock "bcd29636-071b-4699-8360-e0d189df3f95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0a7dd132-e983-4228-89a7-8399e4bb9ac1 req-f62160fd-2783-4380-a67c-9db45daf69b7 service nova] Lock "bcd29636-071b-4699-8360-e0d189df3f95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG nova.compute.manager [req-0a7dd132-e983-4228-89a7-8399e4bb9ac1 req-f62160fd-2783-4380-a67c-9db45daf69b7 service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] No waiting events found dispatching network-vif-plugged-97648bc4-126c-428e-9802-98a196d6bdb6 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:49:55 user nova-compute[73258]: WARNING nova.compute.manager [req-0a7dd132-e983-4228-89a7-8399e4bb9ac1 req-f62160fd-2783-4380-a67c-9db45daf69b7 service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Received unexpected event network-vif-plugged-97648bc4-126c-428e-9802-98a196d6bdb6 for instance with vm_state building and task_state spawning.
Aug 27 06:49:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118997.145941, bcd29636-071b-4699-8360-e0d189df3f95 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:49:57 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bcd29636-071b-4699-8360-e0d189df3f95] VM Resumed (Lifecycle Event)
Aug 27 06:49:57 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Instance spawned successfully.
Aug 27 06:49:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:49:57 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bcd29636-071b-4699-8360-e0d189df3f95] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:49:57 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693118997.1463447, bcd29636-071b-4699-8360-e0d189df3f95 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:49:57 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bcd29636-071b-4699-8360-e0d189df3f95] VM Started (Lifecycle Event)
Aug 27 06:49:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:49:57 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bcd29636-071b-4699-8360-e0d189df3f95] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:49:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:57 user nova-compute[73258]: INFO nova.compute.manager [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Took 6.09 seconds to spawn the instance on the hypervisor.
Aug 27 06:49:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:49:57 user nova-compute[73258]: INFO nova.compute.manager [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Took 7.09 seconds to build instance.
Aug 27 06:49:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796f6d61-7168-4cae-ab84-ac9adf0ba0b5 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "bcd29636-071b-4699-8360-e0d189df3f95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.196s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG nova.compute.manager [req-a1902384-6ead-4296-a950-c4604c3bbeb7 req-6e0f02a1-50e4-42bd-9f44-0d4e9874e66d service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Received event network-vif-plugged-97648bc4-126c-428e-9802-98a196d6bdb6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a1902384-6ead-4296-a950-c4604c3bbeb7 req-6e0f02a1-50e4-42bd-9f44-0d4e9874e66d service nova] Acquiring lock "bcd29636-071b-4699-8360-e0d189df3f95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a1902384-6ead-4296-a950-c4604c3bbeb7 req-6e0f02a1-50e4-42bd-9f44-0d4e9874e66d service nova] Lock "bcd29636-071b-4699-8360-e0d189df3f95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a1902384-6ead-4296-a950-c4604c3bbeb7 req-6e0f02a1-50e4-42bd-9f44-0d4e9874e66d service nova] Lock "bcd29636-071b-4699-8360-e0d189df3f95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG nova.compute.manager [req-a1902384-6ead-4296-a950-c4604c3bbeb7 req-6e0f02a1-50e4-42bd-9f44-0d4e9874e66d service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] No waiting events found dispatching network-vif-plugged-97648bc4-126c-428e-9802-98a196d6bdb6 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:49:57 user nova-compute[73258]: WARNING nova.compute.manager [req-a1902384-6ead-4296-a950-c4604c3bbeb7 req-6e0f02a1-50e4-42bd-9f44-0d4e9874e66d service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Received unexpected event network-vif-plugged-97648bc4-126c-428e-9802-98a196d6bdb6 for instance with vm_state active and task_state None.
Aug 27 06:49:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:49:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:49:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:49:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:58 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:49:58 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:49:58 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=6966MB free_disk=23.92388916015625GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:49:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:49:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1672aa9f-be6f-4357-877f-a48f62119df4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a836678e-240d-4ead-b0b5-64d146910a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9517c681-ed2b-49c2-94a6-aa2181b4b62f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 8396ca48-c47c-41b1-9872-24dbb0b9f526 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 7ee743f1-9611-4165-838e-54fccb332f1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bc3cebb3-0e29-4899-94aa-d13a2a9ca86a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance e6e96ad8-e34e-4970-b3a6-c06df0c6d994 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance ede6423b-ad91-4002-91d1-5849c6a4e26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance b22b7599-5a37-4370-b440-f04e3dc88f98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1324fcba-2b2b-4406-8527-c1585642dd94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance d409b021-ab98-4f9f-a80d-99fe05de7b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bcd29636-071b-4699-8360-e0d189df3f95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:49:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.759s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:11 user nova-compute[73258]: INFO nova.compute.manager [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Terminating instance
Aug 27 06:50:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG nova.compute.manager [req-d6037b43-396b-4709-a933-030cf7a43092 req-aacf5a5d-ab00-46ab-a480-24dcf80a3970 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received event network-vif-unplugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d6037b43-396b-4709-a933-030cf7a43092 req-aacf5a5d-ab00-46ab-a480-24dcf80a3970 service nova] Acquiring lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d6037b43-396b-4709-a933-030cf7a43092 req-aacf5a5d-ab00-46ab-a480-24dcf80a3970 service nova] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d6037b43-396b-4709-a933-030cf7a43092 req-aacf5a5d-ab00-46ab-a480-24dcf80a3970 service nova] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG nova.compute.manager [req-d6037b43-396b-4709-a933-030cf7a43092 req-aacf5a5d-ab00-46ab-a480-24dcf80a3970 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] No waiting events found dispatching network-vif-unplugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG nova.compute.manager [req-d6037b43-396b-4709-a933-030cf7a43092 req-aacf5a5d-ab00-46ab-a480-24dcf80a3970 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received event network-vif-unplugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:50:11 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Instance destroyed successfully.
Aug 27 06:50:11 user nova-compute[73258]: DEBUG nova.objects.instance [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lazy-loading 'resources' on Instance uuid e6e96ad8-e34e-4970-b3a6-c06df0c6d994 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T06:44:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-133269916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-133269916',id=24,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPhZgvMlZKszgmkJRdB2Td8QkZ+kehRxdRcco72ikdAPBqgA1064wic3jyDjgqQp2aKcq+6YzjRXdUerPFbWzpsTYXbn26mHdAkPlLsA+z50REBPVUDwI0jEOuRNEDA4w==',key_name='tempest-keypair-45658026',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:48:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='235a4f958e494352aaa119a4d44a52c5',ramdisk_id='',reservation_id='r-qf0qib1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1261077306',owner_user_name='tempest-AttachVolumeShelveTestJSON-1261077306-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:48:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff1f51bb7163499c94ebbc93a051b4df',uuid=e6e96ad8-e34e-4970-b3a6-c06df0c6d994,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converting VIF {"id": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "address": "fa:16:3e:34:ae:e2", "network": {"id": "4a947b0f-a26a-4592-92f6-8c7edd6ba7df", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1418152215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "235a4f958e494352aaa119a4d44a52c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc4351a6-f0", "ovs_interfaceid": "fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:ae:e2,bridge_name='br-int',has_traffic_filtering=True,id=fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4351a6-f0') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG os_vif [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:ae:e2,bridge_name='br-int',has_traffic_filtering=True,id=fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4351a6-f0') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc4351a6-f0, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:50:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:11 user nova-compute[73258]: INFO os_vif [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:ae:e2,bridge_name='br-int',has_traffic_filtering=True,id=fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7,network=Network(4a947b0f-a26a-4592-92f6-8c7edd6ba7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc4351a6-f0')
Aug 27 06:50:11 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Deleting instance files /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994_del
Aug 27 06:50:11 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Deletion of /opt/stack/data/nova/instances/e6e96ad8-e34e-4970-b3a6-c06df0c6d994_del complete
Aug 27 06:50:12 user nova-compute[73258]: INFO nova.compute.manager [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 27 06:50:12 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:50:12 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:50:12 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:50:13 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:50:13 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Took 1.31 seconds to deallocate network for instance.
Aug 27 06:50:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-6117c8ca-a1e2-4d51-b71e-34a50146550f req-b20a375f-1ea3-4650-b042-219dcf772f32 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received event network-vif-deleted-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:50:13 user nova-compute[73258]: INFO nova.compute.manager [req-6117c8ca-a1e2-4d51-b71e-34a50146550f req-b20a375f-1ea3-4650-b042-219dcf772f32 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Neutron deleted interface fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7; detaching it from the instance and deleting it from the info cache
Aug 27 06:50:13 user nova-compute[73258]: DEBUG nova.network.neutron [req-6117c8ca-a1e2-4d51-b71e-34a50146550f req-b20a375f-1ea3-4650-b042-219dcf772f32 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:50:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-6117c8ca-a1e2-4d51-b71e-34a50146550f req-b20a375f-1ea3-4650-b042-219dcf772f32 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Detach interface failed, port_id=fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7, reason: Instance e6e96ad8-e34e-4970-b3a6-c06df0c6d994 could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:50:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-83a3d44e-a574-4484-93fd-5f736bbedace req-126ca311-e13c-4285-a491-93730757b9a3 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received event network-vif-plugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:50:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-83a3d44e-a574-4484-93fd-5f736bbedace req-126ca311-e13c-4285-a491-93730757b9a3 service nova] Acquiring lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-83a3d44e-a574-4484-93fd-5f736bbedace req-126ca311-e13c-4285-a491-93730757b9a3 service nova] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-83a3d44e-a574-4484-93fd-5f736bbedace req-126ca311-e13c-4285-a491-93730757b9a3 service nova] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-83a3d44e-a574-4484-93fd-5f736bbedace req-126ca311-e13c-4285-a491-93730757b9a3 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] No waiting events found dispatching network-vif-plugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:50:13 user nova-compute[73258]: WARNING nova.compute.manager [req-83a3d44e-a574-4484-93fd-5f736bbedace req-126ca311-e13c-4285-a491-93730757b9a3 service nova] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Received unexpected event network-vif-plugged-fc4351a6-f0bf-4d9f-a223-ad21e0b63fd7 for instance with vm_state deleted and task_state None.
Aug 27 06:50:13 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:50:13 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:50:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.522s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:13 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Deleted allocations for instance e6e96ad8-e34e-4970-b3a6-c06df0c6d994
Aug 27 06:50:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-963fe5da-4010-483b-a989-84871cc9ef72 tempest-AttachVolumeShelveTestJSON-1261077306 tempest-AttachVolumeShelveTestJSON-1261077306-project-member] Lock "e6e96ad8-e34e-4970-b3a6-c06df0c6d994" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.744s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:26 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119011.9011323, e6e96ad8-e34e-4970-b3a6-c06df0c6d994 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:50:26 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] VM Stopped (Lifecycle Event)
Aug 27 06:50:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-674e858d-f2e1-41d5-9ba7-f2dfd4403151 None None] [instance: e6e96ad8-e34e-4970-b3a6-c06df0c6d994] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:50:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:31 user nova-compute[73258]: DEBUG nova.compute.manager [req-e4ac0156-1859-44c3-a261-7149bbf9107d req-72947b8e-cd0e-4006-947d-d18173122b58 service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Received event network-changed-f2f7670e-c9a1-437f-8143-4f7cfc60a035 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:50:31 user nova-compute[73258]: DEBUG nova.compute.manager [req-e4ac0156-1859-44c3-a261-7149bbf9107d req-72947b8e-cd0e-4006-947d-d18173122b58 service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Refreshing instance network info cache due to event network-changed-f2f7670e-c9a1-437f-8143-4f7cfc60a035. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:50:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e4ac0156-1859-44c3-a261-7149bbf9107d req-72947b8e-cd0e-4006-947d-d18173122b58 service nova] Acquiring lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:50:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e4ac0156-1859-44c3-a261-7149bbf9107d req-72947b8e-cd0e-4006-947d-d18173122b58 service nova] Acquired lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:50:31 user nova-compute[73258]: DEBUG nova.network.neutron [req-e4ac0156-1859-44c3-a261-7149bbf9107d req-72947b8e-cd0e-4006-947d-d18173122b58 service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Refreshing network info cache for port f2f7670e-c9a1-437f-8143-4f7cfc60a035 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:50:31 user nova-compute[73258]: DEBUG nova.network.neutron [req-e4ac0156-1859-44c3-a261-7149bbf9107d req-72947b8e-cd0e-4006-947d-d18173122b58 service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Updated VIF entry in instance network info cache for port f2f7670e-c9a1-437f-8143-4f7cfc60a035. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:50:31 user nova-compute[73258]: DEBUG nova.network.neutron [req-e4ac0156-1859-44c3-a261-7149bbf9107d req-72947b8e-cd0e-4006-947d-d18173122b58 service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Updating instance_info_cache with network_info: [{"id": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "address": "fa:16:3e:82:0b:22", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f7670e-c9", "ovs_interfaceid": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:50:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e4ac0156-1859-44c3-a261-7149bbf9107d req-72947b8e-cd0e-4006-947d-d18173122b58 service nova] Releasing lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:50:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Stashing vm_state: active {{(pid=73258) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 27 06:50:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:33 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:50:33 user nova-compute[73258]: INFO nova.compute.claims [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Claim successful on node user
Aug 27 06:50:33 user nova-compute[73258]: INFO nova.compute.resource_tracker [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Updating resource usage from migration 886cc733-8b90-4710-adf4-c1b165a4eb91
Aug 27 06:50:33 user nova-compute[73258]: DEBUG nova.compute.manager [req-f370657e-ef07-45ce-8b45-eb6f524d62f1 req-ae78d31b-f0e9-47fe-8191-4231a06fdf33 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Received event network-changed-0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:50:33 user nova-compute[73258]: DEBUG nova.compute.manager [req-f370657e-ef07-45ce-8b45-eb6f524d62f1 req-ae78d31b-f0e9-47fe-8191-4231a06fdf33 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Refreshing instance network info cache due to event network-changed-0d7639f1-aadd-4f15-9292-8cef2591ce8d. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:50:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f370657e-ef07-45ce-8b45-eb6f524d62f1 req-ae78d31b-f0e9-47fe-8191-4231a06fdf33 service nova] Acquiring lock "refresh_cache-ede6423b-ad91-4002-91d1-5849c6a4e26b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:50:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f370657e-ef07-45ce-8b45-eb6f524d62f1 req-ae78d31b-f0e9-47fe-8191-4231a06fdf33 service nova] Acquired lock "refresh_cache-ede6423b-ad91-4002-91d1-5849c6a4e26b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:50:33 user nova-compute[73258]: DEBUG nova.network.neutron [req-f370657e-ef07-45ce-8b45-eb6f524d62f1 req-ae78d31b-f0e9-47fe-8191-4231a06fdf33 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Refreshing network info cache for port 0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:50:33 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:50:33 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:50:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.553s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:33 user nova-compute[73258]: INFO nova.compute.manager [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Migrating
Aug 27 06:50:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:50:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:50:33 user nova-compute[73258]: INFO nova.compute.rpcapi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 27 06:50:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:50:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "refresh_cache-ede6423b-ad91-4002-91d1-5849c6a4e26b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:50:34 user nova-compute[73258]: DEBUG nova.network.neutron [req-f370657e-ef07-45ce-8b45-eb6f524d62f1 req-ae78d31b-f0e9-47fe-8191-4231a06fdf33 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Updated VIF entry in instance network info cache for port 0d7639f1-aadd-4f15-9292-8cef2591ce8d. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:50:34 user nova-compute[73258]: DEBUG nova.network.neutron [req-f370657e-ef07-45ce-8b45-eb6f524d62f1 req-ae78d31b-f0e9-47fe-8191-4231a06fdf33 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Updating instance_info_cache with network_info: [{"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:50:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f370657e-ef07-45ce-8b45-eb6f524d62f1 req-ae78d31b-f0e9-47fe-8191-4231a06fdf33 service nova] Releasing lock "refresh_cache-ede6423b-ad91-4002-91d1-5849c6a4e26b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:50:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquired lock "refresh_cache-ede6423b-ad91-4002-91d1-5849c6a4e26b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:50:34 user nova-compute[73258]: DEBUG nova.network.neutron [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:50:34 user nova-compute[73258]: DEBUG nova.network.neutron [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Updating instance_info_cache with network_info: [{"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:50:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Releasing lock "refresh_cache-ede6423b-ad91-4002-91d1-5849c6a4e26b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:50:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Starting migrate_disk_and_power_off {{(pid=73258) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 27 06:50:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-a9b36b29-5ecb-418f-b799-a8ee68e22068 req-c7b23c97-0ed2-4a19-9fb9-9c305f81c29c service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Received event network-vif-unplugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a9b36b29-5ecb-418f-b799-a8ee68e22068 req-c7b23c97-0ed2-4a19-9fb9-9c305f81c29c service nova] Acquiring lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a9b36b29-5ecb-418f-b799-a8ee68e22068 req-c7b23c97-0ed2-4a19-9fb9-9c305f81c29c service nova] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a9b36b29-5ecb-418f-b799-a8ee68e22068 req-c7b23c97-0ed2-4a19-9fb9-9c305f81c29c service nova] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-a9b36b29-5ecb-418f-b799-a8ee68e22068 req-c7b23c97-0ed2-4a19-9fb9-9c305f81c29c service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] No waiting events found dispatching network-vif-unplugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:50:35 user nova-compute[73258]: WARNING nova.compute.manager [req-a9b36b29-5ecb-418f-b799-a8ee68e22068 req-c7b23c97-0ed2-4a19-9fb9-9c305f81c29c service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Received unexpected event network-vif-unplugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d for instance with vm_state active and task_state resize_migrating.
Aug 27 06:50:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:35 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Instance destroyed successfully.
Aug 27 06:50:35 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:48:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-247234727',display_name='tempest-ServerActionsTestOtherA-server-247234727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-247234727',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/KYWUE6gNqqFSSqcTnsAI5+JZTptdXjLfwtgiVKLM8n2N6Y2L8s6Bg81l6XDxMjw3BfYNizv1BnMF+y6NIh1U/xVCMRNK16iGCh/62JzPGiCS6K24meGZJ+ETPM0mnhw==',key_name='tempest-keypair-1255305482',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='57faf7cb6c704c05aba06857a6cdd29f',ramdisk_id='',reservation_id='r-lb0avote',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1477462030',owner_user_name='tempest-ServerActionsTestOtherA-1477462030-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:50:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f8a06ab5634f60b6ed2d1d9b2c342e',uuid=ede6423b-ad91-4002-91d1-5849c6a4e26b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-519427619-network", "vif_mac": "fa:16:3e:a4:da:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converting VIF {"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-519427619-network", "vif_mac": "fa:16:3e:a4:da:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:da:75,bridge_name='br-int',has_traffic_filtering=True,id=0d7639f1-aadd-4f15-9292-8cef2591ce8d,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7639f1-aa') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_vif [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:da:75,bridge_name='br-int',has_traffic_filtering=True,id=0d7639f1-aadd-4f15-9292-8cef2591ce8d,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7639f1-aa') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d7639f1-aa, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:35 user nova-compute[73258]: INFO os_vif [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:da:75,bridge_name='br-int',has_traffic_filtering=True,id=0d7639f1-aadd-4f15-9292-8cef2591ce8d,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7639f1-aa')
Aug 27 06:50:35 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaSCwxVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:50:35 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ddb02a-6f88-47b5-9a47-301b673961a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[522f96b2-7be5-4347-aa8e-cf3ef0a59674]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:50:35 user nova-compute[73258]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:50:35 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:50:35 user nova-compute[73258]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:50:35 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa44d3d4280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85e42cb-a25a-45f6-b4c0-75d5eb2fd841]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2d31eb-fd3c-4d65-bec1-e95ef784c938]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9472b0f-fc42-4e69-90c8-9affb6e7e71e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98c5962-de36-4b58-bcea-b6270ebb1688]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23432386439373366', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_82a47ec7', '/dev/disk/by-id/scsi-1SCST_BIO82a47ec7-428d973f48766a08') {{(pid=84389) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cf1a1d-ade6-4083-a671-01fcc22b1cf3]: (4, None) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9f8f79-4e0c-4fb3-9381-88368cefa128]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7f1961-86a2-4bbe-b7cb-ee03c370227d]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550, portal: 172.16.0.220,3260]
Aug 27 06:50:35 user nova-compute[73258]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550, portal: 172.16.0.220,3260] successful.
Aug 27 06:50:35 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59fbe0e-d171-4bdb-a333-a99e0afad4fc]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] <== disconnect_volume: return (303ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:50:35 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:50:36 user nova-compute[73258]: DEBUG nova.network.neutron [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Port 0d7639f1-aadd-4f15-9292-8cef2591ce8d binding to destination host user is already ACTIVE {{(pid=73258) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "refresh_cache-ede6423b-ad91-4002-91d1-5849c6a4e26b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquired lock "refresh_cache-ede6423b-ad91-4002-91d1-5849c6a4e26b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG nova.network.neutron [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG nova.compute.manager [req-8c6de342-ce92-4f4b-8e94-d2b40183213d req-2fdfe1eb-858b-4db5-b342-118ba6aaf640 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Received event network-vif-plugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8c6de342-ce92-4f4b-8e94-d2b40183213d req-2fdfe1eb-858b-4db5-b342-118ba6aaf640 service nova] Acquiring lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8c6de342-ce92-4f4b-8e94-d2b40183213d req-2fdfe1eb-858b-4db5-b342-118ba6aaf640 service nova] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8c6de342-ce92-4f4b-8e94-d2b40183213d req-2fdfe1eb-858b-4db5-b342-118ba6aaf640 service nova] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG nova.compute.manager [req-8c6de342-ce92-4f4b-8e94-d2b40183213d req-2fdfe1eb-858b-4db5-b342-118ba6aaf640 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] No waiting events found dispatching network-vif-plugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:50:37 user nova-compute[73258]: WARNING nova.compute.manager [req-8c6de342-ce92-4f4b-8e94-d2b40183213d req-2fdfe1eb-858b-4db5-b342-118ba6aaf640 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Received unexpected event network-vif-plugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d for instance with vm_state active and task_state resize_migrated.
Aug 27 06:50:37 user nova-compute[73258]: DEBUG nova.network.neutron [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Updating instance_info_cache with network_info: [{"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Releasing lock "refresh_cache-ede6423b-ad91-4002-91d1-5849c6a4e26b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG os_brick.utils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca2ca9b-64ae-4da8-b211-5046d304fd76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c3769b-d35f-47b1-bd5e-7755a959e8b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5d5632-52c4-4023-bd01-32358931de16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ca3982-0929-4496-8cec-36459714bf0f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:50:37 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:50:37 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05099f1-96c0-45f8-968f-94ee1383598a]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:50:37 user nova-compute[73258]: DEBUG os_brick.utils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:50:38 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:38 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:38 user nova-compute[73258]: DEBUG nova.compute.manager [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:50:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:39 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:50:39 user nova-compute[73258]: INFO nova.compute.claims [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Claim successful on node user
Aug 27 06:50:39 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:50:39 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:50:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:50:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:50:39 user nova-compute[73258]: DEBUG nova.network.neutron [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:50:39 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:50:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:50:39 user nova-compute[73258]: DEBUG nova.policy [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36c0faed29a446aa9fa6ff8692581aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cf34590d8d4b8b89b9626c6e150df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:50:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:50:39 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:50:39 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Creating image(s)
Aug 27 06:50:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "/opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "/opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "/opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.172s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk 1073741824" returned: 0 in 0.055s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.177s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Checking if we can resize image /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Cannot resize image /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Ensure instance console log exists: /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:40 user nova-compute[73258]: DEBUG nova.network.neutron [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Successfully created port: 7652cd00-a6c7-4a33-8a78-4feb11948b71 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.network.neutron [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Successfully updated port: 7652cd00-a6c7-4a33-8a78-4feb11948b71 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "refresh_cache-686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquired lock "refresh_cache-686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.network.neutron [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.compute.manager [req-ac50f647-e9d1-4e91-8279-49890bfb88ba req-1c05623a-35aa-467c-bdf4-645b2138e536 service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Received event network-changed-7652cd00-a6c7-4a33-8a78-4feb11948b71 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.compute.manager [req-ac50f647-e9d1-4e91-8279-49890bfb88ba req-1c05623a-35aa-467c-bdf4-645b2138e536 service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Refreshing instance network info cache due to event network-changed-7652cd00-a6c7-4a33-8a78-4feb11948b71. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ac50f647-e9d1-4e91-8279-49890bfb88ba req-1c05623a-35aa-467c-bdf4-645b2138e536 service nova] Acquiring lock "refresh_cache-686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.network.neutron [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.network.neutron [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Updating instance_info_cache with network_info: [{"id": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "address": "fa:16:3e:6f:e0:41", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7652cd00-a6", "ovs_interfaceid": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Releasing lock "refresh_cache-686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Instance network_info: |[{"id": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "address": "fa:16:3e:6f:e0:41", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7652cd00-a6", "ovs_interfaceid": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ac50f647-e9d1-4e91-8279-49890bfb88ba req-1c05623a-35aa-467c-bdf4-645b2138e536 service nova] Acquired lock "refresh_cache-686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.network.neutron [req-ac50f647-e9d1-4e91-8279-49890bfb88ba req-1c05623a-35aa-467c-bdf4-645b2138e536 service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Refreshing network info cache for port 7652cd00-a6c7-4a33-8a78-4feb11948b71 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Start _get_guest_xml network_info=[{"id": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "address": "fa:16:3e:6f:e0:41", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7652cd00-a6", "ovs_interfaceid": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:50:41 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:50:41 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-563501826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-563501826',id=35,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81cf34590d8d4b8b89b9626c6e150df6',ramdisk_id='',reservation_id='r-iwuu71a9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:50:40Z,user_data=None,user_id='36c0faed29a446aa9fa6ff8692581aba',uuid=686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "address": "fa:16:3e:6f:e0:41", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7652cd00-a6", "ovs_interfaceid": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converting VIF {"id": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "address": "fa:16:3e:6f:e0:41", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7652cd00-a6", "ovs_interfaceid": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:e0:41,bridge_name='br-int',has_traffic_filtering=True,id=7652cd00-a6c7-4a33-8a78-4feb11948b71,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7652cd00-a6') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.objects.instance [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'pci_devices' on Instance uuid 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:50:41 user nova-compute[73258]:   <uuid>686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5</uuid>
Aug 27 06:50:41 user nova-compute[73258]:   <name>instance-00000023</name>
Aug 27 06:50:41 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:50:41 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:50:41 user nova-compute[73258]:   <metadata>
Aug 27 06:50:41 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:50:41 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:50:41 user nova-compute[73258]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-563501826</nova:name>
Aug 27 06:50:41 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:50:41</nova:creationTime>
Aug 27 06:50:41 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:50:41 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:50:41 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:50:41 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:50:41 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:50:41 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:50:41 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:50:41 user nova-compute[73258]:       <nova:owner>
Aug 27 06:50:41 user nova-compute[73258]:         <nova:user uuid="36c0faed29a446aa9fa6ff8692581aba">tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member</nova:user>
Aug 27 06:50:41 user nova-compute[73258]:         <nova:project uuid="81cf34590d8d4b8b89b9626c6e150df6">tempest-ServerBootFromVolumeStableRescueTest-1306655557</nova:project>
Aug 27 06:50:41 user nova-compute[73258]:       </nova:owner>
Aug 27 06:50:41 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:50:41 user nova-compute[73258]:       <nova:ports>
Aug 27 06:50:41 user nova-compute[73258]:         <nova:port uuid="7652cd00-a6c7-4a33-8a78-4feb11948b71">
Aug 27 06:50:41 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 06:50:41 user nova-compute[73258]:         </nova:port>
Aug 27 06:50:41 user nova-compute[73258]:       </nova:ports>
Aug 27 06:50:41 user nova-compute[73258]:     </nova:instance>
Aug 27 06:50:41 user nova-compute[73258]:   </metadata>
Aug 27 06:50:41 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:50:41 user nova-compute[73258]:     <system>
Aug 27 06:50:41 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:50:41 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:50:41 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:50:41 user nova-compute[73258]:       <entry name="serial">686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5</entry>
Aug 27 06:50:41 user nova-compute[73258]:       <entry name="uuid">686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5</entry>
Aug 27 06:50:41 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:50:41 user nova-compute[73258]:     </system>
Aug 27 06:50:41 user nova-compute[73258]:   </sysinfo>
Aug 27 06:50:41 user nova-compute[73258]:   <os>
Aug 27 06:50:41 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:50:41 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:50:41 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:50:41 user nova-compute[73258]:   </os>
Aug 27 06:50:41 user nova-compute[73258]:   <features>
Aug 27 06:50:41 user nova-compute[73258]:     <acpi/>
Aug 27 06:50:41 user nova-compute[73258]:     <apic/>
Aug 27 06:50:41 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:50:41 user nova-compute[73258]:   </features>
Aug 27 06:50:41 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:50:41 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:50:41 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:50:41 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:50:41 user nova-compute[73258]:   </clock>
Aug 27 06:50:41 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:50:41 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:50:41 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:50:41 user nova-compute[73258]:   </cpu>
Aug 27 06:50:41 user nova-compute[73258]:   <devices>
Aug 27 06:50:41 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:50:41 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:50:41 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk"/>
Aug 27 06:50:41 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:50:41 user nova-compute[73258]:     </disk>
Aug 27 06:50:41 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:50:41 user nova-compute[73258]:       <mac address="fa:16:3e:6f:e0:41"/>
Aug 27 06:50:41 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:50:41 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:50:41 user nova-compute[73258]:       <target dev="tap7652cd00-a6"/>
Aug 27 06:50:41 user nova-compute[73258]:     </interface>
Aug 27 06:50:41 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:50:41 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/console.log" append="off"/>
Aug 27 06:50:41 user nova-compute[73258]:     </serial>
Aug 27 06:50:41 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:50:41 user nova-compute[73258]:     <video>
Aug 27 06:50:41 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:50:41 user nova-compute[73258]:     </video>
Aug 27 06:50:41 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:50:41 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:50:41 user nova-compute[73258]:     </rng>
Aug 27 06:50:41 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:50:41 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:50:41 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:50:41 user nova-compute[73258]:     </memballoon>
Aug 27 06:50:41 user nova-compute[73258]:   </devices>
Aug 27 06:50:41 user nova-compute[73258]: </domain>
Aug 27 06:50:41 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-563501826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-563501826',id=35,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81cf34590d8d4b8b89b9626c6e150df6',ramdisk_id='',reservation_id='r-iwuu71a9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:50:40Z,user_data=None,user_id='36c0faed29a446aa9fa6ff8692581aba',uuid=686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "address": "fa:16:3e:6f:e0:41", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7652cd00-a6", "ovs_interfaceid": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converting VIF {"id": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "address": "fa:16:3e:6f:e0:41", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7652cd00-a6", "ovs_interfaceid": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:e0:41,bridge_name='br-int',has_traffic_filtering=True,id=7652cd00-a6c7-4a33-8a78-4feb11948b71,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7652cd00-a6') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG os_vif [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:e0:41,bridge_name='br-int',has_traffic_filtering=True,id=7652cd00-a6c7-4a33-8a78-4feb11948b71,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7652cd00-a6') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7652cd00-a6, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7652cd00-a6, col_values=(('external_ids', {'iface-id': '7652cd00-a6c7-4a33-8a78-4feb11948b71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:e0:41', 'vm-uuid': '686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:50:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:41 user nova-compute[73258]: INFO os_vif [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:e0:41,bridge_name='br-int',has_traffic_filtering=True,id=7652cd00-a6c7-4a33-8a78-4feb11948b71,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7652cd00-a6')
Aug 27 06:50:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:50:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] No VIF found with MAC fa:16:3e:6f:e0:41, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:50:42 user nova-compute[73258]: DEBUG nova.network.neutron [req-ac50f647-e9d1-4e91-8279-49890bfb88ba req-1c05623a-35aa-467c-bdf4-645b2138e536 service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Updated VIF entry in instance network info cache for port 7652cd00-a6c7-4a33-8a78-4feb11948b71. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:50:42 user nova-compute[73258]: DEBUG nova.network.neutron [req-ac50f647-e9d1-4e91-8279-49890bfb88ba req-1c05623a-35aa-467c-bdf4-645b2138e536 service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Updating instance_info_cache with network_info: [{"id": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "address": "fa:16:3e:6f:e0:41", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7652cd00-a6", "ovs_interfaceid": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:50:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ac50f647-e9d1-4e91-8279-49890bfb88ba req-1c05623a-35aa-467c-bdf4-645b2138e536 service nova] Releasing lock "refresh_cache-686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:50:42 user nova-compute[73258]: DEBUG nova.compute.manager [req-96be29ea-6c39-407b-91b4-c386fe11ccb7 req-d0ba667b-48d5-4c71-8a76-37d5d909c4d4 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received event network-changed-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:50:42 user nova-compute[73258]: DEBUG nova.compute.manager [req-96be29ea-6c39-407b-91b4-c386fe11ccb7 req-d0ba667b-48d5-4c71-8a76-37d5d909c4d4 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Refreshing instance network info cache due to event network-changed-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:50:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-96be29ea-6c39-407b-91b4-c386fe11ccb7 req-d0ba667b-48d5-4c71-8a76-37d5d909c4d4 service nova] Acquiring lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:50:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-96be29ea-6c39-407b-91b4-c386fe11ccb7 req-d0ba667b-48d5-4c71-8a76-37d5d909c4d4 service nova] Acquired lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:50:42 user nova-compute[73258]: DEBUG nova.network.neutron [req-96be29ea-6c39-407b-91b4-c386fe11ccb7 req-d0ba667b-48d5-4c71-8a76-37d5d909c4d4 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Refreshing network info cache for port 8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "b22b7599-5a37-4370-b440-f04e3dc88f98" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG nova.objects.instance [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'flavor' on Instance uuid b22b7599-5a37-4370-b440-f04e3dc88f98 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "b22b7599-5a37-4370-b440-f04e3dc88f98" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:43 user nova-compute[73258]: INFO nova.compute.manager [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Attaching volume b803adad-6f72-4910-b65c-6d62cb5d30b8 to /dev/vdb
Aug 27 06:50:43 user nova-compute[73258]: DEBUG os_brick.utils [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51611af-c174-40a4-aa9b-db2418816b1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ba9443-953a-479b-ba01-af9dd70a86b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[06211a9f-0994-41e6-8006-0a65f10c7404]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f697adb-5bff-45d3-a709-82fde7def3e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG nova.network.neutron [req-96be29ea-6c39-407b-91b4-c386fe11ccb7 req-d0ba667b-48d5-4c71-8a76-37d5d909c4d4 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Updated VIF entry in instance network info cache for port 8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG nova.network.neutron [req-96be29ea-6c39-407b-91b4-c386fe11ccb7 req-d0ba667b-48d5-4c71-8a76-37d5d909c4d4 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Updating instance_info_cache with network_info: [{"id": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "address": "fa:16:3e:2a:36:5c", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e94cae8-ea", "ovs_interfaceid": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:50:43 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff822501-736b-4f53-942b-b0b6aca8ba9a]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG os_brick.utils [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Updating existing volume attachment record: f9350be3-60ea-41b0-a0ca-fd1ae8985685 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-96be29ea-6c39-407b-91b4-c386fe11ccb7 req-d0ba667b-48d5-4c71-8a76-37d5d909c4d4 service nova] Releasing lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-1aa00bf8-87fd-415f-ba23-0c8c7917fd3b req-48a1fb94-d0ae-458c-ae66-2961a8f55b5e service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Received event network-vif-plugged-7652cd00-a6c7-4a33-8a78-4feb11948b71 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1aa00bf8-87fd-415f-ba23-0c8c7917fd3b req-48a1fb94-d0ae-458c-ae66-2961a8f55b5e service nova] Acquiring lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1aa00bf8-87fd-415f-ba23-0c8c7917fd3b req-48a1fb94-d0ae-458c-ae66-2961a8f55b5e service nova] Lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1aa00bf8-87fd-415f-ba23-0c8c7917fd3b req-48a1fb94-d0ae-458c-ae66-2961a8f55b5e service nova] Lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-1aa00bf8-87fd-415f-ba23-0c8c7917fd3b req-48a1fb94-d0ae-458c-ae66-2961a8f55b5e service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] No waiting events found dispatching network-vif-plugged-7652cd00-a6c7-4a33-8a78-4feb11948b71 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:50:43 user nova-compute[73258]: WARNING nova.compute.manager [req-1aa00bf8-87fd-415f-ba23-0c8c7917fd3b req-48a1fb94-d0ae-458c-ae66-2961a8f55b5e service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Received unexpected event network-vif-plugged-7652cd00-a6c7-4a33-8a78-4feb11948b71 for instance with vm_state building and task_state spawning.
Aug 27 06:50:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:45 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119045.5373044, 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:50:45 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] VM Resumed (Lifecycle Event)
Aug 27 06:50:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:50:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:50:45 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Instance spawned successfully.
Aug 27 06:50:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:50:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:50:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:50:45 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:50:45 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119045.5393853, 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:50:45 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] VM Started (Lifecycle Event)
Aug 27 06:50:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:50:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:50:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:50:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:50:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:50:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:50:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:50:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:50:45 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:50:45 user nova-compute[73258]: INFO nova.compute.manager [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Took 5.83 seconds to spawn the instance on the hypervisor.
Aug 27 06:50:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:50:45 user nova-compute[73258]: INFO nova.compute.manager [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Took 6.77 seconds to build instance.
Aug 27 06:50:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66a93daf-a0e1-4d60-8298-a1622967fbd5 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.876s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:45 user nova-compute[73258]: DEBUG nova.compute.manager [req-60240118-3239-4b27-8bec-6bf6d0bb16fe req-cd39048f-de7f-4b44-83bc-db5a0bea7966 service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Received event network-vif-plugged-7652cd00-a6c7-4a33-8a78-4feb11948b71 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:50:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-60240118-3239-4b27-8bec-6bf6d0bb16fe req-cd39048f-de7f-4b44-83bc-db5a0bea7966 service nova] Acquiring lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-60240118-3239-4b27-8bec-6bf6d0bb16fe req-cd39048f-de7f-4b44-83bc-db5a0bea7966 service nova] Lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-60240118-3239-4b27-8bec-6bf6d0bb16fe req-cd39048f-de7f-4b44-83bc-db5a0bea7966 service nova] Lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:45 user nova-compute[73258]: DEBUG nova.compute.manager [req-60240118-3239-4b27-8bec-6bf6d0bb16fe req-cd39048f-de7f-4b44-83bc-db5a0bea7966 service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] No waiting events found dispatching network-vif-plugged-7652cd00-a6c7-4a33-8a78-4feb11948b71 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:50:45 user nova-compute[73258]: WARNING nova.compute.manager [req-60240118-3239-4b27-8bec-6bf6d0bb16fe req-cd39048f-de7f-4b44-83bc-db5a0bea7966 service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Received unexpected event network-vif-plugged-7652cd00-a6c7-4a33-8a78-4feb11948b71 for instance with vm_state active and task_state None.
Aug 27 06:50:46 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:50:46 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:50:46 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:50:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-a836678e-240d-4ead-b0b5-64d146910a23" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:50:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-a836678e-240d-4ead-b0b5-64d146910a23" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:50:46 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:50:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:47 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Updating instance_info_cache with network_info: [{"id": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "address": "fa:16:3e:00:0b:2b", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eae0f1e-d6", "ovs_interfaceid": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:50:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-a836678e-240d-4ead-b0b5-64d146910a23" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:50:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:50:47 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:50:47 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:50:47 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:50:47 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:50:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:50:47 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:50:47 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Starting finish_migration {{(pid=73258) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Instance directory exists: not creating {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 06:50:49 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Creating image(s)
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Did not create local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Ensure instance console log exists: /opt/stack/data/nova/instances/ede6423b-ad91-4002-91d1-5849c6a4e26b/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Start _get_guest_xml network_info=[{"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-519427619-network", "vif_mac": "fa:16:3e:a4:da:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaSCwxVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ede6423b-ad91-4002-91d1-5849c6a4e26b', 'attached_at': '2023-08-27T06:50:49.000000', 'detached_at': '', 'volume_id': 'c199006a-92aa-4e38-8f04-059c7642b550', 'serial': 'c199006a-92aa-4e38-8f04-059c7642b550'}, 'attachment_id': 'a9da682e-7dfc-442e-b5a5-e892a5eb7773', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:50:49 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:50:49 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaSCwxVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:50:49 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:50:49 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:50:49 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89a0256-98fb-4d9e-a920-0c6843b457d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:50:49 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f2b142-dd47-4fd3-a752-63b295c791ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550] added
Aug 27 06:50:49 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[71983f73-b910-4c09-9dac-4405a3fbd417]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f56141-1dcd-48ff-a51c-cdfa8d5852e0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaSCwxVA {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yaSCwxVA" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e530449-fe6b-4520-bf0b-3b79eb1e9f36]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yaSCwxVA'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[262e80df-0e35-4b2d-992e-89f29da963ac]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c8041e-7370-4924-8848-58847d86ffce]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:50:49 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:50:49 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4962aa4a-6ed3-4263-a939-a4f176d03f15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550, portal: 172.16.0.220,3260]
Aug 27 06:50:49 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550, portal: 172.16.0.220,3260] successful.
Aug 27 06:50:49 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace3c7da-3130-44eb-99c9-cc8bcb798e99]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bea82c-6e0d-43a8-91d3-c6897e030432]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:50:49 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:50:49 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:50:49 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:50:49 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f00a8c-03e6-4503-92e0-a0dd49c6809f]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:50:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaSCwxVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119035.5425513, ede6423b-ad91-4002-91d1-5849c6a4e26b => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:50:50 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] VM Stopped (Lifecycle Event)
Aug 27 06:50:50 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e8ae4a74-6b7b-4f94-b9a7-13c73a135158 None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e8ae4a74-6b7b-4f94-b9a7-13c73a135158 None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:50:50 user nova-compute[73258]: INFO nova.compute.manager [None req-e8ae4a74-6b7b-4f94-b9a7-13c73a135158 None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 06:50:50 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23432386439373366', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432386439373366', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:48:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-247234727',display_name='tempest-ServerActionsTestOtherA-server-247234727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-247234727',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/KYWUE6gNqqFSSqcTnsAI5+JZTptdXjLfwtgiVKLM8n2N6Y2L8s6Bg81l6XDxMjw3BfYNizv1BnMF+y6NIh1U/xVCMRNK16iGCh/62JzPGiCS6K24meGZJ+ETPM0mnhw==',key_name='tempest-keypair-1255305482',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='57faf7cb6c704c05aba06857a6cdd29f',ramdisk_id='',reservation_id='r-lb0avote',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1477462030',owner_user_name='tempest-ServerActionsTestOtherA-1477462030-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:50:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f8a06ab5634f60b6ed2d1d9b2c342e',uuid=ede6423b-ad91-4002-91d1-5849c6a4e26b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-519427619-network", "vif_mac": "fa:16:3e:a4:da:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converting VIF {"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-519427619-network", "vif_mac": "fa:16:3e:a4:da:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:da:75,bridge_name='br-int',has_traffic_filtering=True,id=0d7639f1-aadd-4f15-9292-8cef2591ce8d,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7639f1-aa') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:50:50 user nova-compute[73258]:   <uuid>ede6423b-ad91-4002-91d1-5849c6a4e26b</uuid>
Aug 27 06:50:50 user nova-compute[73258]:   <name>instance-0000001d</name>
Aug 27 06:50:50 user nova-compute[73258]:   <memory>2097152</memory>
Aug 27 06:50:50 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:50:50 user nova-compute[73258]:   <metadata>
Aug 27 06:50:50 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:50:50 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:50:50 user nova-compute[73258]:       <nova:name>tempest-ServerActionsTestOtherA-server-247234727</nova:name>
Aug 27 06:50:50 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:50:49</nova:creationTime>
Aug 27 06:50:50 user nova-compute[73258]:       <nova:flavor name="m1.small">
Aug 27 06:50:50 user nova-compute[73258]:         <nova:memory>2048</nova:memory>
Aug 27 06:50:50 user nova-compute[73258]:         <nova:disk>20</nova:disk>
Aug 27 06:50:50 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:50:50 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:50:50 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:50:50 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:50:50 user nova-compute[73258]:       <nova:owner>
Aug 27 06:50:50 user nova-compute[73258]:         <nova:user uuid="67f8a06ab5634f60b6ed2d1d9b2c342e">tempest-ServerActionsTestOtherA-1477462030-project-member</nova:user>
Aug 27 06:50:50 user nova-compute[73258]:         <nova:project uuid="57faf7cb6c704c05aba06857a6cdd29f">tempest-ServerActionsTestOtherA-1477462030</nova:project>
Aug 27 06:50:50 user nova-compute[73258]:       </nova:owner>
Aug 27 06:50:50 user nova-compute[73258]:       <nova:ports>
Aug 27 06:50:50 user nova-compute[73258]:         <nova:port uuid="0d7639f1-aadd-4f15-9292-8cef2591ce8d">
Aug 27 06:50:50 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 06:50:50 user nova-compute[73258]:         </nova:port>
Aug 27 06:50:50 user nova-compute[73258]:       </nova:ports>
Aug 27 06:50:50 user nova-compute[73258]:     </nova:instance>
Aug 27 06:50:50 user nova-compute[73258]:   </metadata>
Aug 27 06:50:50 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:50:50 user nova-compute[73258]:     <system>
Aug 27 06:50:50 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:50:50 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:50:50 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:50:50 user nova-compute[73258]:       <entry name="serial">ede6423b-ad91-4002-91d1-5849c6a4e26b</entry>
Aug 27 06:50:50 user nova-compute[73258]:       <entry name="uuid">ede6423b-ad91-4002-91d1-5849c6a4e26b</entry>
Aug 27 06:50:50 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:50:50 user nova-compute[73258]:     </system>
Aug 27 06:50:50 user nova-compute[73258]:   </sysinfo>
Aug 27 06:50:50 user nova-compute[73258]:   <os>
Aug 27 06:50:50 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:50:50 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:50:50 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:50:50 user nova-compute[73258]:   </os>
Aug 27 06:50:50 user nova-compute[73258]:   <features>
Aug 27 06:50:50 user nova-compute[73258]:     <acpi/>
Aug 27 06:50:50 user nova-compute[73258]:     <apic/>
Aug 27 06:50:50 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:50:50 user nova-compute[73258]:   </features>
Aug 27 06:50:50 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:50:50 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:50:50 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:50:50 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:50:50 user nova-compute[73258]:   </clock>
Aug 27 06:50:50 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:50:50 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:50:50 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:50:50 user nova-compute[73258]:   </cpu>
Aug 27 06:50:50 user nova-compute[73258]:   <devices>
Aug 27 06:50:50 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:50:50 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:50:50 user nova-compute[73258]:       <source dev="/dev/sdb"/>
Aug 27 06:50:50 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:50:50 user nova-compute[73258]:       <serial>c199006a-92aa-4e38-8f04-059c7642b550</serial>
Aug 27 06:50:50 user nova-compute[73258]:     </disk>
Aug 27 06:50:50 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:50:50 user nova-compute[73258]:       <mac address="fa:16:3e:a4:da:75"/>
Aug 27 06:50:50 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:50:50 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:50:50 user nova-compute[73258]:       <target dev="tap0d7639f1-aa"/>
Aug 27 06:50:50 user nova-compute[73258]:     </interface>
Aug 27 06:50:50 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:50:50 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/ede6423b-ad91-4002-91d1-5849c6a4e26b/console.log" append="off"/>
Aug 27 06:50:50 user nova-compute[73258]:     </serial>
Aug 27 06:50:50 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:50:50 user nova-compute[73258]:     <video>
Aug 27 06:50:50 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:50:50 user nova-compute[73258]:     </video>
Aug 27 06:50:50 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:50:50 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:50:50 user nova-compute[73258]:     </rng>
Aug 27 06:50:50 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:50:50 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:50:50 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:50:50 user nova-compute[73258]:     </memballoon>
Aug 27 06:50:50 user nova-compute[73258]:   </devices>
Aug 27 06:50:50 user nova-compute[73258]: </domain>
Aug 27 06:50:50 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:48:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-247234727',display_name='tempest-ServerActionsTestOtherA-server-247234727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-247234727',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/KYWUE6gNqqFSSqcTnsAI5+JZTptdXjLfwtgiVKLM8n2N6Y2L8s6Bg81l6XDxMjw3BfYNizv1BnMF+y6NIh1U/xVCMRNK16iGCh/62JzPGiCS6K24meGZJ+ETPM0mnhw==',key_name='tempest-keypair-1255305482',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='57faf7cb6c704c05aba06857a6cdd29f',ramdisk_id='',reservation_id='r-lb0avote',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1477462030',owner_user_name='tempest-ServerActionsTestOtherA-1477462030-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:50:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f8a06ab5634f60b6ed2d1d9b2c342e',uuid=ede6423b-ad91-4002-91d1-5849c6a4e26b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-519427619-network", "vif_mac": "fa:16:3e:a4:da:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converting VIF {"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-519427619-network", "vif_mac": "fa:16:3e:a4:da:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:da:75,bridge_name='br-int',has_traffic_filtering=True,id=0d7639f1-aadd-4f15-9292-8cef2591ce8d,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7639f1-aa') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG os_vif [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:da:75,bridge_name='br-int',has_traffic_filtering=True,id=0d7639f1-aadd-4f15-9292-8cef2591ce8d,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7639f1-aa') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d7639f1-aa, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d7639f1-aa, col_values=(('external_ids', {'iface-id': '0d7639f1-aadd-4f15-9292-8cef2591ce8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:da:75', 'vm-uuid': 'ede6423b-ad91-4002-91d1-5849c6a4e26b'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:50 user nova-compute[73258]: INFO os_vif [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:da:75,bridge_name='br-int',has_traffic_filtering=True,id=0d7639f1-aadd-4f15-9292-8cef2591ce8d,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7639f1-aa')
Aug 27 06:50:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:50:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] No VIF found with MAC fa:16:3e:a4:da:75, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:50:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:52 user nova-compute[73258]: DEBUG nova.compute.manager [req-a513d6e9-e41b-4fda-8b21-c17fd70804e8 req-88e75d42-a63c-4dba-867f-536ae744f561 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Received event network-vif-plugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:50:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a513d6e9-e41b-4fda-8b21-c17fd70804e8 req-88e75d42-a63c-4dba-867f-536ae744f561 service nova] Acquiring lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a513d6e9-e41b-4fda-8b21-c17fd70804e8 req-88e75d42-a63c-4dba-867f-536ae744f561 service nova] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a513d6e9-e41b-4fda-8b21-c17fd70804e8 req-88e75d42-a63c-4dba-867f-536ae744f561 service nova] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:52 user nova-compute[73258]: DEBUG nova.compute.manager [req-a513d6e9-e41b-4fda-8b21-c17fd70804e8 req-88e75d42-a63c-4dba-867f-536ae744f561 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] No waiting events found dispatching network-vif-plugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:50:52 user nova-compute[73258]: WARNING nova.compute.manager [req-a513d6e9-e41b-4fda-8b21-c17fd70804e8 req-88e75d42-a63c-4dba-867f-536ae744f561 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Received unexpected event network-vif-plugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d for instance with vm_state active and task_state resize_finish.
Aug 27 06:50:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:53 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:50:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:53 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:50:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:54 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119054.3317578, ede6423b-ad91-4002-91d1-5849c6a4e26b => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:50:54 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] VM Resumed (Lifecycle Event)
Aug 27 06:50:54 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:50:54 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:50:54 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Instance running successfully.
Aug 27 06:50:54 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Failed to set time: agent not configured {{(pid=73258) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 27 06:50:54 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3a7f7c1d-896e-4993-b934-5835ee6a3fc6 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] finish_migration finished successfully. {{(pid=73258) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 27 06:50:54 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:50:54 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 06:50:54 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119054.3349032, ede6423b-ad91-4002-91d1-5849c6a4e26b => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:50:54 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] VM Started (Lifecycle Event)
Aug 27 06:50:54 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:50:54 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:50:54 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 06:50:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:54 user nova-compute[73258]: DEBUG nova.compute.manager [req-d73fdfef-21f9-460f-a7eb-6ae4619f8d68 req-c04e94b5-4510-4a58-892e-fdb5a3b9fc39 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Received event network-vif-plugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:50:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d73fdfef-21f9-460f-a7eb-6ae4619f8d68 req-c04e94b5-4510-4a58-892e-fdb5a3b9fc39 service nova] Acquiring lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d73fdfef-21f9-460f-a7eb-6ae4619f8d68 req-c04e94b5-4510-4a58-892e-fdb5a3b9fc39 service nova] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d73fdfef-21f9-460f-a7eb-6ae4619f8d68 req-c04e94b5-4510-4a58-892e-fdb5a3b9fc39 service nova] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:54 user nova-compute[73258]: DEBUG nova.compute.manager [req-d73fdfef-21f9-460f-a7eb-6ae4619f8d68 req-c04e94b5-4510-4a58-892e-fdb5a3b9fc39 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] No waiting events found dispatching network-vif-plugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:50:54 user nova-compute[73258]: WARNING nova.compute.manager [req-d73fdfef-21f9-460f-a7eb-6ae4619f8d68 req-c04e94b5-4510-4a58-892e-fdb5a3b9fc39 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Received unexpected event network-vif-plugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d for instance with vm_state resized and task_state None.
Aug 27 06:50:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:54 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:50:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixlFOBzw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:50:55 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:50:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:50:55 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:50:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:50:55 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5733a99-6f22-41a9-8eb8-aaaf9c7994b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:50:55 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4079e55-4ed2-438c-ad7c-90c2207c7a4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8] added
Aug 27 06:50:55 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ced983f-0d1c-48a8-a91c-2686097eb424]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f4b6bb-0f7f-4df5-90e0-3d108c8fe300]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixlFOBzw {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixlFOBzw" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[980ec75d-5f33-4046-b09e-faf1c7adedcb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ixlFOBzw'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d1afe0-8789-400a-8979-27e8de282adc]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47d2e1a-c059-4cc7-a3ae-74f957d8e88a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:50:55 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:50:55 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:50:55 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:50:55 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f84d579-3492-4f15-85b4-f8b887381c70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8, portal: 172.16.0.220,3260]
Aug 27 06:50:55 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8, portal: 172.16.0.220,3260] successful.
Aug 27 06:50:55 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[32034b20-2ded-49d3-b8cb-b6119275572d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e47aea-1e40-4717-ab25-509801ebc083]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:50:56 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:50:56 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:50:56 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:50:56 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:50:56 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:50:56 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bfd9aa-80de-409a-beb5-25aacd9d63e3]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixlFOBzw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:50:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '23533616336663634', 'path': '/dev/sdc'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:50:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533616336663634', 'path': '/dev/sdc'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:50:57 user nova-compute[73258]: DEBUG nova.objects.instance [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'flavor' on Instance uuid b22b7599-5a37-4370-b440-f04e3dc88f98 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:50:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:50:57 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:50:57 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 06:50:57 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:50:57 user nova-compute[73258]:   <serial>b803adad-6f72-4910-b65c-6d62cb5d30b8</serial>
Aug 27 06:50:57 user nova-compute[73258]: </disk>
Aug 27 06:50:57 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:50:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:50:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:50:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] No VIF found with MAC fa:16:3e:2a:36:5c, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:50:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4543b354-d1f2-4ede-9744-78269be5a77c tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.420s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:50:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:58 user nova-compute[73258]: INFO nova.compute.manager [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Rescuing
Aug 27 06:50:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:50:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquired lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:50:58 user nova-compute[73258]: DEBUG nova.network.neutron [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:50:58 user nova-compute[73258]: DEBUG nova.objects.instance [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'flavor' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:50:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "refresh_cache-9517c681-ed2b-49c2-94a6-aa2181b4b62f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:50:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquired lock "refresh_cache-9517c681-ed2b-49c2-94a6-aa2181b4b62f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:50:58 user nova-compute[73258]: DEBUG nova.network.neutron [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:50:58 user nova-compute[73258]: DEBUG nova.objects.instance [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'info_cache' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:50:58 user nova-compute[73258]: DEBUG nova.objects.base [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Object Instance<9517c681-ed2b-49c2-94a6-aa2181b4b62f> lazy-loaded attributes: flavor,info_cache {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.network.neutron [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Updating instance_info_cache with network_info: [{"id": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "address": "fa:16:3e:2a:36:5c", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e94cae8-ea", "ovs_interfaceid": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Releasing lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.network.neutron [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Updating instance_info_cache with network_info: [{"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Releasing lock "refresh_cache-9517c681-ed2b-49c2-94a6-aa2181b4b62f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:50:59 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Instance destroyed successfully.
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.objects.instance [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'resources' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.objects.base [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Object Instance<9517c681-ed2b-49c2-94a6-aa2181b4b62f> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:43:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1573525836',display_name='tempest-AttachVolumeTestJSON-server-1573525836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1573525836',id=20,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuhlWzl340MR8vuL4wDTAkmN5hCJUdQIIyuqJCteVnLZ+c/yoSQsUNeq9gc2CsDlviPIALHDhlmzrpmhT0dESkXG7J9YKzWGCIInu7/GNC69QhJ+6s+eSD+zVfJ71qniA==',key_name='tempest-keypair-2145652813',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:43:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='191ca81ae335419aa935b1b7576b12ff',ramdisk_id='',reservation_id='r-nh0b3aah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1777325696',owner_user_name='tempest-AttachVolumeTestJSON-1777325696-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e3b8e4e749b4d039b4d5ebdc6469151',uuid=9517c681-ed2b-49c2-94a6-aa2181b4b62f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converting VIF {"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG os_vif [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b4375ea-f7, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:59 user nova-compute[73258]: INFO os_vif [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7')
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Start _get_guest_xml network_info=[{"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.objects.instance [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'numa_topology' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.objects.base [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Object Instance<9517c681-ed2b-49c2-94a6-aa2181b4b62f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:50:59 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:50:59 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.objects.instance [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.objects.base [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Object Instance<9517c681-ed2b-49c2-94a6-aa2181b4b62f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:43:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1573525836',display_name='tempest-AttachVolumeTestJSON-server-1573525836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1573525836',id=20,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuhlWzl340MR8vuL4wDTAkmN5hCJUdQIIyuqJCteVnLZ+c/yoSQsUNeq9gc2CsDlviPIALHDhlmzrpmhT0dESkXG7J9YKzWGCIInu7/GNC69QhJ+6s+eSD+zVfJ71qniA==',key_name='tempest-keypair-2145652813',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:43:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='191ca81ae335419aa935b1b7576b12ff',ramdisk_id='',reservation_id='r-nh0b3aah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1777325696',owner_user_name='tempest-AttachVolumeTestJSON-1777325696-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e3b8e4e749b4d039b4d5ebdc6469151',uuid=9517c681-ed2b-49c2-94a6-aa2181b4b62f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converting VIF {"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.objects.instance [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'pci_devices' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.compute.manager [req-deeb6bfc-523f-469a-905f-4b527e089912 req-75bb36cc-43de-45cb-876c-1c88690f9f52 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received event network-vif-unplugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-deeb6bfc-523f-469a-905f-4b527e089912 req-75bb36cc-43de-45cb-876c-1c88690f9f52 service nova] Acquiring lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-deeb6bfc-523f-469a-905f-4b527e089912 req-75bb36cc-43de-45cb-876c-1c88690f9f52 service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-deeb6bfc-523f-469a-905f-4b527e089912 req-75bb36cc-43de-45cb-876c-1c88690f9f52 service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.compute.manager [req-deeb6bfc-523f-469a-905f-4b527e089912 req-75bb36cc-43de-45cb-876c-1c88690f9f52 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] No waiting events found dispatching network-vif-unplugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:50:59 user nova-compute[73258]: WARNING nova.compute.manager [req-deeb6bfc-523f-469a-905f-4b527e089912 req-75bb36cc-43de-45cb-876c-1c88690f9f52 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received unexpected event network-vif-unplugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 for instance with vm_state active and task_state rescuing.
Aug 27 06:50:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.objects.base [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Object Instance<9517c681-ed2b-49c2-94a6-aa2181b4b62f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:50:59 user nova-compute[73258]:   <uuid>9517c681-ed2b-49c2-94a6-aa2181b4b62f</uuid>
Aug 27 06:50:59 user nova-compute[73258]:   <name>instance-00000014</name>
Aug 27 06:50:59 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:50:59 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:50:59 user nova-compute[73258]:   <metadata>
Aug 27 06:50:59 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:50:59 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:50:59 user nova-compute[73258]:       <nova:name>tempest-AttachVolumeTestJSON-server-1573525836</nova:name>
Aug 27 06:50:59 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:50:59</nova:creationTime>
Aug 27 06:50:59 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:50:59 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:50:59 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:50:59 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:50:59 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:50:59 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:50:59 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:50:59 user nova-compute[73258]:       <nova:owner>
Aug 27 06:50:59 user nova-compute[73258]:         <nova:user uuid="9e3b8e4e749b4d039b4d5ebdc6469151">tempest-AttachVolumeTestJSON-1777325696-project-member</nova:user>
Aug 27 06:50:59 user nova-compute[73258]:         <nova:project uuid="191ca81ae335419aa935b1b7576b12ff">tempest-AttachVolumeTestJSON-1777325696</nova:project>
Aug 27 06:50:59 user nova-compute[73258]:       </nova:owner>
Aug 27 06:50:59 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:50:59 user nova-compute[73258]:       <nova:ports>
Aug 27 06:50:59 user nova-compute[73258]:         <nova:port uuid="7b4375ea-f74b-4677-a768-97e96029c237">
Aug 27 06:50:59 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 06:50:59 user nova-compute[73258]:         </nova:port>
Aug 27 06:50:59 user nova-compute[73258]:       </nova:ports>
Aug 27 06:50:59 user nova-compute[73258]:     </nova:instance>
Aug 27 06:50:59 user nova-compute[73258]:   </metadata>
Aug 27 06:50:59 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:50:59 user nova-compute[73258]:     <system>
Aug 27 06:50:59 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:50:59 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:50:59 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:50:59 user nova-compute[73258]:       <entry name="serial">9517c681-ed2b-49c2-94a6-aa2181b4b62f</entry>
Aug 27 06:50:59 user nova-compute[73258]:       <entry name="uuid">9517c681-ed2b-49c2-94a6-aa2181b4b62f</entry>
Aug 27 06:50:59 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:50:59 user nova-compute[73258]:     </system>
Aug 27 06:50:59 user nova-compute[73258]:   </sysinfo>
Aug 27 06:50:59 user nova-compute[73258]:   <os>
Aug 27 06:50:59 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:50:59 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:50:59 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:50:59 user nova-compute[73258]:   </os>
Aug 27 06:50:59 user nova-compute[73258]:   <features>
Aug 27 06:50:59 user nova-compute[73258]:     <acpi/>
Aug 27 06:50:59 user nova-compute[73258]:     <apic/>
Aug 27 06:50:59 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:50:59 user nova-compute[73258]:   </features>
Aug 27 06:50:59 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:50:59 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:50:59 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:50:59 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:50:59 user nova-compute[73258]:   </clock>
Aug 27 06:50:59 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:50:59 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:50:59 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:50:59 user nova-compute[73258]:   </cpu>
Aug 27 06:50:59 user nova-compute[73258]:   <devices>
Aug 27 06:50:59 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:50:59 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:50:59 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk"/>
Aug 27 06:50:59 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:50:59 user nova-compute[73258]:     </disk>
Aug 27 06:50:59 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:50:59 user nova-compute[73258]:       <mac address="fa:16:3e:f5:fe:36"/>
Aug 27 06:50:59 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:50:59 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:50:59 user nova-compute[73258]:       <target dev="tap7b4375ea-f7"/>
Aug 27 06:50:59 user nova-compute[73258]:     </interface>
Aug 27 06:50:59 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:50:59 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/console.log" append="off"/>
Aug 27 06:50:59 user nova-compute[73258]:     </serial>
Aug 27 06:50:59 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:50:59 user nova-compute[73258]:     <video>
Aug 27 06:50:59 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:50:59 user nova-compute[73258]:     </video>
Aug 27 06:50:59 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:50:59 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:50:59 user nova-compute[73258]:     </rng>
Aug 27 06:50:59 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:50:59 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:50:59 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:50:59 user nova-compute[73258]:     </memballoon>
Aug 27 06:50:59 user nova-compute[73258]:   </devices>
Aug 27 06:50:59 user nova-compute[73258]: </domain>
Aug 27 06:50:59 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:50:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG nova.objects.instance [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG nova.objects.base [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Object Instance<9517c681-ed2b-49c2-94a6-aa2181b4b62f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:00 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Instance destroyed successfully.
Aug 27 06:51:00 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Attempting rescue
Aug 27 06:51:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73258) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Instance directory exists: not creating {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 06:51:00 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Creating image(s)
Aug 27 06:51:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "/opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "/opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "/opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG nova.objects.instance [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'trusted_certs' on Instance uuid b22b7599-5a37-4370-b440-f04e3dc88f98 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.553s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:00 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:51:00 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:51:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=6816MB free_disk=23.89056396484375GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.180s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk.rescue {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk.rescue" returned: 0 in 0.059s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.objects.instance [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'migration_context' on Instance uuid b22b7599-5a37-4370-b440-f04e3dc88f98 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Cannot resize image /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.objects.instance [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'migration_context' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.objects.base [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Object Instance<b22b7599-5a37-4370-b440-f04e3dc88f98> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Start _get_guest_xml network_info=[{"id": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "address": "fa:16:3e:2a:36:5c", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "vif_mac": "fa:16:3e:2a:36:5c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e94cae8-ea", "ovs_interfaceid": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.objects.instance [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'resources' on Instance uuid b22b7599-5a37-4370-b440-f04e3dc88f98 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.objects.base [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Object Instance<9517c681-ed2b-49c2-94a6-aa2181b4b62f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:43:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1573525836',display_name='tempest-AttachVolumeTestJSON-server-1573525836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1573525836',id=20,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuhlWzl340MR8vuL4wDTAkmN5hCJUdQIIyuqJCteVnLZ+c/yoSQsUNeq9gc2CsDlviPIALHDhlmzrpmhT0dESkXG7J9YKzWGCIInu7/GNC69QhJ+6s+eSD+zVfJ71qniA==',key_name='tempest-keypair-2145652813',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:43:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='191ca81ae335419aa935b1b7576b12ff',ramdisk_id='',reservation_id='r-nh0b3aah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1777325696',owner_user_name='tempest-AttachVolumeTestJSON-1777325696-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e3b8e4e749b4d039b4d5ebdc6469151',uuid=9517c681-ed2b-49c2-94a6-aa2181b4b62f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converting VIF {"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG os_vif [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Applying migration context for instance ede6423b-ad91-4002-91d1-5849c6a4e26b as it has an incoming, in-progress migration 886cc733-8b90-4710-adf4-c1b165a4eb91. Migration status is finished {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 06:51:01 user nova-compute[73258]: INFO nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Updating resource usage from migration 886cc733-8b90-4710-adf4-c1b165a4eb91
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.objects.base [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Object Instance<b22b7599-5a37-4370-b440-f04e3dc88f98> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.objects.instance [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'numa_topology' on Instance uuid b22b7599-5a37-4370-b440-f04e3dc88f98 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b4375ea-f7, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7b4375ea-f7, col_values=(('external_ids', {'iface-id': '7b4375ea-f74b-4677-a768-97e96029c237', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:fe:36', 'vm-uuid': '9517c681-ed2b-49c2-94a6-aa2181b4b62f'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.objects.base [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Object Instance<b22b7599-5a37-4370-b440-f04e3dc88f98> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:01 user nova-compute[73258]: INFO os_vif [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7')
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1672aa9f-be6f-4357-877f-a48f62119df4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a836678e-240d-4ead-b0b5-64d146910a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9517c681-ed2b-49c2-94a6-aa2181b4b62f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 8396ca48-c47c-41b1-9872-24dbb0b9f526 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 7ee743f1-9611-4165-838e-54fccb332f1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bc3cebb3-0e29-4899-94aa-d13a2a9ca86a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance b22b7599-5a37-4370-b440-f04e3dc88f98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1324fcba-2b2b-4406-8527-c1585642dd94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance d409b021-ab98-4f9f-a80d-99fe05de7b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bcd29636-071b-4699-8360-e0d189df3f95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Migration 886cc733-8b90-4710-adf4-c1b165a4eb91 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance ede6423b-ad91-4002-91d1-5849c6a4e26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:51:01 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:51:01 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.objects.instance [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'vcpu_model' on Instance uuid b22b7599-5a37-4370-b440-f04e3dc88f98 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.objects.base [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Object Instance<b22b7599-5a37-4370-b440-f04e3dc88f98> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:48:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1499776913',display_name='tempest-ServerRescueNegativeTestJSON-server-1499776913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1499776913',id=30,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErbhwcq7aMHPks7Q30Yl1JgTtz86nuYtLPWY4cd1Va/1/xuONf64c83ZqaEqnO0vQM+Iy3jGDNqDWdT2gBJMeVX8g/Qp/6AdHpxWA0fEmnlzHeTG2hi39F3l9DovV+GoA==',key_name='tempest-keypair-1178169413',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:48:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6efa67b959a473da5a06f9e0aa8795f',ramdisk_id='',reservation_id='r-onwvh0ae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1025141277',owner_user_name='tempest-ServerRescueNegativeTestJSON-1025141277-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='685859ec81944e3398853037c24673a4',uuid=b22b7599-5a37-4370-b440-f04e3dc88f98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "address": "fa:16:3e:2a:36:5c", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "vif_mac": "fa:16:3e:2a:36:5c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e94cae8-ea", "ovs_interfaceid": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converting VIF {"id": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "address": "fa:16:3e:2a:36:5c", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "vif_mac": "fa:16:3e:2a:36:5c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e94cae8-ea", "ovs_interfaceid": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:36:5c,bridge_name='br-int',has_traffic_filtering=True,id=8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e94cae8-ea') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.objects.instance [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'pci_devices' on Instance uuid b22b7599-5a37-4370-b440-f04e3dc88f98 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.objects.base [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Object Instance<b22b7599-5a37-4370-b440-f04e3dc88f98> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:51:01 user nova-compute[73258]:   <uuid>b22b7599-5a37-4370-b440-f04e3dc88f98</uuid>
Aug 27 06:51:01 user nova-compute[73258]:   <name>instance-0000001e</name>
Aug 27 06:51:01 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:51:01 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:51:01 user nova-compute[73258]:   <metadata>
Aug 27 06:51:01 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:51:01 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:51:01 user nova-compute[73258]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1499776913</nova:name>
Aug 27 06:51:01 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:51:01</nova:creationTime>
Aug 27 06:51:01 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:51:01 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:51:01 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:51:01 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:51:01 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:51:01 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:51:01 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:51:01 user nova-compute[73258]:       <nova:owner>
Aug 27 06:51:01 user nova-compute[73258]:         <nova:user uuid="685859ec81944e3398853037c24673a4">tempest-ServerRescueNegativeTestJSON-1025141277-project-member</nova:user>
Aug 27 06:51:01 user nova-compute[73258]:         <nova:project uuid="f6efa67b959a473da5a06f9e0aa8795f">tempest-ServerRescueNegativeTestJSON-1025141277</nova:project>
Aug 27 06:51:01 user nova-compute[73258]:       </nova:owner>
Aug 27 06:51:01 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:51:01 user nova-compute[73258]:       <nova:ports>
Aug 27 06:51:01 user nova-compute[73258]:         <nova:port uuid="8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9">
Aug 27 06:51:01 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 06:51:01 user nova-compute[73258]:         </nova:port>
Aug 27 06:51:01 user nova-compute[73258]:       </nova:ports>
Aug 27 06:51:01 user nova-compute[73258]:     </nova:instance>
Aug 27 06:51:01 user nova-compute[73258]:   </metadata>
Aug 27 06:51:01 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:51:01 user nova-compute[73258]:     <system>
Aug 27 06:51:01 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:51:01 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:51:01 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:51:01 user nova-compute[73258]:       <entry name="serial">b22b7599-5a37-4370-b440-f04e3dc88f98</entry>
Aug 27 06:51:01 user nova-compute[73258]:       <entry name="uuid">b22b7599-5a37-4370-b440-f04e3dc88f98</entry>
Aug 27 06:51:01 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:51:01 user nova-compute[73258]:     </system>
Aug 27 06:51:01 user nova-compute[73258]:   </sysinfo>
Aug 27 06:51:01 user nova-compute[73258]:   <os>
Aug 27 06:51:01 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:51:01 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:51:01 user nova-compute[73258]:   </os>
Aug 27 06:51:01 user nova-compute[73258]:   <features>
Aug 27 06:51:01 user nova-compute[73258]:     <acpi/>
Aug 27 06:51:01 user nova-compute[73258]:     <apic/>
Aug 27 06:51:01 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:51:01 user nova-compute[73258]:   </features>
Aug 27 06:51:01 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:51:01 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:51:01 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:51:01 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:51:01 user nova-compute[73258]:   </clock>
Aug 27 06:51:01 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:51:01 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:51:01 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:51:01 user nova-compute[73258]:   </cpu>
Aug 27 06:51:01 user nova-compute[73258]:   <devices>
Aug 27 06:51:01 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:51:01 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:51:01 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk.rescue"/>
Aug 27 06:51:01 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:51:01 user nova-compute[73258]:     </disk>
Aug 27 06:51:01 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:51:01 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:51:01 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk"/>
Aug 27 06:51:01 user nova-compute[73258]:       <target dev="vdb" bus="virtio"/>
Aug 27 06:51:01 user nova-compute[73258]:     </disk>
Aug 27 06:51:01 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:51:01 user nova-compute[73258]:       <mac address="fa:16:3e:2a:36:5c"/>
Aug 27 06:51:01 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:51:01 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:51:01 user nova-compute[73258]:       <target dev="tap8e94cae8-ea"/>
Aug 27 06:51:01 user nova-compute[73258]:     </interface>
Aug 27 06:51:01 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:51:01 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/console.log" append="off"/>
Aug 27 06:51:01 user nova-compute[73258]:     </serial>
Aug 27 06:51:01 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:51:01 user nova-compute[73258]:     <video>
Aug 27 06:51:01 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:51:01 user nova-compute[73258]:     </video>
Aug 27 06:51:01 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:51:01 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:51:01 user nova-compute[73258]:     </rng>
Aug 27 06:51:01 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:51:01 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:51:01 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:51:01 user nova-compute[73258]:     </memballoon>
Aug 27 06:51:01 user nova-compute[73258]:   </devices>
Aug 27 06:51:01 user nova-compute[73258]: </domain>
Aug 27 06:51:01 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:51:01 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Instance destroyed successfully.
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] No VIF found with MAC fa:16:3e:2a:36:5c, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.873s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.manager [req-edd94d48-a896-4864-ab55-0c40eaf8196c req-d614f9ef-6e8e-4cc3-885c-3a80cbd4f71f service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received event network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-edd94d48-a896-4864-ab55-0c40eaf8196c req-d614f9ef-6e8e-4cc3-885c-3a80cbd4f71f service nova] Acquiring lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-edd94d48-a896-4864-ab55-0c40eaf8196c req-d614f9ef-6e8e-4cc3-885c-3a80cbd4f71f service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-edd94d48-a896-4864-ab55-0c40eaf8196c req-d614f9ef-6e8e-4cc3-885c-3a80cbd4f71f service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:01 user nova-compute[73258]: DEBUG nova.compute.manager [req-edd94d48-a896-4864-ab55-0c40eaf8196c req-d614f9ef-6e8e-4cc3-885c-3a80cbd4f71f service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] No waiting events found dispatching network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:51:01 user nova-compute[73258]: WARNING nova.compute.manager [req-edd94d48-a896-4864-ab55-0c40eaf8196c req-d614f9ef-6e8e-4cc3-885c-3a80cbd4f71f service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received unexpected event network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 for instance with vm_state active and task_state rescuing.
Aug 27 06:51:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:03 user nova-compute[73258]: DEBUG nova.compute.manager [req-2f1d26d7-8f21-47af-a5b7-4535ee3424ed req-d66a67e9-54ef-4fa3-a182-c2be9fc898a6 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:51:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2f1d26d7-8f21-47af-a5b7-4535ee3424ed req-d66a67e9-54ef-4fa3-a182-c2be9fc898a6 service nova] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2f1d26d7-8f21-47af-a5b7-4535ee3424ed req-d66a67e9-54ef-4fa3-a182-c2be9fc898a6 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2f1d26d7-8f21-47af-a5b7-4535ee3424ed req-d66a67e9-54ef-4fa3-a182-c2be9fc898a6 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:03 user nova-compute[73258]: DEBUG nova.compute.manager [req-2f1d26d7-8f21-47af-a5b7-4535ee3424ed req-d66a67e9-54ef-4fa3-a182-c2be9fc898a6 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] No waiting events found dispatching network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:51:03 user nova-compute[73258]: WARNING nova.compute.manager [req-2f1d26d7-8f21-47af-a5b7-4535ee3424ed req-d66a67e9-54ef-4fa3-a182-c2be9fc898a6 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received unexpected event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 for instance with vm_state stopped and task_state powering-on.
Aug 27 06:51:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:04 user nova-compute[73258]: DEBUG nova.compute.manager [req-4623ad50-6b3e-401d-a699-0f189919445a req-f7bfc41a-d454-4466-bdc1-69b926aa8a6e service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received event network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:51:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4623ad50-6b3e-401d-a699-0f189919445a req-f7bfc41a-d454-4466-bdc1-69b926aa8a6e service nova] Acquiring lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4623ad50-6b3e-401d-a699-0f189919445a req-f7bfc41a-d454-4466-bdc1-69b926aa8a6e service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4623ad50-6b3e-401d-a699-0f189919445a req-f7bfc41a-d454-4466-bdc1-69b926aa8a6e service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:04 user nova-compute[73258]: DEBUG nova.compute.manager [req-4623ad50-6b3e-401d-a699-0f189919445a req-f7bfc41a-d454-4466-bdc1-69b926aa8a6e service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] No waiting events found dispatching network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:51:04 user nova-compute[73258]: WARNING nova.compute.manager [req-4623ad50-6b3e-401d-a699-0f189919445a req-f7bfc41a-d454-4466-bdc1-69b926aa8a6e service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received unexpected event network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 for instance with vm_state active and task_state rescuing.
Aug 27 06:51:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:04 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:51:05 user nova-compute[73258]: DEBUG nova.compute.manager [req-90e7bbae-aaa9-4653-a745-b93c1cd76990 req-5ca20472-31f7-4c6a-b2c3-79531cd087ed service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:51:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-90e7bbae-aaa9-4653-a745-b93c1cd76990 req-5ca20472-31f7-4c6a-b2c3-79531cd087ed service nova] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-90e7bbae-aaa9-4653-a745-b93c1cd76990 req-5ca20472-31f7-4c6a-b2c3-79531cd087ed service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-90e7bbae-aaa9-4653-a745-b93c1cd76990 req-5ca20472-31f7-4c6a-b2c3-79531cd087ed service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:05 user nova-compute[73258]: DEBUG nova.compute.manager [req-90e7bbae-aaa9-4653-a745-b93c1cd76990 req-5ca20472-31f7-4c6a-b2c3-79531cd087ed service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] No waiting events found dispatching network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:51:05 user nova-compute[73258]: WARNING nova.compute.manager [req-90e7bbae-aaa9-4653-a745-b93c1cd76990 req-5ca20472-31f7-4c6a-b2c3-79531cd087ed service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received unexpected event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 for instance with vm_state stopped and task_state powering-on.
Aug 27 06:51:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:06 user nova-compute[73258]: DEBUG nova.compute.manager [req-07f422a1-0524-4786-87d4-2ec0eb8c4057 req-fc0fc314-ac32-46e1-a26a-9dea32676836 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received event network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:51:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-07f422a1-0524-4786-87d4-2ec0eb8c4057 req-fc0fc314-ac32-46e1-a26a-9dea32676836 service nova] Acquiring lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-07f422a1-0524-4786-87d4-2ec0eb8c4057 req-fc0fc314-ac32-46e1-a26a-9dea32676836 service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-07f422a1-0524-4786-87d4-2ec0eb8c4057 req-fc0fc314-ac32-46e1-a26a-9dea32676836 service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:06 user nova-compute[73258]: DEBUG nova.compute.manager [req-07f422a1-0524-4786-87d4-2ec0eb8c4057 req-fc0fc314-ac32-46e1-a26a-9dea32676836 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] No waiting events found dispatching network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:51:06 user nova-compute[73258]: WARNING nova.compute.manager [req-07f422a1-0524-4786-87d4-2ec0eb8c4057 req-fc0fc314-ac32-46e1-a26a-9dea32676836 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received unexpected event network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 for instance with vm_state active and task_state rescuing.
Aug 27 06:51:06 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119066.869421, 9517c681-ed2b-49c2-94a6-aa2181b4b62f => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:51:06 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] VM Resumed (Lifecycle Event)
Aug 27 06:51:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:51:06 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Instance rebooted successfully.
Aug 27 06:51:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-66b5bce5-2fb9-47a2-9ca3-a5c0650b064a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:51:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:51:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:51:06 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 27 06:51:06 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119066.877273, 9517c681-ed2b-49c2-94a6-aa2181b4b62f => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:51:06 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] VM Started (Lifecycle Event)
Aug 27 06:51:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:51:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:51:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-ce29244f-4a7b-4654-848a-86f5660dbd7a tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:51:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Removed pending event for b22b7599-5a37-4370-b440-f04e3dc88f98 due to event {{(pid=73258) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 06:51:06 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119066.9767969, b22b7599-5a37-4370-b440-f04e3dc88f98 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:51:06 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] VM Resumed (Lifecycle Event)
Aug 27 06:51:07 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:51:07 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:51:07 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 06:51:07 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119066.9796448, b22b7599-5a37-4370-b440-f04e3dc88f98 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:51:07 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] VM Started (Lifecycle Event)
Aug 27 06:51:07 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:51:07 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:51:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-54238b0f-4821-4745-9d54-aa1a97018391 req-9834d398-c3c4-4fa1-a4cb-ceaaf8418736 service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Received event network-changed-45fb1201-3985-41b3-9c75-fecb5fcbd4ae {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:51:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-54238b0f-4821-4745-9d54-aa1a97018391 req-9834d398-c3c4-4fa1-a4cb-ceaaf8418736 service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Refreshing instance network info cache due to event network-changed-45fb1201-3985-41b3-9c75-fecb5fcbd4ae. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:51:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-54238b0f-4821-4745-9d54-aa1a97018391 req-9834d398-c3c4-4fa1-a4cb-ceaaf8418736 service nova] Acquiring lock "refresh_cache-3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:51:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-54238b0f-4821-4745-9d54-aa1a97018391 req-9834d398-c3c4-4fa1-a4cb-ceaaf8418736 service nova] Acquired lock "refresh_cache-3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:51:08 user nova-compute[73258]: DEBUG nova.network.neutron [req-54238b0f-4821-4745-9d54-aa1a97018391 req-9834d398-c3c4-4fa1-a4cb-ceaaf8418736 service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Refreshing network info cache for port 45fb1201-3985-41b3-9c75-fecb5fcbd4ae {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:51:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:08 user nova-compute[73258]: DEBUG nova.objects.instance [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lazy-loading 'flavor' on Instance uuid 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:51:09 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Ignoring supplied device name: /dev/vdb
Aug 27 06:51:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:09 user nova-compute[73258]: INFO nova.compute.manager [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Attaching volume 1c8ed5a0-96ea-4562-9399-f57b30e6026c to /dev/vdb
Aug 27 06:51:09 user nova-compute[73258]: DEBUG nova.network.neutron [req-54238b0f-4821-4745-9d54-aa1a97018391 req-9834d398-c3c4-4fa1-a4cb-ceaaf8418736 service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Updated VIF entry in instance network info cache for port 45fb1201-3985-41b3-9c75-fecb5fcbd4ae. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG nova.network.neutron [req-54238b0f-4821-4745-9d54-aa1a97018391 req-9834d398-c3c4-4fa1-a4cb-ceaaf8418736 service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Updating instance_info_cache with network_info: [{"id": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "address": "fa:16:3e:00:c8:7d", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45fb1201-39", "ovs_interfaceid": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-54238b0f-4821-4745-9d54-aa1a97018391 req-9834d398-c3c4-4fa1-a4cb-ceaaf8418736 service nova] Releasing lock "refresh_cache-3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG os_brick.utils [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9171c977-c002-4ec8-8cf7-cfa5ef3a961d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22cf456-f336-4d91-b323-5dfcba67e39d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d621b658-0549-410c-b1fc-7b6b2636ead5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[87098bab-0aab-4ab7-925d-e0a828f25fb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:51:09 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:51:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe87ee85-0951-4358-8c8d-3fdf204266a5]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG os_brick.utils [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:51:09 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Updating existing volume attachment record: 98f8fbc8-1b23-474d-9903-3e3d7245bcdb {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:51:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquiring lock "1324fcba-2b2b-4406-8527-c1585642dd94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "1324fcba-2b2b-4406-8527-c1585642dd94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquiring lock "1324fcba-2b2b-4406-8527-c1585642dd94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "1324fcba-2b2b-4406-8527-c1585642dd94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "1324fcba-2b2b-4406-8527-c1585642dd94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:19 user nova-compute[73258]: INFO nova.compute.manager [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Terminating instance
Aug 27 06:51:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-3954898c-1155-4263-b73d-b0dcd5dd5aab req-d18bd052-411f-418c-927e-cb193195281f service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Received event network-vif-unplugged-cef77cbb-9e3c-4b8a-a42c-50ff43e0d444 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3954898c-1155-4263-b73d-b0dcd5dd5aab req-d18bd052-411f-418c-927e-cb193195281f service nova] Acquiring lock "1324fcba-2b2b-4406-8527-c1585642dd94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3954898c-1155-4263-b73d-b0dcd5dd5aab req-d18bd052-411f-418c-927e-cb193195281f service nova] Lock "1324fcba-2b2b-4406-8527-c1585642dd94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3954898c-1155-4263-b73d-b0dcd5dd5aab req-d18bd052-411f-418c-927e-cb193195281f service nova] Lock "1324fcba-2b2b-4406-8527-c1585642dd94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-3954898c-1155-4263-b73d-b0dcd5dd5aab req-d18bd052-411f-418c-927e-cb193195281f service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] No waiting events found dispatching network-vif-unplugged-cef77cbb-9e3c-4b8a-a42c-50ff43e0d444 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-3954898c-1155-4263-b73d-b0dcd5dd5aab req-d18bd052-411f-418c-927e-cb193195281f service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Received event network-vif-unplugged-cef77cbb-9e3c-4b8a-a42c-50ff43e0d444 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:51:19 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Instance destroyed successfully.
Aug 27 06:51:19 user nova-compute[73258]: DEBUG nova.objects.instance [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lazy-loading 'resources' on Instance uuid 1324fcba-2b2b-4406-8527-c1585642dd94 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:49:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-411495519',display_name='tempest-VolumesActionsTest-instance-411495519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-411495519',id=32,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:49:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aeb0b2a4be9946e680a0e65d58f9c4f3',ramdisk_id='',reservation_id='r-4a0ekiy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1397322250',owner_user_name='tempest-VolumesActionsTest-1397322250-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:49:32Z,user_data=None,user_id='41ce9c10e4f14e478b5833700a5546cc',uuid=1324fcba-2b2b-4406-8527-c1585642dd94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "address": "fa:16:3e:5a:22:36", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef77cbb-9e", "ovs_interfaceid": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Converting VIF {"id": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "address": "fa:16:3e:5a:22:36", "network": {"id": "c5f850d2-9a33-4e76-a6fd-54865efe7aae", "bridge": "br-int", "label": "tempest-VolumesActionsTest-624794353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeb0b2a4be9946e680a0e65d58f9c4f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcef77cbb-9e", "ovs_interfaceid": "cef77cbb-9e3c-4b8a-a42c-50ff43e0d444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:22:36,bridge_name='br-int',has_traffic_filtering=True,id=cef77cbb-9e3c-4b8a-a42c-50ff43e0d444,network=Network(c5f850d2-9a33-4e76-a6fd-54865efe7aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcef77cbb-9e') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG os_vif [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:22:36,bridge_name='br-int',has_traffic_filtering=True,id=cef77cbb-9e3c-4b8a-a42c-50ff43e0d444,network=Network(c5f850d2-9a33-4e76-a6fd-54865efe7aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcef77cbb-9e') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcef77cbb-9e, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:51:19 user nova-compute[73258]: INFO os_vif [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:22:36,bridge_name='br-int',has_traffic_filtering=True,id=cef77cbb-9e3c-4b8a-a42c-50ff43e0d444,network=Network(c5f850d2-9a33-4e76-a6fd-54865efe7aae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcef77cbb-9e')
Aug 27 06:51:19 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Deleting instance files /opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94_del
Aug 27 06:51:19 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Deletion of /opt/stack/data/nova/instances/1324fcba-2b2b-4406-8527-c1585642dd94_del complete
Aug 27 06:51:19 user nova-compute[73258]: INFO nova.compute.manager [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Took 0.80 seconds to destroy the instance on the hypervisor.
Aug 27 06:51:19 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:51:19 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:51:20 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:51:20 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Took 0.66 seconds to deallocate network for instance.
Aug 27 06:51:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-88517998-3a8a-4da3-9d43-b3c8393e1c75 req-ab534f69-0c49-45e5-a396-9b929d22031b service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Received event network-vif-deleted-cef77cbb-9e3c-4b8a-a42c-50ff43e0d444 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:51:20 user nova-compute[73258]: INFO nova.compute.manager [req-88517998-3a8a-4da3-9d43-b3c8393e1c75 req-ab534f69-0c49-45e5-a396-9b929d22031b service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Neutron deleted interface cef77cbb-9e3c-4b8a-a42c-50ff43e0d444; detaching it from the instance and deleting it from the info cache
Aug 27 06:51:20 user nova-compute[73258]: DEBUG nova.network.neutron [req-88517998-3a8a-4da3-9d43-b3c8393e1c75 req-ab534f69-0c49-45e5-a396-9b929d22031b service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:51:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-88517998-3a8a-4da3-9d43-b3c8393e1c75 req-ab534f69-0c49-45e5-a396-9b929d22031b service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Detach interface failed, port_id=cef77cbb-9e3c-4b8a-a42c-50ff43e0d444, reason: Instance 1324fcba-2b2b-4406-8527-c1585642dd94 could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:51:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:21 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:51:21 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:51:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.524s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:21 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Deleted allocations for instance 1324fcba-2b2b-4406-8527-c1585642dd94
Aug 27 06:51:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7e76dba6-b67f-4ac4-80fb-3dc4fc205aa4 tempest-VolumesActionsTest-1397322250 tempest-VolumesActionsTest-1397322250-project-member] Lock "1324fcba-2b2b-4406-8527-c1585642dd94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.230s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:21 user nova-compute[73258]: DEBUG nova.compute.manager [req-2c02e773-e7d5-4d5e-a9ed-ffe1dfad90c1 req-85090901-c238-4a81-be6e-1aad2c4cd9f9 service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Received event network-vif-plugged-cef77cbb-9e3c-4b8a-a42c-50ff43e0d444 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:51:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2c02e773-e7d5-4d5e-a9ed-ffe1dfad90c1 req-85090901-c238-4a81-be6e-1aad2c4cd9f9 service nova] Acquiring lock "1324fcba-2b2b-4406-8527-c1585642dd94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2c02e773-e7d5-4d5e-a9ed-ffe1dfad90c1 req-85090901-c238-4a81-be6e-1aad2c4cd9f9 service nova] Lock "1324fcba-2b2b-4406-8527-c1585642dd94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2c02e773-e7d5-4d5e-a9ed-ffe1dfad90c1 req-85090901-c238-4a81-be6e-1aad2c4cd9f9 service nova] Lock "1324fcba-2b2b-4406-8527-c1585642dd94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:21 user nova-compute[73258]: DEBUG nova.compute.manager [req-2c02e773-e7d5-4d5e-a9ed-ffe1dfad90c1 req-85090901-c238-4a81-be6e-1aad2c4cd9f9 service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] No waiting events found dispatching network-vif-plugged-cef77cbb-9e3c-4b8a-a42c-50ff43e0d444 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:51:21 user nova-compute[73258]: WARNING nova.compute.manager [req-2c02e773-e7d5-4d5e-a9ed-ffe1dfad90c1 req-85090901-c238-4a81-be6e-1aad2c4cd9f9 service nova] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Received unexpected event network-vif-plugged-cef77cbb-9e3c-4b8a-a42c-50ff43e0d444 for instance with vm_state deleted and task_state None.
Aug 27 06:51:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPpXnZvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:51:22 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:51:22 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:51:22 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3910cba3-bd5a-4c39-9a4a-71951aa77389]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:51:22 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97ce3ca-f303-48c2-a53c-63335b7a3c94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c] added
Aug 27 06:51:22 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc383ba-0291-4f26-8834-757273aee68d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee9b745-254d-4376-a200-514a346ebf79]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPpXnZvh {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPpXnZvh" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d654293-51e4-4e86-9f7f-c3c79d74c96b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QPpXnZvh'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5b7892-71e2-428d-84af-9a9510d3a7a8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f71481-703e-41d8-b4d2-76aefc80cc31]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:51:22 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:51:22 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:51:22 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:51:22 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:51:22 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:51:22 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4c1890-f3f4-41b7-8331-4d1e02d9e1d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c, portal: 172.16.0.220,3260]
Aug 27 06:51:22 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c, portal: 172.16.0.220,3260] successful.
Aug 27 06:51:22 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[748df6e2-b9db-4e9f-a9df-cb84f56aaf47]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[685c30aa-5e56-4c28-9dee-a5618062b4fb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:51:22 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:51:22 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:51:22 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:51:22 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:51:22 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:51:22 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:51:22 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:51:22 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdb5575-2611-46e5-a9d9-a396096df7b3]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:51:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPpXnZvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:51:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:51:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23864393537653638', 'path': '/dev/sdd'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:51:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864393537653638', 'path': '/dev/sdd'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:51:23 user nova-compute[73258]: DEBUG nova.objects.instance [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lazy-loading 'flavor' on Instance uuid 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:51:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:51:24 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:51:24 user nova-compute[73258]:   <source dev="/dev/sdd"/>
Aug 27 06:51:24 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:51:24 user nova-compute[73258]:   <serial>1c8ed5a0-96ea-4562-9399-f57b30e6026c</serial>
Aug 27 06:51:24 user nova-compute[73258]: </disk>
Aug 27 06:51:24 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:51:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:51:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:51:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] No VIF found with MAC fa:16:3e:00:c8:7d, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:51:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fdca7ca1-c5da-49ba-b308-d868d0aa1e1b tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.319s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:34 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119079.6911461, 1324fcba-2b2b-4406-8527-c1585642dd94 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:51:34 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] VM Stopped (Lifecycle Event)
Aug 27 06:51:34 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e64445cd-c1a4-4cb9-9707-a78fba11b86c None None] [instance: 1324fcba-2b2b-4406-8527-c1585642dd94] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:51:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-d2fdf8cf-ebd1-4d78-9dec-4a5ed40e3e30 req-4caa1412-71b7-46f8-9063-abb192f46b5c service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Received event network-changed-a1f85e16-bf92-403d-bd6d-2300dfc481d7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:51:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-d2fdf8cf-ebd1-4d78-9dec-4a5ed40e3e30 req-4caa1412-71b7-46f8-9063-abb192f46b5c service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Refreshing instance network info cache due to event network-changed-a1f85e16-bf92-403d-bd6d-2300dfc481d7. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:51:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d2fdf8cf-ebd1-4d78-9dec-4a5ed40e3e30 req-4caa1412-71b7-46f8-9063-abb192f46b5c service nova] Acquiring lock "refresh_cache-d409b021-ab98-4f9f-a80d-99fe05de7b69" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:51:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d2fdf8cf-ebd1-4d78-9dec-4a5ed40e3e30 req-4caa1412-71b7-46f8-9063-abb192f46b5c service nova] Acquired lock "refresh_cache-d409b021-ab98-4f9f-a80d-99fe05de7b69" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:51:35 user nova-compute[73258]: DEBUG nova.network.neutron [req-d2fdf8cf-ebd1-4d78-9dec-4a5ed40e3e30 req-4caa1412-71b7-46f8-9063-abb192f46b5c service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Refreshing network info cache for port a1f85e16-bf92-403d-bd6d-2300dfc481d7 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:51:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "d409b021-ab98-4f9f-a80d-99fe05de7b69" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:35 user nova-compute[73258]: DEBUG nova.network.neutron [req-d2fdf8cf-ebd1-4d78-9dec-4a5ed40e3e30 req-4caa1412-71b7-46f8-9063-abb192f46b5c service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Updated VIF entry in instance network info cache for port a1f85e16-bf92-403d-bd6d-2300dfc481d7. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:51:35 user nova-compute[73258]: DEBUG nova.network.neutron [req-d2fdf8cf-ebd1-4d78-9dec-4a5ed40e3e30 req-4caa1412-71b7-46f8-9063-abb192f46b5c service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Updating instance_info_cache with network_info: [{"id": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "address": "fa:16:3e:52:49:8c", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f85e16-bf", "ovs_interfaceid": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:51:35 user nova-compute[73258]: DEBUG nova.objects.instance [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lazy-loading 'flavor' on Instance uuid d409b021-ab98-4f9f-a80d-99fe05de7b69 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:51:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d2fdf8cf-ebd1-4d78-9dec-4a5ed40e3e30 req-4caa1412-71b7-46f8-9063-abb192f46b5c service nova] Releasing lock "refresh_cache-d409b021-ab98-4f9f-a80d-99fe05de7b69" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:51:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "d409b021-ab98-4f9f-a80d-99fe05de7b69" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:35 user nova-compute[73258]: INFO nova.compute.manager [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Attaching volume 9c76fa8e-0378-4e87-aa12-bf0c8ece2978 to /dev/vdb
Aug 27 06:51:35 user nova-compute[73258]: DEBUG os_brick.utils [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fe3050-cdb9-4ee7-b826-713955700fe6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc3e1d6-605f-4d9f-b3b2-0d67d878799b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd74fb7-2ce8-4bf7-b053-908d3bd5763e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5da595f-0938-436b-82f5-815b6d373e42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:51:36 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:51:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe97bf17-be18-40c0-884d-50535caff89d]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG os_brick.utils [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:51:36 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Updating existing volume attachment record: cab965f2-3a59-4199-8339-1344e644fca0 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:51:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:41 user nova-compute[73258]: DEBUG nova.compute.manager [req-d0621a98-a387-4c49-90be-ea5e30b77701 req-67daa0b7-069f-4463-9bb1-814a0ec42142 service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Received event network-changed-97648bc4-126c-428e-9802-98a196d6bdb6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:51:41 user nova-compute[73258]: DEBUG nova.compute.manager [req-d0621a98-a387-4c49-90be-ea5e30b77701 req-67daa0b7-069f-4463-9bb1-814a0ec42142 service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Refreshing instance network info cache due to event network-changed-97648bc4-126c-428e-9802-98a196d6bdb6. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:51:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d0621a98-a387-4c49-90be-ea5e30b77701 req-67daa0b7-069f-4463-9bb1-814a0ec42142 service nova] Acquiring lock "refresh_cache-bcd29636-071b-4699-8360-e0d189df3f95" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:51:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d0621a98-a387-4c49-90be-ea5e30b77701 req-67daa0b7-069f-4463-9bb1-814a0ec42142 service nova] Acquired lock "refresh_cache-bcd29636-071b-4699-8360-e0d189df3f95" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:51:41 user nova-compute[73258]: DEBUG nova.network.neutron [req-d0621a98-a387-4c49-90be-ea5e30b77701 req-67daa0b7-069f-4463-9bb1-814a0ec42142 service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Refreshing network info cache for port 97648bc4-126c-428e-9802-98a196d6bdb6 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:51:41 user nova-compute[73258]: DEBUG nova.network.neutron [req-d0621a98-a387-4c49-90be-ea5e30b77701 req-67daa0b7-069f-4463-9bb1-814a0ec42142 service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Updated VIF entry in instance network info cache for port 97648bc4-126c-428e-9802-98a196d6bdb6. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:51:41 user nova-compute[73258]: DEBUG nova.network.neutron [req-d0621a98-a387-4c49-90be-ea5e30b77701 req-67daa0b7-069f-4463-9bb1-814a0ec42142 service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Updating instance_info_cache with network_info: [{"id": "97648bc4-126c-428e-9802-98a196d6bdb6", "address": "fa:16:3e:9f:26:af", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97648bc4-12", "ovs_interfaceid": "97648bc4-126c-428e-9802-98a196d6bdb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:51:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d0621a98-a387-4c49-90be-ea5e30b77701 req-67daa0b7-069f-4463-9bb1-814a0ec42142 service nova] Releasing lock "refresh_cache-bcd29636-071b-4699-8360-e0d189df3f95" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:51:41 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:51:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:51:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-9517c681-ed2b-49c2-94a6-aa2181b4b62f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:51:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-9517c681-ed2b-49c2-94a6-aa2181b4b62f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:51:41 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:51:42 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Updating instance_info_cache with network_info: [{"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:51:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-9517c681-ed2b-49c2-94a6-aa2181b4b62f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:51:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:51:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG nova.objects.instance [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lazy-loading 'flavor' on Instance uuid bc3cebb3-0e29-4899-94aa-d13a2a9ca86a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:45 user nova-compute[73258]: INFO nova.compute.manager [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Attaching volume e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd to /dev/vdb
Aug 27 06:51:45 user nova-compute[73258]: DEBUG os_brick.utils [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[48554ec8-e80f-4ddb-9475-ba61830a09cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8159599d-4439-4540-84e0-5d542cac0e05]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fda93b-baa2-431a-ab76-5f2727f06272]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6dffc8-1339-44f6-8f6f-6615d36efacd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:51:45 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbb6ec1-29fb-48c5-a155-a310b38c8909]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG os_brick.utils [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Updating existing volume attachment record: a820d3fc-56b4-4000-9791-3d69bfa089e1 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:51:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:51:46 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:51:46 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:51:47 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:51:47 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:51:48 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:51:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "bcd29636-071b-4699-8360-e0d189df3f95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "bcd29636-071b-4699-8360-e0d189df3f95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG nova.objects.instance [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lazy-loading 'flavor' on Instance uuid bcd29636-071b-4699-8360-e0d189df3f95 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "bcd29636-071b-4699-8360-e0d189df3f95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "bcd29636-071b-4699-8360-e0d189df3f95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "bcd29636-071b-4699-8360-e0d189df3f95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:52 user nova-compute[73258]: INFO nova.compute.manager [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Attaching volume aa79d516-b3c1-4baf-b6ad-06765173f752 to /dev/vdb
Aug 27 06:51:52 user nova-compute[73258]: DEBUG os_brick.utils [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab14ddd9-520d-466e-86cd-60f877990be0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79bd488-6286-4118-9b82-be6281dae9d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb75b63-61c3-4e29-8cf0-ff40afbca86d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[81515409-945d-47fc-821b-86a2ab35fa1b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:51:52 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:51:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13ed3d5-bba1-4087-bac9-8f2b6e7b8e0d]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG os_brick.utils [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:51:52 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Updating existing volume attachment record: c8658572-eb49-47eb-b153-28a26483731c {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:51:53 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:51:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:53 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZQTlaWPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:51:54 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:51:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:51:54 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:51:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:51:54 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b32b6e-2d6a-4cfd-a2ae-f5f037c64c90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:51:54 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d7d204-fe9e-4aa1-829d-cdd72694e058]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978] added
Aug 27 06:51:54 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d93694-a0e4-4a46-8faf-0691a1751521]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ec00f9-4900-48bc-9dc3-53c01477132a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZQTlaWPF {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZQTlaWPF" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d535548-8b8c-4e18-8d43-2229a7f25a31]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZQTlaWPF'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceaac444-6d7d-4b19-99f2-4a2fc9d75d57]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c881e4-201b-46bf-9efb-15c6d02355fc]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:51:54 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:51:54 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:51:54 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:51:54 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:51:54 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:51:54 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:51:54 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:51:54 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:51:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9373a9-7407-40cc-a78b-0eec807fe2ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978, portal: 172.16.0.220,3260]
Aug 27 06:51:55 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978, portal: 172.16.0.220,3260] successful.
Aug 27 06:51:55 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.067s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a73999b-bc57-47d2-9234-430aadde692d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f8bcb9-a725-4209-a54c-7a1be947644e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:51:55 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:51:55 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:51:55 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:51:55 user nova-compute[73258]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 (non-flash)
Aug 27 06:51:55 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:51:55 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:51:55 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:51:55 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:51:55 user nova-compute[73258]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 (non-flash)
Aug 27 06:51:55 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.436s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[586158ce-ab12-4faa-a1b9-7aa5868165e0]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZQTlaWPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.480s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] <== connect_volume: return (1485ms) {'type': 'block', 'scsi_wwn': '26635303966376630', 'path': '/dev/sdf'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635303966376630', 'path': '/dev/sdf'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG nova.objects.instance [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lazy-loading 'flavor' on Instance uuid d409b021-ab98-4f9f-a80d-99fe05de7b69 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:51:56 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:51:56 user nova-compute[73258]:   <source dev="/dev/sdf"/>
Aug 27 06:51:56 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:51:56 user nova-compute[73258]:   <serial>9c76fa8e-0378-4e87-aa12-bf0c8ece2978</serial>
Aug 27 06:51:56 user nova-compute[73258]: </disk>
Aug 27 06:51:56 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] No VIF found with MAC fa:16:3e:52:49:8c, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ba8bd925-6e5c-4ff5-b691-09496c82b1fc tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.052s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:51:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:51:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "d409b021-ab98-4f9f-a80d-99fe05de7b69" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:51:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:51:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:51:59 user nova-compute[73258]: INFO nova.compute.manager [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Detaching volume 9c76fa8e-0378-4e87-aa12-bf0c8ece2978
Aug 27 06:51:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:51:59 user nova-compute[73258]: INFO nova.virt.block_device [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Attempting to driver detach volume 9c76fa8e-0378-4e87-aa12-bf0c8ece2978 from mountpoint /dev/vdb
Aug 27 06:51:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Attempting to detach device vdb from instance d409b021-ab98-4f9f-a80d-99fe05de7b69 from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:51:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:51:59 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:51:59 user nova-compute[73258]:   <source dev="/dev/sdf"/>
Aug 27 06:51:59 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:51:59 user nova-compute[73258]:   <serial>9c76fa8e-0378-4e87-aa12-bf0c8ece2978</serial>
Aug 27 06:51:59 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:51:59 user nova-compute[73258]: </disk>
Aug 27 06:51:59 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:51:59 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Successfully detached device vdb from instance d409b021-ab98-4f9f-a80d-99fe05de7b69 from the persistent domain config.
Aug 27 06:51:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d409b021-ab98-4f9f-a80d-99fe05de7b69 from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:51:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:51:59 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:51:59 user nova-compute[73258]:   <source dev="/dev/sdf"/>
Aug 27 06:51:59 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:51:59 user nova-compute[73258]:   <serial>9c76fa8e-0378-4e87-aa12-bf0c8ece2978</serial>
Aug 27 06:51:59 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:51:59 user nova-compute[73258]: </disk>
Aug 27 06:51:59 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:51:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:51:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693119119.9504433, d409b021-ab98-4f9f-a80d-99fe05de7b69 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d409b021-ab98-4f9f-a80d-99fe05de7b69 {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:52:00 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Successfully detached device vdb from instance d409b021-ab98-4f9f-a80d-99fe05de7b69 from the live domain config.
Aug 27 06:52:00 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:52:00 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=6668MB free_disk=23.877437591552734GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZQTlaWPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:52:00 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:52:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[871d7a7a-9110-4e9a-a73e-6c99c1f530a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcce851-40e9-42d4-b273-e2d5782f7aec]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:00 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:00 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:00 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:00 user nova-compute[73258]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 (non-flash)
Aug 27 06:52:00 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:00 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:00 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:00 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:00 user nova-compute[73258]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 (non-flash)
Aug 27 06:52:00 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4107ae0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978'): ({'sdf'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Removing single pathed devices sdf {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde03325-3523-4f2b-b4a0-8a39680e80df]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8d3e4c-3594-47aa-8aa6-7c09510fc287]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Flushing IO for device /dev/sdf {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Applying migration context for instance ede6423b-ad91-4002-91d1-5849c6a4e26b as it has an incoming, in-progress migration 886cc733-8b90-4710-adf4-c1b165a4eb91. Migration status is finished {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 06:52:00 user nova-compute[73258]: INFO nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Updating resource usage from migration 886cc733-8b90-4710-adf4-c1b165a4eb91
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8bfd0d-1e82-484a-9fd2-dd8274c63356]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9b3b5b-44a8-4569-bd0b-52ec4161f5d7]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] SCSI volumes sdf have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1672aa9f-be6f-4357-877f-a48f62119df4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a836678e-240d-4ead-b0b5-64d146910a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9517c681-ed2b-49c2-94a6-aa2181b4b62f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 8396ca48-c47c-41b1-9872-24dbb0b9f526 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 7ee743f1-9611-4165-838e-54fccb332f1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bc3cebb3-0e29-4899-94aa-d13a2a9ca86a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance b22b7599-5a37-4370-b440-f04e3dc88f98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance d409b021-ab98-4f9f-a80d-99fe05de7b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bcd29636-071b-4699-8360-e0d189df3f95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Migration 886cc733-8b90-4710-adf4-c1b165a4eb91 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance ede6423b-ad91-4002-91d1-5849c6a4e26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[971207eb-bb64-40a7-8f65-bbf1b5324c6f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d87bab-7b1d-4da6-bd46-59a1a2ad95d6]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978, portal: 172.16.0.220,3260]
Aug 27 06:52:00 user nova-compute[73258]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978, portal: 172.16.0.220,3260] successful.
Aug 27 06:52:00 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c76fa8e-0378-4e87-aa12-bf0c8ece2978 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f71936-8a7d-45bc-b476-069aa5b1e757]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] <== disconnect_volume: return (315ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:52:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.636s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:01 user nova-compute[73258]: DEBUG nova.objects.instance [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lazy-loading 'flavor' on Instance uuid d409b021-ab98-4f9f-a80d-99fe05de7b69 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:52:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9566f8da-54cb-4c95-9147-a68bcddf4e40 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.023s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olbJMszc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:52:04 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:52:04 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:52:04 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe83b5a-efbc-4835-a45e-98c112883bf9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:52:04 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae43fa4-3bff-4485-b8de-1eb47f62caa0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd] added
Aug 27 06:52:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44416bb-3670-4cd0-aa7b-319097ed428a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46c9350-2375-4058-b256-d67e31e1106e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v olbJMszc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v olbJMszc" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f012bbf-5faa-4130-96e0-2ec97ca8c7af]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'olbJMszc'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3e77b3-57cc-4268-ba0a-ae9058907c64]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[91302648-48ff-4cf4-a902-9450d0199bbe]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:04 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:04 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:04 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:04 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:04 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:04 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2171deba-941a-4664-90b1-cc463fe35354]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260]
Aug 27 06:52:04 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260] successful.
Aug 27 06:52:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83c83a4-b3da-4b5d-bc61-6f797b36dfd6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f80c5d-54bb-4b9d-b859-3f86e67c9b25]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:04 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:04 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:04 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:04 user nova-compute[73258]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:52:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:04 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:04 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:04 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:04 user nova-compute[73258]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:52:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb927252-97a7-4644-ae2a-866a175462ee]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:04 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: None {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olbJMszc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23866313138333131', 'path': '/dev/sdf'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866313138333131', 'path': '/dev/sdf'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG nova.objects.instance [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lazy-loading 'flavor' on Instance uuid bc3cebb3-0e29-4899-94aa-d13a2a9ca86a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:52:05 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:52:05 user nova-compute[73258]:   <source dev="/dev/sdf"/>
Aug 27 06:52:05 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:52:05 user nova-compute[73258]:   <serial>e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd</serial>
Aug 27 06:52:05 user nova-compute[73258]: </disk>
Aug 27 06:52:05 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iarsMJEX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:52:05 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:52:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:52:05 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:52:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:52:05 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:52:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa4a6b0-ae9d-40da-bb1d-cd7d68aa8263]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:52:05 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dca25c-d00c-4809-8a90-4e5fa4be1989]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752] added
Aug 27 06:52:05 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ec5239-59ad-4fb4-a9b8-4a7e6a5909e3]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c3163a-b7e4-4b05-a041-e827ebc26e48]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iarsMJEX {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iarsMJEX" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba820b5b-f97e-4bd3-b330-5e5088950bbd]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iarsMJEX'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[98223fcd-7565-4f9d-a9bf-5bb43e983202]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf25fab-1967-4089-8fb7-440d6cdbd203]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:06 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:06 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:06 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:06 user nova-compute[73258]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:52:06 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:06 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:06 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:06 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:06 user nova-compute[73258]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:52:06 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8d260a-0994-4df0-acbe-06f0205ce572]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752, portal: 172.16.0.220,3260]
Aug 27 06:52:06 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752, portal: 172.16.0.220,3260] successful.
Aug 27 06:52:06 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f192437-f859-43da-9554-9195e6b2a85e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[94252fea-b20b-4f8a-81db-9801ace8a7bc]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:06 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:06 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:06 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:06 user nova-compute[73258]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:52:06 user nova-compute[73258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 (non-flash)
Aug 27 06:52:06 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:06 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:06 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:06 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:06 user nova-compute[73258]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:52:06 user nova-compute[73258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 (non-flash)
Aug 27 06:52:06 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] HCTL ('38', '-', '-', 0) found on session 34 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3498a17-81fa-4f55-a8a2-f3b2115e9cc2]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: None {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] No VIF found with MAC fa:16:3e:6d:e9:55, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:52:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f7722505-2416-4534-a335-628cbb256212 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.107s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:07 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:52:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iarsMJEX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:52:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:52:07 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '26563343964653665', 'path': '/dev/sdg'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:52:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563343964653665', 'path': '/dev/sdg'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:52:07 user nova-compute[73258]: DEBUG nova.objects.instance [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lazy-loading 'flavor' on Instance uuid bcd29636-071b-4699-8360-e0d189df3f95 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:52:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:52:07 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:52:07 user nova-compute[73258]:   <source dev="/dev/sdg"/>
Aug 27 06:52:07 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:52:07 user nova-compute[73258]:   <serial>aa79d516-b3c1-4baf-b6ad-06765173f752</serial>
Aug 27 06:52:07 user nova-compute[73258]: </disk>
Aug 27 06:52:07 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:52:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:52:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:52:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] No VIF found with MAC fa:16:3e:9f:26:af, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:52:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-85a6bf50-5cec-4ba3-818e-7231601c9233 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "bcd29636-071b-4699-8360-e0d189df3f95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.171s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:08 user nova-compute[73258]: DEBUG nova.compute.manager [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Stashing vm_state: active {{(pid=73258) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 27 06:52:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:08 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:52:08 user nova-compute[73258]: INFO nova.compute.claims [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Claim successful on node user
Aug 27 06:52:08 user nova-compute[73258]: INFO nova.compute.resource_tracker [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Updating resource usage from migration 7558c8cf-6d73-409d-a4f0-ace10cb843eb
Aug 27 06:52:08 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:52:08 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:52:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.615s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:08 user nova-compute[73258]: INFO nova.compute.manager [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Migrating
Aug 27 06:52:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:52:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquired lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:52:08 user nova-compute[73258]: DEBUG nova.network.neutron [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "bcd29636-071b-4699-8360-e0d189df3f95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "bcd29636-071b-4699-8360-e0d189df3f95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:09 user nova-compute[73258]: INFO nova.compute.manager [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Detaching volume aa79d516-b3c1-4baf-b6ad-06765173f752
Aug 27 06:52:09 user nova-compute[73258]: INFO nova.virt.block_device [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Attempting to driver detach volume aa79d516-b3c1-4baf-b6ad-06765173f752 from mountpoint /dev/vdb
Aug 27 06:52:09 user nova-compute[73258]: DEBUG nova.network.neutron [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Updating instance_info_cache with network_info: [{"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Attempting to detach device vdb from instance bcd29636-071b-4699-8360-e0d189df3f95 from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:52:09 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:52:09 user nova-compute[73258]:   <source dev="/dev/sdg"/>
Aug 27 06:52:09 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:52:09 user nova-compute[73258]:   <serial>aa79d516-b3c1-4baf-b6ad-06765173f752</serial>
Aug 27 06:52:09 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:52:09 user nova-compute[73258]: </disk>
Aug 27 06:52:09 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Releasing lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:52:09 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Successfully detached device vdb from instance bcd29636-071b-4699-8360-e0d189df3f95 from the persistent domain config.
Aug 27 06:52:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bcd29636-071b-4699-8360-e0d189df3f95 from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:52:09 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:52:09 user nova-compute[73258]:   <source dev="/dev/sdg"/>
Aug 27 06:52:09 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:52:09 user nova-compute[73258]:   <serial>aa79d516-b3c1-4baf-b6ad-06765173f752</serial>
Aug 27 06:52:09 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:52:09 user nova-compute[73258]: </disk>
Aug 27 06:52:09 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Starting migrate_disk_and_power_off {{(pid=73258) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-944089c4-6e1e-4700-af24-14fa916a8d14 req-35c7cabc-834d-4428-a5d8-3a888fbfc401 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received event network-vif-unplugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-944089c4-6e1e-4700-af24-14fa916a8d14 req-35c7cabc-834d-4428-a5d8-3a888fbfc401 service nova] Acquiring lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-944089c4-6e1e-4700-af24-14fa916a8d14 req-35c7cabc-834d-4428-a5d8-3a888fbfc401 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-944089c4-6e1e-4700-af24-14fa916a8d14 req-35c7cabc-834d-4428-a5d8-3a888fbfc401 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-944089c4-6e1e-4700-af24-14fa916a8d14 req-35c7cabc-834d-4428-a5d8-3a888fbfc401 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] No waiting events found dispatching network-vif-unplugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:52:09 user nova-compute[73258]: WARNING nova.compute.manager [req-944089c4-6e1e-4700-af24-14fa916a8d14 req-35c7cabc-834d-4428-a5d8-3a888fbfc401 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received unexpected event network-vif-unplugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 for instance with vm_state active and task_state resize_migrating.
Aug 27 06:52:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693119129.9006379, bcd29636-071b-4699-8360-e0d189df3f95 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bcd29636-071b-4699-8360-e0d189df3f95 {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:52:09 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Successfully detached device vdb from instance bcd29636-071b-4699-8360-e0d189df3f95 from the live domain config.
Aug 27 06:52:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iarsMJEX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:52:09 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:52:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[334435bd-dbbb-4ae8-bf95-5397811a20f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3753462e-b16e-4eb9-a068-94a4540e555d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:09 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:09 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:09 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:09 user nova-compute[73258]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:52:09 user nova-compute[73258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 (non-flash)
Aug 27 06:52:09 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:09 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:09 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:09 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:09 user nova-compute[73258]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:52:09 user nova-compute[73258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 (non-flash)
Aug 27 06:52:09 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa410523130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752'): ({'sdg'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Removing single pathed devices sdg {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:52:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb39221-bccf-4c5e-90fd-56cad7e92d8d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6471cd1-bf0c-4305-b22e-bdf2c5a73c61]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Flushing IO for device /dev/sdg {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[939e3179-4e32-422e-b3d0-cc1c4f6e7c4d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d473d388-21a0-4b7a-8270-957a24039de6]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] SCSI volumes sdg have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6ab096-86a0-4a33-bdaf-b229d7cf2552]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7052d00-0677-44e9-a279-076f288192d0]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752, portal: 172.16.0.220,3260]
Aug 27 06:52:10 user nova-compute[73258]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752, portal: 172.16.0.220,3260] successful.
Aug 27 06:52:10 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa79d516-b3c1-4baf-b6ad-06765173f752 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3b9809-2fea-480e-ae88-fe22ba19d4f1]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] <== disconnect_volume: return (341ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:52:10 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Instance destroyed successfully.
Aug 27 06:52:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1707767622',display_name='tempest-ServerActionsTestOtherB-server-1707767622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1707767622',id=28,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCup9tVy/ES6sbgueL/45Bba8K9LkjKsB0AzSdwXqHLd/SJJd00ZmJLNSvj/I/yfKqYtF7c1wkGM0pTAca7U7ASXDTxzPj0yMtlZAbKBP15oOn8TvN1fkhhoEIFexZqUw==',key_name='tempest-keypair-903561007',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:48:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cf1d43b7929c4f60a9948f0d9ed35fce',ramdisk_id='',reservation_id='r-rpya4ij3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-895910456',owner_user_name='tempest-ServerActionsTestOtherB-895910456-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:52:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ec7b0ff818840ab9d77576254aaf89e',uuid=bc3cebb3-0e29-4899-94aa-d13a2a9ca86a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1053221461-network", "vif_mac": "fa:16:3e:6d:e9:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Converting VIF {"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1053221461-network", "vif_mac": "fa:16:3e:6d:e9:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_vif [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8024bd0-32, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:52:10 user nova-compute[73258]: INFO os_vif [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32')
Aug 27 06:52:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olbJMszc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:52:10 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b5dcad-02e8-42f6-8558-72440f1666fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb58df0e-65a6-4b61-8c4b-879b1ddbd844]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:10 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:10 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:10 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:10 user nova-compute[73258]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:52:10 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:10 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:10 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:10 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:10 user nova-compute[73258]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:52:10 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa410523010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd'): ({'sdf'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Removing single pathed devices sdf {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[80792c94-9082-48a5-a59e-7933aa4146cd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d30b8f-a54d-4d60-bebf-b154d66cf33b]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Flushing IO for device /dev/sdf {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf1e9b2-49a1-47b9-b994-4b60ec7bf324]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f9acf4-54d3-4cb1-8b93-12b5620eca27]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] SCSI volumes sdf have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ce3592-0879-4ecc-ba83-642c2de65442]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --logout" returned: 0 in 0.154s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[66803024-7945-4833-98d2-a9b14502f5f4]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260]
Aug 27 06:52:10 user nova-compute[73258]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260] successful.
Aug 27 06:52:10 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aa9706-7b3f-4b33-8d43-d27188c3be00]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] <== disconnect_volume: return (409ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:52:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a_resize/disk /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:11 user nova-compute[73258]: DEBUG nova.objects.instance [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lazy-loading 'flavor' on Instance uuid bcd29636-071b-4699-8360-e0d189df3f95 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:52:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-645e9ddd-7354-4103-a23b-f01111893eeb tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "bcd29636-071b-4699-8360-e0d189df3f95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.113s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CMD "cp -r /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a_resize/disk /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk" returned: 0 in 0.293s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a_resize/disk.info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk.info {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CMD "cp -r /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a_resize/disk.info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk.info" returned: 0 in 0.040s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:11 user nova-compute[73258]: DEBUG nova.compute.manager [req-20ecff02-6b1a-4f21-b496-78cff6885b46 req-6b22712f-590f-4738-9e31-47ee775bd17f service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received event network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:52:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-20ecff02-6b1a-4f21-b496-78cff6885b46 req-6b22712f-590f-4738-9e31-47ee775bd17f service nova] Acquiring lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-20ecff02-6b1a-4f21-b496-78cff6885b46 req-6b22712f-590f-4738-9e31-47ee775bd17f service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-20ecff02-6b1a-4f21-b496-78cff6885b46 req-6b22712f-590f-4738-9e31-47ee775bd17f service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:11 user nova-compute[73258]: DEBUG nova.compute.manager [req-20ecff02-6b1a-4f21-b496-78cff6885b46 req-6b22712f-590f-4738-9e31-47ee775bd17f service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] No waiting events found dispatching network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:52:11 user nova-compute[73258]: WARNING nova.compute.manager [req-20ecff02-6b1a-4f21-b496-78cff6885b46 req-6b22712f-590f-4738-9e31-47ee775bd17f service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received unexpected event network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 for instance with vm_state active and task_state resize_migrating.
Aug 27 06:52:12 user nova-compute[73258]: DEBUG nova.network.neutron [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Port c8024bd0-329f-4c9e-8974-4881fc97ada9 binding to destination host user is already ACTIVE {{(pid=73258) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 27 06:52:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:52:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquired lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:52:13 user nova-compute[73258]: DEBUG nova.network.neutron [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:52:13 user nova-compute[73258]: DEBUG nova.network.neutron [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Updating instance_info_cache with network_info: [{"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:52:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Releasing lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG os_brick.utils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6e418b-310a-4878-8c0b-eebeda54e7ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cd6437-6621-447e-b1e7-d432d290b7bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb04ca18-3bab-4e85-aeb1-316ee1fd8912]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f17cc3-c879-448c-8ef7-917dce482997]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:52:14 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:52:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8479f4ce-ff5a-4ba3-bdea-d70b576ba859]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG os_brick.utils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:52:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d0d07e2a-661b-41b0-bdd6-1c9cf6943f66 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "ede6423b-ad91-4002-91d1-5849c6a4e26b" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d0d07e2a-661b-41b0-bdd6-1c9cf6943f66 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:23 user nova-compute[73258]: DEBUG nova.compute.manager [None req-d0d07e2a-661b-41b0-bdd6-1c9cf6943f66 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Going to confirm migration 1 {{(pid=73258) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 27 06:52:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d0d07e2a-661b-41b0-bdd6-1c9cf6943f66 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "refresh_cache-ede6423b-ad91-4002-91d1-5849c6a4e26b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:52:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d0d07e2a-661b-41b0-bdd6-1c9cf6943f66 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquired lock "refresh_cache-ede6423b-ad91-4002-91d1-5849c6a4e26b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:52:23 user nova-compute[73258]: DEBUG nova.network.neutron [None req-d0d07e2a-661b-41b0-bdd6-1c9cf6943f66 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:52:23 user nova-compute[73258]: DEBUG nova.objects.instance [None req-d0d07e2a-661b-41b0-bdd6-1c9cf6943f66 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lazy-loading 'info_cache' on Instance uuid ede6423b-ad91-4002-91d1-5849c6a4e26b {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:52:24 user nova-compute[73258]: DEBUG nova.network.neutron [None req-d0d07e2a-661b-41b0-bdd6-1c9cf6943f66 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Updating instance_info_cache with network_info: [{"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:52:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d0d07e2a-661b-41b0-bdd6-1c9cf6943f66 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Releasing lock "refresh_cache-ede6423b-ad91-4002-91d1-5849c6a4e26b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:52:24 user nova-compute[73258]: DEBUG nova.objects.instance [None req-d0d07e2a-661b-41b0-bdd6-1c9cf6943f66 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lazy-loading 'migration_context' on Instance uuid ede6423b-ad91-4002-91d1-5849c6a4e26b {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:52:24 user nova-compute[73258]: DEBUG nova.objects.base [None req-d0d07e2a-661b-41b0-bdd6-1c9cf6943f66 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Object Instance<ede6423b-ad91-4002-91d1-5849c6a4e26b> lazy-loaded attributes: info_cache,migration_context {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:52:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d0d07e2a-661b-41b0-bdd6-1c9cf6943f66 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d0d07e2a-661b-41b0-bdd6-1c9cf6943f66 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:24 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-d0d07e2a-661b-41b0-bdd6-1c9cf6943f66 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:52:24 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-d0d07e2a-661b-41b0-bdd6-1c9cf6943f66 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:52:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d0d07e2a-661b-41b0-bdd6-1c9cf6943f66 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.537s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:24 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-d0d07e2a-661b-41b0-bdd6-1c9cf6943f66 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Deleted allocation for migration 886cc733-8b90-4710-adf4-c1b165a4eb91
Aug 27 06:52:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-d0d07e2a-661b-41b0-bdd6-1c9cf6943f66 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.822s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:25 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119130.2972503, bc3cebb3-0e29-4899-94aa-d13a2a9ca86a => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:52:25 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] VM Stopped (Lifecycle Event)
Aug 27 06:52:25 user nova-compute[73258]: DEBUG nova.compute.manager [None req-663f46f6-81dc-4bf6-8e35-4aa7f39fd1be None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:52:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:25 user nova-compute[73258]: DEBUG nova.compute.manager [None req-663f46f6-81dc-4bf6-8e35-4aa7f39fd1be None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:52:25 user nova-compute[73258]: INFO nova.compute.manager [None req-663f46f6-81dc-4bf6-8e35-4aa7f39fd1be None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 06:52:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Starting finish_migration {{(pid=73258) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 27 06:52:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Instance directory exists: not creating {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 06:52:26 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Creating image(s)
Aug 27 06:52:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk. size=21474836480 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk 21474836480 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk 21474836480" returned: 0 in 0.053s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Did not create local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Ensure instance console log exists: /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Start _get_guest_xml network_info=[{"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1053221461-network", "vif_mac": "fa:16:3e:6d:e9:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olbJMszc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'bc3cebb3-0e29-4899-94aa-d13a2a9ca86a', 'attached_at': '2023-08-27T06:52:27.000000', 'detached_at': '', 'volume_id': 'e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd', 'serial': 'e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd'}, 'attachment_id': '655d667c-883d-4d93-a949-b826bcdc8944', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:52:27 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:52:27 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olbJMszc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:52:27 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:52:27 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:52:27 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4722db-3a8e-449c-b731-647b40002559]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:52:27 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a963f2e9-9727-4b32-a5a2-1461ffbe4315]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd] added
Aug 27 06:52:27 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cd8eca-af98-425d-9e8e-62208ea15385]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c816ef0c-66c3-4cd7-94b1-d0eea4d586a7]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v olbJMszc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v olbJMszc" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3111b395-bd5e-4f29-bcd2-a5594ee72944]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'olbJMszc'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc798d9d-a6cf-4760-9753-b62881593e14]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57a5d62-e8cf-4bfb-a5d7-3c4d9d02cbf5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5efdf22a-cc5b-4a7d-81de-1f9dc5065e8a (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:27 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:27 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:27 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:27 user nova-compute[73258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5efdf22a-cc5b-4a7d-81de-1f9dc5065e8a (non-flash)
Aug 27 06:52:27 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:27 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:27 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:27 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:27 user nova-compute[73258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5efdf22a-cc5b-4a7d-81de-1f9dc5065e8a (non-flash)
Aug 27 06:52:27 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[333c5b6e-1621-4903-aa34-4036484fe6ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260]
Aug 27 06:52:27 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260] successful.
Aug 27 06:52:27 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfeb035-db0a-4a38-b005-1409b4a983b9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1132d63a-dae2-49f7-ae0c-899a840fbf3c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5efdf22a-cc5b-4a7d-81de-1f9dc5065e8a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:27 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:27 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:27 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:27 user nova-compute[73258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5efdf22a-cc5b-4a7d-81de-1f9dc5065e8a (non-flash)
Aug 27 06:52:27 user nova-compute[73258]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:52:27 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:27 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:27 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:27 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:27 user nova-compute[73258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5efdf22a-cc5b-4a7d-81de-1f9dc5065e8a (non-flash)
Aug 27 06:52:27 user nova-compute[73258]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:52:27 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[49591fdd-2dd2-4e5a-a16f-624db5efed8b]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:27 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: None {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olbJMszc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23866313138333131', 'path': '/dev/sdg'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866313138333131', 'path': '/dev/sdg'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1707767622',display_name='tempest-ServerActionsTestOtherB-server-1707767622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1707767622',id=28,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCup9tVy/ES6sbgueL/45Bba8K9LkjKsB0AzSdwXqHLd/SJJd00ZmJLNSvj/I/yfKqYtF7c1wkGM0pTAca7U7ASXDTxzPj0yMtlZAbKBP15oOn8TvN1fkhhoEIFexZqUw==',key_name='tempest-keypair-903561007',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:48:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cf1d43b7929c4f60a9948f0d9ed35fce',ramdisk_id='',reservation_id='r-rpya4ij3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-895910456',owner_user_name='tempest-ServerActionsTestOtherB-895910456-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:52:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ec7b0ff818840ab9d77576254aaf89e',uuid=bc3cebb3-0e29-4899-94aa-d13a2a9ca86a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1053221461-network", "vif_mac": "fa:16:3e:6d:e9:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Converting VIF {"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1053221461-network", "vif_mac": "fa:16:3e:6d:e9:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:52:28 user nova-compute[73258]:   <uuid>bc3cebb3-0e29-4899-94aa-d13a2a9ca86a</uuid>
Aug 27 06:52:28 user nova-compute[73258]:   <name>instance-0000001c</name>
Aug 27 06:52:28 user nova-compute[73258]:   <memory>2097152</memory>
Aug 27 06:52:28 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:52:28 user nova-compute[73258]:   <metadata>
Aug 27 06:52:28 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:52:28 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:52:28 user nova-compute[73258]:       <nova:name>tempest-ServerActionsTestOtherB-server-1707767622</nova:name>
Aug 27 06:52:28 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:52:27</nova:creationTime>
Aug 27 06:52:28 user nova-compute[73258]:       <nova:flavor name="m1.small">
Aug 27 06:52:28 user nova-compute[73258]:         <nova:memory>2048</nova:memory>
Aug 27 06:52:28 user nova-compute[73258]:         <nova:disk>20</nova:disk>
Aug 27 06:52:28 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:52:28 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:52:28 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:52:28 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:52:28 user nova-compute[73258]:       <nova:owner>
Aug 27 06:52:28 user nova-compute[73258]:         <nova:user uuid="6ec7b0ff818840ab9d77576254aaf89e">tempest-ServerActionsTestOtherB-895910456-project-member</nova:user>
Aug 27 06:52:28 user nova-compute[73258]:         <nova:project uuid="cf1d43b7929c4f60a9948f0d9ed35fce">tempest-ServerActionsTestOtherB-895910456</nova:project>
Aug 27 06:52:28 user nova-compute[73258]:       </nova:owner>
Aug 27 06:52:28 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:52:28 user nova-compute[73258]:       <nova:ports>
Aug 27 06:52:28 user nova-compute[73258]:         <nova:port uuid="c8024bd0-329f-4c9e-8974-4881fc97ada9">
Aug 27 06:52:28 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 06:52:28 user nova-compute[73258]:         </nova:port>
Aug 27 06:52:28 user nova-compute[73258]:       </nova:ports>
Aug 27 06:52:28 user nova-compute[73258]:     </nova:instance>
Aug 27 06:52:28 user nova-compute[73258]:   </metadata>
Aug 27 06:52:28 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:52:28 user nova-compute[73258]:     <system>
Aug 27 06:52:28 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:52:28 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:52:28 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:52:28 user nova-compute[73258]:       <entry name="serial">bc3cebb3-0e29-4899-94aa-d13a2a9ca86a</entry>
Aug 27 06:52:28 user nova-compute[73258]:       <entry name="uuid">bc3cebb3-0e29-4899-94aa-d13a2a9ca86a</entry>
Aug 27 06:52:28 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:52:28 user nova-compute[73258]:     </system>
Aug 27 06:52:28 user nova-compute[73258]:   </sysinfo>
Aug 27 06:52:28 user nova-compute[73258]:   <os>
Aug 27 06:52:28 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:52:28 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:52:28 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:52:28 user nova-compute[73258]:   </os>
Aug 27 06:52:28 user nova-compute[73258]:   <features>
Aug 27 06:52:28 user nova-compute[73258]:     <acpi/>
Aug 27 06:52:28 user nova-compute[73258]:     <apic/>
Aug 27 06:52:28 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:52:28 user nova-compute[73258]:   </features>
Aug 27 06:52:28 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:52:28 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:52:28 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:52:28 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:52:28 user nova-compute[73258]:   </clock>
Aug 27 06:52:28 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:52:28 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:52:28 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:52:28 user nova-compute[73258]:   </cpu>
Aug 27 06:52:28 user nova-compute[73258]:   <devices>
Aug 27 06:52:28 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:52:28 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:52:28 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk"/>
Aug 27 06:52:28 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:52:28 user nova-compute[73258]:     </disk>
Aug 27 06:52:28 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:52:28 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:52:28 user nova-compute[73258]:       <source dev="/dev/sdg"/>
Aug 27 06:52:28 user nova-compute[73258]:       <target dev="vdb" bus="virtio"/>
Aug 27 06:52:28 user nova-compute[73258]:       <serial>e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd</serial>
Aug 27 06:52:28 user nova-compute[73258]:     </disk>
Aug 27 06:52:28 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:52:28 user nova-compute[73258]:       <mac address="fa:16:3e:6d:e9:55"/>
Aug 27 06:52:28 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:52:28 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:52:28 user nova-compute[73258]:       <target dev="tapc8024bd0-32"/>
Aug 27 06:52:28 user nova-compute[73258]:     </interface>
Aug 27 06:52:28 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:52:28 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/console.log" append="off"/>
Aug 27 06:52:28 user nova-compute[73258]:     </serial>
Aug 27 06:52:28 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:52:28 user nova-compute[73258]:     <video>
Aug 27 06:52:28 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:52:28 user nova-compute[73258]:     </video>
Aug 27 06:52:28 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:52:28 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:52:28 user nova-compute[73258]:     </rng>
Aug 27 06:52:28 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:52:28 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:52:28 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:52:28 user nova-compute[73258]:     </memballoon>
Aug 27 06:52:28 user nova-compute[73258]:   </devices>
Aug 27 06:52:28 user nova-compute[73258]: </domain>
Aug 27 06:52:28 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1707767622',display_name='tempest-ServerActionsTestOtherB-server-1707767622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1707767622',id=28,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCup9tVy/ES6sbgueL/45Bba8K9LkjKsB0AzSdwXqHLd/SJJd00ZmJLNSvj/I/yfKqYtF7c1wkGM0pTAca7U7ASXDTxzPj0yMtlZAbKBP15oOn8TvN1fkhhoEIFexZqUw==',key_name='tempest-keypair-903561007',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:48:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cf1d43b7929c4f60a9948f0d9ed35fce',ramdisk_id='',reservation_id='r-rpya4ij3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-895910456',owner_user_name='tempest-ServerActionsTestOtherB-895910456-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:52:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ec7b0ff818840ab9d77576254aaf89e',uuid=bc3cebb3-0e29-4899-94aa-d13a2a9ca86a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1053221461-network", "vif_mac": "fa:16:3e:6d:e9:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Converting VIF {"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1053221461-network", "vif_mac": "fa:16:3e:6d:e9:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG os_vif [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8024bd0-32, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8024bd0-32, col_values=(('external_ids', {'iface-id': 'c8024bd0-329f-4c9e-8974-4881fc97ada9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:e9:55', 'vm-uuid': 'bc3cebb3-0e29-4899-94aa-d13a2a9ca86a'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:28 user nova-compute[73258]: INFO os_vif [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32')
Aug 27 06:52:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:52:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] No VIF found with MAC fa:16:3e:6d:e9:55, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:52:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquiring lock "8396ca48-c47c-41b1-9872-24dbb0b9f526" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "8396ca48-c47c-41b1-9872-24dbb0b9f526" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquiring lock "8396ca48-c47c-41b1-9872-24dbb0b9f526-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "8396ca48-c47c-41b1-9872-24dbb0b9f526-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "8396ca48-c47c-41b1-9872-24dbb0b9f526-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:29 user nova-compute[73258]: INFO nova.compute.manager [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Terminating instance
Aug 27 06:52:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:52:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-f073d89f-2d19-49f0-a85e-891827c05eba req-7c414b97-168b-4673-aec7-07d6f2faf4c0 service nova] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Received event network-vif-unplugged-88db4c6e-c521-4efa-8311-ba38294ef3fe {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:52:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f073d89f-2d19-49f0-a85e-891827c05eba req-7c414b97-168b-4673-aec7-07d6f2faf4c0 service nova] Acquiring lock "8396ca48-c47c-41b1-9872-24dbb0b9f526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f073d89f-2d19-49f0-a85e-891827c05eba req-7c414b97-168b-4673-aec7-07d6f2faf4c0 service nova] Lock "8396ca48-c47c-41b1-9872-24dbb0b9f526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f073d89f-2d19-49f0-a85e-891827c05eba req-7c414b97-168b-4673-aec7-07d6f2faf4c0 service nova] Lock "8396ca48-c47c-41b1-9872-24dbb0b9f526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-f073d89f-2d19-49f0-a85e-891827c05eba req-7c414b97-168b-4673-aec7-07d6f2faf4c0 service nova] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] No waiting events found dispatching network-vif-unplugged-88db4c6e-c521-4efa-8311-ba38294ef3fe {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:52:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-f073d89f-2d19-49f0-a85e-891827c05eba req-7c414b97-168b-4673-aec7-07d6f2faf4c0 service nova] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Received event network-vif-unplugged-88db4c6e-c521-4efa-8311-ba38294ef3fe for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:52:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:52:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:30 user nova-compute[73258]: INFO nova.compute.manager [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] instance snapshotting
Aug 27 06:52:31 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Beginning live snapshot process
Aug 27 06:52:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:31 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Instance destroyed successfully.
Aug 27 06:52:31 user nova-compute[73258]: DEBUG nova.objects.instance [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lazy-loading 'resources' on Instance uuid 8396ca48-c47c-41b1-9872-24dbb0b9f526 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:52:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-976425331',display_name='tempest-ServersNegativeTestJSON-server-976425331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-976425331',id=21,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:43:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e11b4cd365934e568225156ab305cda2',ramdisk_id='',reservation_id='r-48ic0eo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1353100795',owner_user_name='tempest-ServersNegativeTestJSON-1353100795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:43:14Z,user_data=None,user_id='7bd578ee905a49e88abe9c72668bc1dd',uuid=8396ca48-c47c-41b1-9872-24dbb0b9f526,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "address": "fa:16:3e:c0:6e:7e", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db4c6e-c5", "ovs_interfaceid": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:52:31 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Converting VIF {"id": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "address": "fa:16:3e:c0:6e:7e", "network": {"id": "baf86837-de09-4d7d-a6a1-36fb8bf7bf68", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-568741407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11b4cd365934e568225156ab305cda2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db4c6e-c5", "ovs_interfaceid": "88db4c6e-c521-4efa-8311-ba38294ef3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:52:31 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6e:7e,bridge_name='br-int',has_traffic_filtering=True,id=88db4c6e-c521-4efa-8311-ba38294ef3fe,network=Network(baf86837-de09-4d7d-a6a1-36fb8bf7bf68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88db4c6e-c5') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:52:31 user nova-compute[73258]: DEBUG os_vif [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6e:7e,bridge_name='br-int',has_traffic_filtering=True,id=88db4c6e-c521-4efa-8311-ba38294ef3fe,network=Network(baf86837-de09-4d7d-a6a1-36fb8bf7bf68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88db4c6e-c5') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:52:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88db4c6e-c5, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:52:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:52:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:31 user nova-compute[73258]: INFO os_vif [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:6e:7e,bridge_name='br-int',has_traffic_filtering=True,id=88db4c6e-c521-4efa-8311-ba38294ef3fe,network=Network(baf86837-de09-4d7d-a6a1-36fb8bf7bf68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88db4c6e-c5')
Aug 27 06:52:31 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Deleting instance files /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526_del
Aug 27 06:52:31 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Deletion of /opt/stack/data/nova/instances/8396ca48-c47c-41b1-9872-24dbb0b9f526_del complete
Aug 27 06:52:31 user nova-compute[73258]: INFO nova.compute.manager [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Took 2.24 seconds to destroy the instance on the hypervisor.
Aug 27 06:52:31 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:52:31 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:52:31 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json -f qcow2 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-ac2c564f-5c98-4873-9c1a-474da5a38cee req-23fa3683-6aec-4f81-80dd-65853ed57655 service nova] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Received event network-vif-plugged-88db4c6e-c521-4efa-8311-ba38294ef3fe {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ac2c564f-5c98-4873-9c1a-474da5a38cee req-23fa3683-6aec-4f81-80dd-65853ed57655 service nova] Acquiring lock "8396ca48-c47c-41b1-9872-24dbb0b9f526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ac2c564f-5c98-4873-9c1a-474da5a38cee req-23fa3683-6aec-4f81-80dd-65853ed57655 service nova] Lock "8396ca48-c47c-41b1-9872-24dbb0b9f526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ac2c564f-5c98-4873-9c1a-474da5a38cee req-23fa3683-6aec-4f81-80dd-65853ed57655 service nova] Lock "8396ca48-c47c-41b1-9872-24dbb0b9f526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-ac2c564f-5c98-4873-9c1a-474da5a38cee req-23fa3683-6aec-4f81-80dd-65853ed57655 service nova] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] No waiting events found dispatching network-vif-plugged-88db4c6e-c521-4efa-8311-ba38294ef3fe {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:52:32 user nova-compute[73258]: WARNING nova.compute.manager [req-ac2c564f-5c98-4873-9c1a-474da5a38cee req-23fa3683-6aec-4f81-80dd-65853ed57655 service nova] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Received unexpected event network-vif-plugged-88db4c6e-c521-4efa-8311-ba38294ef3fe for instance with vm_state active and task_state deleting.
Aug 27 06:52:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-ac2c564f-5c98-4873-9c1a-474da5a38cee req-23fa3683-6aec-4f81-80dd-65853ed57655 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received event network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ac2c564f-5c98-4873-9c1a-474da5a38cee req-23fa3683-6aec-4f81-80dd-65853ed57655 service nova] Acquiring lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ac2c564f-5c98-4873-9c1a-474da5a38cee req-23fa3683-6aec-4f81-80dd-65853ed57655 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ac2c564f-5c98-4873-9c1a-474da5a38cee req-23fa3683-6aec-4f81-80dd-65853ed57655 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-ac2c564f-5c98-4873-9c1a-474da5a38cee req-23fa3683-6aec-4f81-80dd-65853ed57655 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] No waiting events found dispatching network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:52:32 user nova-compute[73258]: WARNING nova.compute.manager [req-ac2c564f-5c98-4873-9c1a-474da5a38cee req-23fa3683-6aec-4f81-80dd-65853ed57655 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received unexpected event network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 for instance with vm_state active and task_state resize_finish.
Aug 27 06:52:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-ac2c564f-5c98-4873-9c1a-474da5a38cee req-23fa3683-6aec-4f81-80dd-65853ed57655 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received event network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ac2c564f-5c98-4873-9c1a-474da5a38cee req-23fa3683-6aec-4f81-80dd-65853ed57655 service nova] Acquiring lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ac2c564f-5c98-4873-9c1a-474da5a38cee req-23fa3683-6aec-4f81-80dd-65853ed57655 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ac2c564f-5c98-4873-9c1a-474da5a38cee req-23fa3683-6aec-4f81-80dd-65853ed57655 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-ac2c564f-5c98-4873-9c1a-474da5a38cee req-23fa3683-6aec-4f81-80dd-65853ed57655 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] No waiting events found dispatching network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:52:32 user nova-compute[73258]: WARNING nova.compute.manager [req-ac2c564f-5c98-4873-9c1a-474da5a38cee req-23fa3683-6aec-4f81-80dd-65853ed57655 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received unexpected event network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 for instance with vm_state active and task_state resize_finish.
Aug 27 06:52:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json -f qcow2" returned: 0 in 0.276s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json -f qcow2 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json -f qcow2" returned: 0 in 0.209s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:52:32 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Took 0.79 seconds to deallocate network for instance.
Aug 27 06:52:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.244s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp14ywsalg/47e21b5773294aa08cf7452271135f15.delta 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp14ywsalg/47e21b5773294aa08cf7452271135f15.delta 1073741824" returned: 0 in 0.060s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:32 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 27 06:52:33 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:52:33 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:52:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.740s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:33 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Deleted allocations for instance 8396ca48-c47c-41b1-9872-24dbb0b9f526
Aug 27 06:52:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:52:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6adb4ef7-2166-44a0-93b2-3130bebef566 tempest-ServersNegativeTestJSON-1353100795 tempest-ServersNegativeTestJSON-1353100795-project-member] Lock "8396ca48-c47c-41b1-9872-24dbb0b9f526" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.136s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:52:34 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 06:52:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-e09b2021-a3cf-4c4f-b068-ea0fdf3af617 req-0fa89b27-8b20-4e15-b3c0-fb417836279c service nova] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Received event network-vif-deleted-88db4c6e-c521-4efa-8311-ba38294ef3fe {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:52:34 user nova-compute[73258]: DEBUG nova.privsep.utils [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 06:52:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp14ywsalg/47e21b5773294aa08cf7452271135f15.delta /opt/stack/data/nova/instances/snapshots/tmp14ywsalg/47e21b5773294aa08cf7452271135f15 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:34 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119154.4553626, bc3cebb3-0e29-4899-94aa-d13a2a9ca86a => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:52:34 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] VM Resumed (Lifecycle Event)
Aug 27 06:52:34 user nova-compute[73258]: DEBUG nova.compute.manager [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:52:34 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Instance running successfully.
Aug 27 06:52:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Failed to set time: agent not configured {{(pid=73258) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 27 06:52:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-5537aebc-07f2-4378-8ea8-07f392992011 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] finish_migration finished successfully. {{(pid=73258) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 27 06:52:34 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:52:34 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:52:34 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 06:52:34 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119154.457051, bc3cebb3-0e29-4899-94aa-d13a2a9ca86a => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:52:34 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] VM Started (Lifecycle Event)
Aug 27 06:52:34 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:52:34 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:52:34 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 06:52:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp14ywsalg/47e21b5773294aa08cf7452271135f15.delta /opt/stack/data/nova/instances/snapshots/tmp14ywsalg/47e21b5773294aa08cf7452271135f15" returned: 0 in 0.444s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:34 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Snapshot extracted, beginning image upload
Aug 27 06:52:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:37 user nova-compute[73258]: INFO nova.compute.manager [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Detaching volume 1c8ed5a0-96ea-4562-9399-f57b30e6026c
Aug 27 06:52:37 user nova-compute[73258]: INFO nova.virt.block_device [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Attempting to driver detach volume 1c8ed5a0-96ea-4562-9399-f57b30e6026c from mountpoint /dev/vdb
Aug 27 06:52:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Attempting to detach device vdb from instance 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:52:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:52:37 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:52:37 user nova-compute[73258]:   <source dev="/dev/sdd"/>
Aug 27 06:52:37 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:52:37 user nova-compute[73258]:   <serial>1c8ed5a0-96ea-4562-9399-f57b30e6026c</serial>
Aug 27 06:52:37 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:52:37 user nova-compute[73258]: </disk>
Aug 27 06:52:37 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:52:37 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Successfully detached device vdb from instance 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df from the persistent domain config.
Aug 27 06:52:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:52:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:52:37 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:52:37 user nova-compute[73258]:   <source dev="/dev/sdd"/>
Aug 27 06:52:37 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:52:37 user nova-compute[73258]:   <serial>1c8ed5a0-96ea-4562-9399-f57b30e6026c</serial>
Aug 27 06:52:37 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:52:37 user nova-compute[73258]: </disk>
Aug 27 06:52:37 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:52:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693119158.5313568, 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:52:38 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Successfully detached device vdb from instance 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df from the live domain config.
Aug 27 06:52:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPpXnZvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:52:38 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:52:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27c7174-194e-4fd9-b9db-3337a3e241cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5efdf22a-cc5b-4a7d-81de-1f9dc5065e8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d251bf-e610-4159-85bc-98b019929351]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5efdf22a-cc5b-4a7d-81de-1f9dc5065e8a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:38 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:38 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:38 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:38 user nova-compute[73258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5efdf22a-cc5b-4a7d-81de-1f9dc5065e8a (non-flash)
Aug 27 06:52:38 user nova-compute[73258]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:52:38 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:38 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:38 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:38 user nova-compute[73258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c (non-flash)
Aug 27 06:52:38 user nova-compute[73258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5efdf22a-cc5b-4a7d-81de-1f9dc5065e8a (non-flash)
Aug 27 06:52:38 user nova-compute[73258]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:52:38 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4305c0e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c'): ({'sdd'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Removing single pathed devices sdd {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfea5ce-e268-441e-a55b-21f67c7f3375]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[74111a1c-3459-4b05-bb94-84b5ad65dd94]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Flushing IO for device /dev/sdd {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8de3243-671d-4593-a191-ac02aa48bf15]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.063s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6d8428-3f30-4ff8-9679-eb631a905c47]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] SCSI volumes sdd have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc824df-6053-4f79-beae-7fb6a8432de0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[075ea654-4608-45ee-8bc8-7321c189e7c5]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c, portal: 172.16.0.220,3260]
Aug 27 06:52:38 user nova-compute[73258]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c, portal: 172.16.0.220,3260] successful.
Aug 27 06:52:38 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:39 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3c20f8-346d-4643-b798-947917959faa]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:52:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:52:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] <== disconnect_volume: return (412ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:52:39 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:52:39 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Snapshot image upload complete
Aug 27 06:52:39 user nova-compute[73258]: INFO nova.compute.manager [None req-3aa6b243-4518-406d-9c75-50fd7264cd75 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Took 8.34 seconds to snapshot the instance on the hypervisor.
Aug 27 06:52:40 user nova-compute[73258]: DEBUG nova.objects.instance [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lazy-loading 'flavor' on Instance uuid 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b7c0a7bd-8cc3-450c-a723-4c8d4784cba2 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.857s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.266s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:40 user nova-compute[73258]: INFO nova.compute.manager [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Terminating instance
Aug 27 06:52:40 user nova-compute[73258]: DEBUG nova.compute.manager [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG nova.compute.manager [req-c02ef0f2-18ac-403c-8332-762247097588 req-11612bc3-86c4-4fa7-8b6c-cbfa99ee0dae service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Received event network-vif-unplugged-45fb1201-3985-41b3-9c75-fecb5fcbd4ae {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c02ef0f2-18ac-403c-8332-762247097588 req-11612bc3-86c4-4fa7-8b6c-cbfa99ee0dae service nova] Acquiring lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c02ef0f2-18ac-403c-8332-762247097588 req-11612bc3-86c4-4fa7-8b6c-cbfa99ee0dae service nova] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c02ef0f2-18ac-403c-8332-762247097588 req-11612bc3-86c4-4fa7-8b6c-cbfa99ee0dae service nova] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG nova.compute.manager [req-c02ef0f2-18ac-403c-8332-762247097588 req-11612bc3-86c4-4fa7-8b6c-cbfa99ee0dae service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] No waiting events found dispatching network-vif-unplugged-45fb1201-3985-41b3-9c75-fecb5fcbd4ae {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG nova.compute.manager [req-c02ef0f2-18ac-403c-8332-762247097588 req-11612bc3-86c4-4fa7-8b6c-cbfa99ee0dae service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Received event network-vif-unplugged-45fb1201-3985-41b3-9c75-fecb5fcbd4ae for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:52:40 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Instance destroyed successfully.
Aug 27 06:52:40 user nova-compute[73258]: DEBUG nova.objects.instance [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lazy-loading 'resources' on Instance uuid 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1267693825',display_name='tempest-VolumesSnapshotTestJSON-instance-1267693825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1267693825',id=31,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJ0NqSDzU9mJJxf2KI9nJFS+/egVxE/xnOfyNVhm2JmIYcKnFP3hKi0OQ/cb0YZuB7vbVtBtjjTJ/mkrhPm3w1UFxv2rwIIxcWgKOamloypmgTU3BXSjP4nOby6p0SAuw==',key_name='tempest-keypair-632012971',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2900acc4299f427fa7152d2f039e026f',ramdisk_id='',reservation_id='r-cx3unj61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-993486304',owner_user_name='tempest-VolumesSnapshotTestJSON-993486304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e39b42a04fd64685ac7382cd16dc7285',uuid=3cd7bb27-7b3b-4540-ab38-f085d6a6e5df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "address": "fa:16:3e:00:c8:7d", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45fb1201-39", "ovs_interfaceid": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Converting VIF {"id": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "address": "fa:16:3e:00:c8:7d", "network": {"id": "82b73052-3c5c-4f8f-b938-b4423125eae1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-244046868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2900acc4299f427fa7152d2f039e026f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45fb1201-39", "ovs_interfaceid": "45fb1201-3985-41b3-9c75-fecb5fcbd4ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:c8:7d,bridge_name='br-int',has_traffic_filtering=True,id=45fb1201-3985-41b3-9c75-fecb5fcbd4ae,network=Network(82b73052-3c5c-4f8f-b938-b4423125eae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45fb1201-39') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG os_vif [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:c8:7d,bridge_name='br-int',has_traffic_filtering=True,id=45fb1201-3985-41b3-9c75-fecb5fcbd4ae,network=Network(82b73052-3c5c-4f8f-b938-b4423125eae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45fb1201-39') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45fb1201-39, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:40 user nova-compute[73258]: INFO os_vif [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:c8:7d,bridge_name='br-int',has_traffic_filtering=True,id=45fb1201-3985-41b3-9c75-fecb5fcbd4ae,network=Network(82b73052-3c5c-4f8f-b938-b4423125eae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45fb1201-39')
Aug 27 06:52:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPpXnZvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:52:40 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:52:40 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c8ed5a0-96ea-4562-9399-f57b30e6026c', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:52:40 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:41 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc665369-7126-405a-85c6-14adb71505ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5efdf22a-cc5b-4a7d-81de-1f9dc5065e8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:41 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6857b198-7909-49f3-8894-17eafebebc2b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5efdf22a-cc5b-4a7d-81de-1f9dc5065e8a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:52:41 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:41 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:41 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:41 user nova-compute[73258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5efdf22a-cc5b-4a7d-81de-1f9dc5065e8a (non-flash)
Aug 27 06:52:41 user nova-compute[73258]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:52:41 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:52:41 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:52:41 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:52:41 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:52:41 user nova-compute[73258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5efdf22a-cc5b-4a7d-81de-1f9dc5065e8a (non-flash)
Aug 27 06:52:41 user nova-compute[73258]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:52:41 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:52:41 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa410537eb0>, {}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:52:41 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Disconnecting from: [] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:52:41 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:52:41 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] <== disconnect_volume: return (66ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:52:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:52:41 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Deleting instance files /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df_del
Aug 27 06:52:41 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Deletion of /opt/stack/data/nova/instances/3cd7bb27-7b3b-4540-ab38-f085d6a6e5df_del complete
Aug 27 06:52:41 user nova-compute[73258]: INFO nova.compute.manager [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Took 1.35 seconds to destroy the instance on the hypervisor.
Aug 27 06:52:41 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:52:41 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:52:41 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:52:42 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:52:42 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Took 1.20 seconds to deallocate network for instance.
Aug 27 06:52:42 user nova-compute[73258]: WARNING nova.volume.cinder [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Attachment 98f8fbc8-1b23-474d-9903-3e3d7245bcdb does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 98f8fbc8-1b23-474d-9903-3e3d7245bcdb. (HTTP 404) (Request-ID: req-85d30b11-6143-48b7-885b-31980723719e)
Aug 27 06:52:42 user nova-compute[73258]: INFO nova.compute.manager [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Took 0.03 seconds to detach 1 volumes for instance.
Aug 27 06:52:42 user nova-compute[73258]: DEBUG nova.compute.manager [req-b6526ed3-7317-4600-a97a-383c12dc56fd req-d7aaa975-c469-4e37-a987-8d5dd9d54d57 service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Received event network-vif-plugged-45fb1201-3985-41b3-9c75-fecb5fcbd4ae {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:52:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b6526ed3-7317-4600-a97a-383c12dc56fd req-d7aaa975-c469-4e37-a987-8d5dd9d54d57 service nova] Acquiring lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b6526ed3-7317-4600-a97a-383c12dc56fd req-d7aaa975-c469-4e37-a987-8d5dd9d54d57 service nova] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b6526ed3-7317-4600-a97a-383c12dc56fd req-d7aaa975-c469-4e37-a987-8d5dd9d54d57 service nova] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:42 user nova-compute[73258]: DEBUG nova.compute.manager [req-b6526ed3-7317-4600-a97a-383c12dc56fd req-d7aaa975-c469-4e37-a987-8d5dd9d54d57 service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] No waiting events found dispatching network-vif-plugged-45fb1201-3985-41b3-9c75-fecb5fcbd4ae {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:52:42 user nova-compute[73258]: WARNING nova.compute.manager [req-b6526ed3-7317-4600-a97a-383c12dc56fd req-d7aaa975-c469-4e37-a987-8d5dd9d54d57 service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Received unexpected event network-vif-plugged-45fb1201-3985-41b3-9c75-fecb5fcbd4ae for instance with vm_state active and task_state deleting.
Aug 27 06:52:42 user nova-compute[73258]: DEBUG nova.compute.manager [req-b6526ed3-7317-4600-a97a-383c12dc56fd req-d7aaa975-c469-4e37-a987-8d5dd9d54d57 service nova] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Received event network-vif-deleted-45fb1201-3985-41b3-9c75-fecb5fcbd4ae {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:52:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:43 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:52:43 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:52:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.566s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:43 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Deleted allocations for instance 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df
Aug 27 06:52:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-76223cb9-224b-4665-b297-278dd512ab74 tempest-VolumesSnapshotTestJSON-993486304 tempest-VolumesSnapshotTestJSON-993486304-project-member] Lock "3cd7bb27-7b3b-4540-ab38-f085d6a6e5df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.453s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:46 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119151.211439, 8396ca48-c47c-41b1-9872-24dbb0b9f526 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:52:46 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] VM Stopped (Lifecycle Event)
Aug 27 06:52:46 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6527c23a-19c9-4ef5-bf6c-c8c26ae2cb47 None None] [instance: 8396ca48-c47c-41b1-9872-24dbb0b9f526] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:52:46 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:52:46 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:52:46 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:52:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-7ee743f1-9611-4165-838e-54fccb332f1a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:52:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-7ee743f1-9611-4165-838e-54fccb332f1a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:52:47 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:52:47 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Updating instance_info_cache with network_info: [{"id": "27d47d21-922e-43da-8dee-8d62f45edd64", "address": "fa:16:3e:5c:73:20", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d47d21-92", "ovs_interfaceid": "27d47d21-922e-43da-8dee-8d62f45edd64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:52:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-7ee743f1-9611-4165-838e-54fccb332f1a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:52:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:52:47 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:52:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:52:47 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:52:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 06:52:47 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:52:48 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:52:48 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:52:48 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:52:49 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:52:49 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:52:50 user nova-compute[73258]: INFO nova.compute.manager [None req-bbcf03a7-3109-499a-bffe-a103c2f7c8a6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Unrescuing
Aug 27 06:52:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbcf03a7-3109-499a-bffe-a103c2f7c8a6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbcf03a7-3109-499a-bffe-a103c2f7c8a6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquired lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bbcf03a7-3109-499a-bffe-a103c2f7c8a6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:50 user nova-compute[73258]: INFO nova.compute.manager [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Terminating instance
Aug 27 06:52:50 user nova-compute[73258]: DEBUG nova.compute.manager [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG nova.network.neutron [None req-bbcf03a7-3109-499a-bffe-a103c2f7c8a6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Updating instance_info_cache with network_info: [{"id": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "address": "fa:16:3e:2a:36:5c", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e94cae8-ea", "ovs_interfaceid": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bbcf03a7-3109-499a-bffe-a103c2f7c8a6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Releasing lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG nova.objects.instance [None req-bbcf03a7-3109-499a-bffe-a103c2f7c8a6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'flavor' on Instance uuid b22b7599-5a37-4370-b440-f04e3dc88f98 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG nova.compute.manager [req-885c5ee6-d46e-4eb0-9978-0a439fa703a2 req-8ab2f02e-b361-42f1-87f4-49f161b444f2 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-vif-unplugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-885c5ee6-d46e-4eb0-9978-0a439fa703a2 req-8ab2f02e-b361-42f1-87f4-49f161b444f2 service nova] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-885c5ee6-d46e-4eb0-9978-0a439fa703a2 req-8ab2f02e-b361-42f1-87f4-49f161b444f2 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-885c5ee6-d46e-4eb0-9978-0a439fa703a2 req-8ab2f02e-b361-42f1-87f4-49f161b444f2 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG nova.compute.manager [req-885c5ee6-d46e-4eb0-9978-0a439fa703a2 req-8ab2f02e-b361-42f1-87f4-49f161b444f2 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] No waiting events found dispatching network-vif-unplugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG nova.compute.manager [req-885c5ee6-d46e-4eb0-9978-0a439fa703a2 req-8ab2f02e-b361-42f1-87f4-49f161b444f2 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-vif-unplugged-7b4375ea-f74b-4677-a768-97e96029c237 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:52:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:51 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Instance destroyed successfully.
Aug 27 06:52:51 user nova-compute[73258]: DEBUG nova.objects.instance [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'resources' on Instance uuid 9517c681-ed2b-49c2-94a6-aa2181b4b62f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:52:51 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:43:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1573525836',display_name='tempest-AttachVolumeTestJSON-server-1573525836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1573525836',id=20,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuhlWzl340MR8vuL4wDTAkmN5hCJUdQIIyuqJCteVnLZ+c/yoSQsUNeq9gc2CsDlviPIALHDhlmzrpmhT0dESkXG7J9YKzWGCIInu7/GNC69QhJ+6s+eSD+zVfJ71qniA==',key_name='tempest-keypair-2145652813',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:43:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='191ca81ae335419aa935b1b7576b12ff',ramdisk_id='',reservation_id='r-nh0b3aah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1777325696',owner_user_name='tempest-AttachVolumeTestJSON-1777325696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:51:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e3b8e4e749b4d039b4d5ebdc6469151',uuid=9517c681-ed2b-49c2-94a6-aa2181b4b62f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:52:51 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converting VIF {"id": "7b4375ea-f74b-4677-a768-97e96029c237", "address": "fa:16:3e:f5:fe:36", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4375ea-f7", "ovs_interfaceid": "7b4375ea-f74b-4677-a768-97e96029c237", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:52:51 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:52:51 user nova-compute[73258]: DEBUG os_vif [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:52:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b4375ea-f7, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:52:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:52:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:51 user nova-compute[73258]: INFO os_vif [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:fe:36,bridge_name='br-int',has_traffic_filtering=True,id=7b4375ea-f74b-4677-a768-97e96029c237,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4375ea-f7')
Aug 27 06:52:51 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Deleting instance files /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f_del
Aug 27 06:52:51 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Deletion of /opt/stack/data/nova/instances/9517c681-ed2b-49c2-94a6-aa2181b4b62f_del complete
Aug 27 06:52:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:51 user nova-compute[73258]: INFO nova.compute.manager [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 27 06:52:51 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:52:51 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:52:51 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:52:51 user nova-compute[73258]: DEBUG nova.compute.manager [req-ad0eb7b8-e7d5-4632-ab09-7a7f4492f44a req-67bafe7e-6f68-4b30-b9dd-89b108ced153 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received event network-vif-unplugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:52:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ad0eb7b8-e7d5-4632-ab09-7a7f4492f44a req-67bafe7e-6f68-4b30-b9dd-89b108ced153 service nova] Acquiring lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ad0eb7b8-e7d5-4632-ab09-7a7f4492f44a req-67bafe7e-6f68-4b30-b9dd-89b108ced153 service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ad0eb7b8-e7d5-4632-ab09-7a7f4492f44a req-67bafe7e-6f68-4b30-b9dd-89b108ced153 service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:51 user nova-compute[73258]: DEBUG nova.compute.manager [req-ad0eb7b8-e7d5-4632-ab09-7a7f4492f44a req-67bafe7e-6f68-4b30-b9dd-89b108ced153 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] No waiting events found dispatching network-vif-unplugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:52:51 user nova-compute[73258]: WARNING nova.compute.manager [req-ad0eb7b8-e7d5-4632-ab09-7a7f4492f44a req-67bafe7e-6f68-4b30-b9dd-89b108ced153 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received unexpected event network-vif-unplugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:52:51 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Instance destroyed successfully.
Aug 27 06:52:52 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:52:52 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Took 1.06 seconds to deallocate network for instance.
Aug 27 06:52:52 user nova-compute[73258]: DEBUG nova.compute.manager [req-ebc3c2e8-5b2b-441e-a6f7-ac531cd979c8 req-f062abec-894e-4d08-ab78-1993a09a2615 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-vif-deleted-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:52:52 user nova-compute[73258]: INFO nova.compute.manager [req-ebc3c2e8-5b2b-441e-a6f7-ac531cd979c8 req-f062abec-894e-4d08-ab78-1993a09a2615 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Neutron deleted interface 7b4375ea-f74b-4677-a768-97e96029c237; detaching it from the instance and deleting it from the info cache
Aug 27 06:52:52 user nova-compute[73258]: DEBUG nova.network.neutron [req-ebc3c2e8-5b2b-441e-a6f7-ac531cd979c8 req-f062abec-894e-4d08-ab78-1993a09a2615 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:52:52 user nova-compute[73258]: DEBUG nova.compute.manager [req-ebc3c2e8-5b2b-441e-a6f7-ac531cd979c8 req-f062abec-894e-4d08-ab78-1993a09a2615 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Detach interface failed, port_id=7b4375ea-f74b-4677-a768-97e96029c237, reason: Instance 9517c681-ed2b-49c2-94a6-aa2181b4b62f could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:52:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:52 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Refreshing inventories for resource provider 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 06:52:52 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Updating ProviderTree inventory for provider 13f05024-5078-4590-94a5-110d29d864c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 06:52:52 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Updating inventory in ProviderTree for provider 13f05024-5078-4590-94a5-110d29d864c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 06:52:52 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Refreshing aggregate associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, aggregates: None {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 06:52:52 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Refreshing trait associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 06:52:52 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:52:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 06:52:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] There are 0 instances to clean {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 06:52:52 user nova-compute[73258]: DEBUG nova.compute.manager [req-5fd6e527-ab0c-47b6-826b-59660ecb38cb req-b20570c8-8e43-450d-aedf-26bce04a0d45 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:52:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5fd6e527-ab0c-47b6-826b-59660ecb38cb req-b20570c8-8e43-450d-aedf-26bce04a0d45 service nova] Acquiring lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5fd6e527-ab0c-47b6-826b-59660ecb38cb req-b20570c8-8e43-450d-aedf-26bce04a0d45 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5fd6e527-ab0c-47b6-826b-59660ecb38cb req-b20570c8-8e43-450d-aedf-26bce04a0d45 service nova] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:52 user nova-compute[73258]: DEBUG nova.compute.manager [req-5fd6e527-ab0c-47b6-826b-59660ecb38cb req-b20570c8-8e43-450d-aedf-26bce04a0d45 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] No waiting events found dispatching network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:52:52 user nova-compute[73258]: WARNING nova.compute.manager [req-5fd6e527-ab0c-47b6-826b-59660ecb38cb req-b20570c8-8e43-450d-aedf-26bce04a0d45 service nova] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Received unexpected event network-vif-plugged-7b4375ea-f74b-4677-a768-97e96029c237 for instance with vm_state deleted and task_state None.
Aug 27 06:52:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.811s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:53 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Deleted allocations for instance 9517c681-ed2b-49c2-94a6-aa2181b4b62f
Aug 27 06:52:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4c1aa961-a28c-4527-b22e-d119644be6c2 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "9517c681-ed2b-49c2-94a6-aa2181b4b62f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.180s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG nova.compute.manager [req-90fa8a67-a52b-4801-be5c-40dc6a9fef85 req-72afe8ac-8d49-47c5-b741-e46f4a775b05 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received event network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-90fa8a67-a52b-4801-be5c-40dc6a9fef85 req-72afe8ac-8d49-47c5-b741-e46f4a775b05 service nova] Acquiring lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-90fa8a67-a52b-4801-be5c-40dc6a9fef85 req-72afe8ac-8d49-47c5-b741-e46f4a775b05 service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-90fa8a67-a52b-4801-be5c-40dc6a9fef85 req-72afe8ac-8d49-47c5-b741-e46f4a775b05 service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG nova.compute.manager [req-90fa8a67-a52b-4801-be5c-40dc6a9fef85 req-72afe8ac-8d49-47c5-b741-e46f4a775b05 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] No waiting events found dispatching network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:52:53 user nova-compute[73258]: WARNING nova.compute.manager [req-90fa8a67-a52b-4801-be5c-40dc6a9fef85 req-72afe8ac-8d49-47c5-b741-e46f4a775b05 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received unexpected event network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:52:53 user nova-compute[73258]: DEBUG nova.compute.manager [req-90fa8a67-a52b-4801-be5c-40dc6a9fef85 req-72afe8ac-8d49-47c5-b741-e46f4a775b05 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received event network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-90fa8a67-a52b-4801-be5c-40dc6a9fef85 req-72afe8ac-8d49-47c5-b741-e46f4a775b05 service nova] Acquiring lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-90fa8a67-a52b-4801-be5c-40dc6a9fef85 req-72afe8ac-8d49-47c5-b741-e46f4a775b05 service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-90fa8a67-a52b-4801-be5c-40dc6a9fef85 req-72afe8ac-8d49-47c5-b741-e46f4a775b05 service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG nova.compute.manager [req-90fa8a67-a52b-4801-be5c-40dc6a9fef85 req-72afe8ac-8d49-47c5-b741-e46f4a775b05 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] No waiting events found dispatching network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:52:53 user nova-compute[73258]: WARNING nova.compute.manager [req-90fa8a67-a52b-4801-be5c-40dc6a9fef85 req-72afe8ac-8d49-47c5-b741-e46f4a775b05 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received unexpected event network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:52:53 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:53 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:52:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:54 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:52:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Removed pending event for b22b7599-5a37-4370-b440-f04e3dc88f98 due to event {{(pid=73258) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119175.6196058, b22b7599-5a37-4370-b440-f04e3dc88f98 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:52:55 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] VM Resumed (Lifecycle Event)
Aug 27 06:52:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bbcf03a7-3109-499a-bffe-a103c2f7c8a6 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG nova.compute.manager [req-9cc510d1-c02d-4e5a-bae8-b5364146ea77 req-d90710bd-4c0f-40ca-96f3-1794aa770018 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received event network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9cc510d1-c02d-4e5a-bae8-b5364146ea77 req-d90710bd-4c0f-40ca-96f3-1794aa770018 service nova] Acquiring lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9cc510d1-c02d-4e5a-bae8-b5364146ea77 req-d90710bd-4c0f-40ca-96f3-1794aa770018 service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9cc510d1-c02d-4e5a-bae8-b5364146ea77 req-d90710bd-4c0f-40ca-96f3-1794aa770018 service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG nova.compute.manager [req-9cc510d1-c02d-4e5a-bae8-b5364146ea77 req-d90710bd-4c0f-40ca-96f3-1794aa770018 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] No waiting events found dispatching network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:52:55 user nova-compute[73258]: WARNING nova.compute.manager [req-9cc510d1-c02d-4e5a-bae8-b5364146ea77 req-d90710bd-4c0f-40ca-96f3-1794aa770018 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received unexpected event network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:52:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119175.6218317, b22b7599-5a37-4370-b440-f04e3dc88f98 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:52:55 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] VM Started (Lifecycle Event)
Aug 27 06:52:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:55 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119160.9334123, 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:52:55 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] VM Stopped (Lifecycle Event)
Aug 27 06:52:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a4702c9f-e492-42e1-a0bd-d3c3097c31ac None None] [instance: 3cd7bb27-7b3b-4540-ab38-f085d6a6e5df] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:52:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:52:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:52:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:52:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:52:58 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:52:58 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:52:58 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=7291MB free_disk=23.871288299560547GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:52:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Applying migration context for instance bc3cebb3-0e29-4899-94aa-d13a2a9ca86a as it has an incoming, in-progress migration 7558c8cf-6d73-409d-a4f0-ace10cb843eb. Migration status is finished {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 06:52:59 user nova-compute[73258]: INFO nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Updating resource usage from migration 7558c8cf-6d73-409d-a4f0-ace10cb843eb
Aug 27 06:52:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1672aa9f-be6f-4357-877f-a48f62119df4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a836678e-240d-4ead-b0b5-64d146910a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 7ee743f1-9611-4165-838e-54fccb332f1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance b22b7599-5a37-4370-b440-f04e3dc88f98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance d409b021-ab98-4f9f-a80d-99fe05de7b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bcd29636-071b-4699-8360-e0d189df3f95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance ede6423b-ad91-4002-91d1-5849c6a4e26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Migration 7558c8cf-6d73-409d-a4f0-ace10cb843eb is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bc3cebb3-0e29-4899-94aa-d13a2a9ca86a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.814s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "bcd29636-071b-4699-8360-e0d189df3f95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "bcd29636-071b-4699-8360-e0d189df3f95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "bcd29636-071b-4699-8360-e0d189df3f95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "bcd29636-071b-4699-8360-e0d189df3f95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "bcd29636-071b-4699-8360-e0d189df3f95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:59 user nova-compute[73258]: INFO nova.compute.manager [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Terminating instance
Aug 27 06:52:59 user nova-compute[73258]: DEBUG nova.compute.manager [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:52:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:00 user nova-compute[73258]: DEBUG nova.compute.manager [req-23bcebe0-93ee-4ffa-928f-e6ae99a62ff2 req-26ca8f1d-728a-48be-a58f-a15f9005ddd7 service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Received event network-vif-unplugged-97648bc4-126c-428e-9802-98a196d6bdb6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:53:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-23bcebe0-93ee-4ffa-928f-e6ae99a62ff2 req-26ca8f1d-728a-48be-a58f-a15f9005ddd7 service nova] Acquiring lock "bcd29636-071b-4699-8360-e0d189df3f95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-23bcebe0-93ee-4ffa-928f-e6ae99a62ff2 req-26ca8f1d-728a-48be-a58f-a15f9005ddd7 service nova] Lock "bcd29636-071b-4699-8360-e0d189df3f95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-23bcebe0-93ee-4ffa-928f-e6ae99a62ff2 req-26ca8f1d-728a-48be-a58f-a15f9005ddd7 service nova] Lock "bcd29636-071b-4699-8360-e0d189df3f95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:00 user nova-compute[73258]: DEBUG nova.compute.manager [req-23bcebe0-93ee-4ffa-928f-e6ae99a62ff2 req-26ca8f1d-728a-48be-a58f-a15f9005ddd7 service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] No waiting events found dispatching network-vif-unplugged-97648bc4-126c-428e-9802-98a196d6bdb6 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:53:00 user nova-compute[73258]: DEBUG nova.compute.manager [req-23bcebe0-93ee-4ffa-928f-e6ae99a62ff2 req-26ca8f1d-728a-48be-a58f-a15f9005ddd7 service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Received event network-vif-unplugged-97648bc4-126c-428e-9802-98a196d6bdb6 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:53:00 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Instance destroyed successfully.
Aug 27 06:53:00 user nova-compute[73258]: DEBUG nova.objects.instance [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lazy-loading 'resources' on Instance uuid bcd29636-071b-4699-8360-e0d189df3f95 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:53:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-963997122',display_name='tempest-AttachVolumeNegativeTest-server-963997122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-963997122',id=34,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNs5L+ew4n+dqHz4V1PvhcRY8wpZzZ3h4WCmMJVaAm1WHc2PR36LS4xicrUuNI5xRtOWpk6PGkM2dPLgfe+o2CMIFkhbFDPCBvrWQ/Ly94J7/TSJ8yCeoKZIq4s+N59XGg==',key_name='tempest-keypair-1858747133',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:49:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f43f32eaadfd4f7eacc418385cc5e474',ramdisk_id='',reservation_id='r-0z7o1imn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-537954646',owner_user_name='tempest-AttachVolumeNegativeTest-537954646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:49:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd74559df08d44e298ba6e2ccbaaefae',uuid=bcd29636-071b-4699-8360-e0d189df3f95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97648bc4-126c-428e-9802-98a196d6bdb6", "address": "fa:16:3e:9f:26:af", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97648bc4-12", "ovs_interfaceid": "97648bc4-126c-428e-9802-98a196d6bdb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:53:00 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converting VIF {"id": "97648bc4-126c-428e-9802-98a196d6bdb6", "address": "fa:16:3e:9f:26:af", "network": {"id": "174c8c50-0fa8-4ba9-9faf-762d7457e99c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1184198599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f43f32eaadfd4f7eacc418385cc5e474", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97648bc4-12", "ovs_interfaceid": "97648bc4-126c-428e-9802-98a196d6bdb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:53:00 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:26:af,bridge_name='br-int',has_traffic_filtering=True,id=97648bc4-126c-428e-9802-98a196d6bdb6,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97648bc4-12') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:53:00 user nova-compute[73258]: DEBUG os_vif [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:26:af,bridge_name='br-int',has_traffic_filtering=True,id=97648bc4-126c-428e-9802-98a196d6bdb6,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97648bc4-12') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:53:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97648bc4-12, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:53:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:53:00 user nova-compute[73258]: INFO os_vif [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:26:af,bridge_name='br-int',has_traffic_filtering=True,id=97648bc4-126c-428e-9802-98a196d6bdb6,network=Network(174c8c50-0fa8-4ba9-9faf-762d7457e99c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97648bc4-12')
Aug 27 06:53:00 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Deleting instance files /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95_del
Aug 27 06:53:00 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Deletion of /opt/stack/data/nova/instances/bcd29636-071b-4699-8360-e0d189df3f95_del complete
Aug 27 06:53:00 user nova-compute[73258]: INFO nova.compute.manager [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 27 06:53:00 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:53:00 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:53:00 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: bcd29636-071b-4699-8360-e0d189df3f95] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:53:01 user nova-compute[73258]: DEBUG nova.compute.manager [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:53:01 user nova-compute[73258]: INFO nova.compute.manager [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] instance snapshotting
Aug 27 06:53:01 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Beginning live snapshot process
Aug 27 06:53:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json -f qcow2 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:01 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:53:01 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Took 1.19 seconds to deallocate network for instance.
Aug 27 06:53:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json -f qcow2" returned: 0 in 0.207s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json -f qcow2 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:01 user nova-compute[73258]: DEBUG nova.compute.manager [req-89270be0-57b2-4161-a28e-f649be05679d req-5f2bdf54-e130-4b11-888b-b8fe17e7aec9 service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Received event network-vif-deleted-97648bc4-126c-428e-9802-98a196d6bdb6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:53:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json -f qcow2" returned: 0 in 0.216s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:02 user nova-compute[73258]: DEBUG nova.compute.manager [req-5bdaa085-aeb5-40df-904a-4e158123f700 req-ae5fb1f1-62e7-4498-bd05-fe78da49c7ef service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Received event network-vif-plugged-97648bc4-126c-428e-9802-98a196d6bdb6 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:53:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5bdaa085-aeb5-40df-904a-4e158123f700 req-ae5fb1f1-62e7-4498-bd05-fe78da49c7ef service nova] Acquiring lock "bcd29636-071b-4699-8360-e0d189df3f95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5bdaa085-aeb5-40df-904a-4e158123f700 req-ae5fb1f1-62e7-4498-bd05-fe78da49c7ef service nova] Lock "bcd29636-071b-4699-8360-e0d189df3f95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5bdaa085-aeb5-40df-904a-4e158123f700 req-ae5fb1f1-62e7-4498-bd05-fe78da49c7ef service nova] Lock "bcd29636-071b-4699-8360-e0d189df3f95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:02 user nova-compute[73258]: DEBUG nova.compute.manager [req-5bdaa085-aeb5-40df-904a-4e158123f700 req-ae5fb1f1-62e7-4498-bd05-fe78da49c7ef service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] No waiting events found dispatching network-vif-plugged-97648bc4-126c-428e-9802-98a196d6bdb6 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:53:02 user nova-compute[73258]: WARNING nova.compute.manager [req-5bdaa085-aeb5-40df-904a-4e158123f700 req-ae5fb1f1-62e7-4498-bd05-fe78da49c7ef service nova] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Received unexpected event network-vif-plugged-97648bc4-126c-428e-9802-98a196d6bdb6 for instance with vm_state deleted and task_state None.
Aug 27 06:53:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.200s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdqiliyvy/fcc3cb6b1bfa495588fd2fb9139bf763.delta 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdqiliyvy/fcc3cb6b1bfa495588fd2fb9139bf763.delta 1073741824" returned: 0 in 0.059s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:02 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 27 06:53:02 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:53:02 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:53:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.566s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:02 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Deleted allocations for instance bcd29636-071b-4699-8360-e0d189df3f95
Aug 27 06:53:02 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:53:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-bdfcaaf7-e5a9-424c-990e-c7d5c3adf8e4 tempest-AttachVolumeNegativeTest-537954646 tempest-AttachVolumeNegativeTest-537954646-project-member] Lock "bcd29636-071b-4699-8360-e0d189df3f95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.972s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:03 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:53:03 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 06:53:03 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 06:53:03 user nova-compute[73258]: DEBUG nova.privsep.utils [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 06:53:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdqiliyvy/fcc3cb6b1bfa495588fd2fb9139bf763.delta /opt/stack/data/nova/instances/snapshots/tmpdqiliyvy/fcc3cb6b1bfa495588fd2fb9139bf763 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdqiliyvy/fcc3cb6b1bfa495588fd2fb9139bf763.delta /opt/stack/data/nova/instances/snapshots/tmpdqiliyvy/fcc3cb6b1bfa495588fd2fb9139bf763" returned: 0 in 0.444s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:04 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Snapshot extracted, beginning image upload
Aug 27 06:53:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:06 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119171.269164, 9517c681-ed2b-49c2-94a6-aa2181b4b62f => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:53:06 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] VM Stopped (Lifecycle Event)
Aug 27 06:53:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-1e4b378a-b7be-43cd-af0f-3b071b7e86a5 None None] [instance: 9517c681-ed2b-49c2-94a6-aa2181b4b62f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:53:07 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Snapshot image upload complete
Aug 27 06:53:07 user nova-compute[73258]: INFO nova.compute.manager [None req-be64977a-28b6-4251-94e7-0d956ab10be8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Took 6.08 seconds to snapshot the instance on the hypervisor.
Aug 27 06:53:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:53:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:10 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:53:10 user nova-compute[73258]: INFO nova.compute.claims [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Claim successful on node user
Aug 27 06:53:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:10 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:53:10 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:53:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:53:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:53:10 user nova-compute[73258]: DEBUG nova.network.neutron [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:53:10 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:53:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:53:10 user nova-compute[73258]: DEBUG nova.policy [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c44464f6e84417cb8823d01c7aa669f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72f7bfc1fb284defb6f92a77be8821e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:53:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:53:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:53:10 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Creating image(s)
Aug 27 06:53:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "/opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "/opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "/opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "b6952fde14e7ad469fd99033d55acc0138835fb9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "b6952fde14e7ad469fd99033d55acc0138835fb9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6952fde14e7ad469fd99033d55acc0138835fb9.part --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6952fde14e7ad469fd99033d55acc0138835fb9.part --force-share --output=json" returned: 0 in 0.330s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:12 user nova-compute[73258]: DEBUG nova.virt.images [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] 8abd7ee1-5a4a-495d-a692-665d88f59000 was qcow2, converting to raw {{(pid=73258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 06:53:12 user nova-compute[73258]: DEBUG nova.privsep.utils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 06:53:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b6952fde14e7ad469fd99033d55acc0138835fb9.part /opt/stack/data/nova/instances/_base/b6952fde14e7ad469fd99033d55acc0138835fb9.converted {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:12 user nova-compute[73258]: DEBUG nova.network.neutron [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Successfully created port: ec3a771c-4248-4c68-ab25-763dda6741ea {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:53:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b6952fde14e7ad469fd99033d55acc0138835fb9.part /opt/stack/data/nova/instances/_base/b6952fde14e7ad469fd99033d55acc0138835fb9.converted" returned: 0 in 0.780s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6952fde14e7ad469fd99033d55acc0138835fb9.converted --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6952fde14e7ad469fd99033d55acc0138835fb9.converted --force-share --output=json" returned: 0 in 0.217s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "b6952fde14e7ad469fd99033d55acc0138835fb9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.232s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6952fde14e7ad469fd99033d55acc0138835fb9 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6952fde14e7ad469fd99033d55acc0138835fb9 --force-share --output=json" returned: 0 in 0.215s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "b6952fde14e7ad469fd99033d55acc0138835fb9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "b6952fde14e7ad469fd99033d55acc0138835fb9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6952fde14e7ad469fd99033d55acc0138835fb9 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6952fde14e7ad469fd99033d55acc0138835fb9 --force-share --output=json" returned: 0 in 0.183s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6952fde14e7ad469fd99033d55acc0138835fb9,backing_fmt=raw /opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6952fde14e7ad469fd99033d55acc0138835fb9,backing_fmt=raw /opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/disk 1073741824" returned: 0 in 0.052s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "b6952fde14e7ad469fd99033d55acc0138835fb9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6952fde14e7ad469fd99033d55acc0138835fb9 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6952fde14e7ad469fd99033d55acc0138835fb9 --force-share --output=json" returned: 0 in 0.187s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:53:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Ensure instance console log exists: /opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:53:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:14 user nova-compute[73258]: DEBUG nova.network.neutron [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Successfully updated port: ec3a771c-4248-4c68-ab25-763dda6741ea {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:53:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "refresh_cache-01a9f7b2-805a-4ece-a29c-33ac0057cc9b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:53:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquired lock "refresh_cache-01a9f7b2-805a-4ece-a29c-33ac0057cc9b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:53:14 user nova-compute[73258]: DEBUG nova.network.neutron [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:53:14 user nova-compute[73258]: DEBUG nova.compute.manager [req-35213dd6-0e76-40a1-adf1-ca598211f52b req-acd282e4-7ed9-4626-9d50-1a1c775cec6d service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Received event network-changed-ec3a771c-4248-4c68-ab25-763dda6741ea {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:53:14 user nova-compute[73258]: DEBUG nova.compute.manager [req-35213dd6-0e76-40a1-adf1-ca598211f52b req-acd282e4-7ed9-4626-9d50-1a1c775cec6d service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Refreshing instance network info cache due to event network-changed-ec3a771c-4248-4c68-ab25-763dda6741ea. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:53:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-35213dd6-0e76-40a1-adf1-ca598211f52b req-acd282e4-7ed9-4626-9d50-1a1c775cec6d service nova] Acquiring lock "refresh_cache-01a9f7b2-805a-4ece-a29c-33ac0057cc9b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:53:14 user nova-compute[73258]: DEBUG nova.network.neutron [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.network.neutron [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Updating instance_info_cache with network_info: [{"id": "ec3a771c-4248-4c68-ab25-763dda6741ea", "address": "fa:16:3e:29:0d:42", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec3a771c-42", "ovs_interfaceid": "ec3a771c-4248-4c68-ab25-763dda6741ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Releasing lock "refresh_cache-01a9f7b2-805a-4ece-a29c-33ac0057cc9b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.compute.manager [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Instance network_info: |[{"id": "ec3a771c-4248-4c68-ab25-763dda6741ea", "address": "fa:16:3e:29:0d:42", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec3a771c-42", "ovs_interfaceid": "ec3a771c-4248-4c68-ab25-763dda6741ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-35213dd6-0e76-40a1-adf1-ca598211f52b req-acd282e4-7ed9-4626-9d50-1a1c775cec6d service nova] Acquired lock "refresh_cache-01a9f7b2-805a-4ece-a29c-33ac0057cc9b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.network.neutron [req-35213dd6-0e76-40a1-adf1-ca598211f52b req-acd282e4-7ed9-4626-9d50-1a1c775cec6d service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Refreshing network info cache for port ec3a771c-4248-4c68-ab25-763dda6741ea {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Start _get_guest_xml network_info=[{"id": "ec3a771c-4248-4c68-ab25-763dda6741ea", "address": "fa:16:3e:29:0d:42", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec3a771c-42", "ovs_interfaceid": "ec3a771c-4248-4c68-ab25-763dda6741ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ef6113e108c6f64365fe2018342ed80e',container_format='bare',created_at=2023-08-27T06:53:01Z,direct_url=<?>,disk_format='qcow2',id=8abd7ee1-5a4a-495d-a692-665d88f59000,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-927217249',owner='72f7bfc1fb284defb6f92a77be8821e5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T06:53:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '8abd7ee1-5a4a-495d-a692-665d88f59000'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:53:15 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:53:15 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ef6113e108c6f64365fe2018342ed80e',container_format='bare',created_at=2023-08-27T06:53:01Z,direct_url=<?>,disk_format='qcow2',id=8abd7ee1-5a4a-495d-a692-665d88f59000,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-927217249',owner='72f7bfc1fb284defb6f92a77be8821e5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T06:53:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-858831142',display_name='tempest-TestStampPattern-server-858831142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-858831142',id=36,image_ref='8abd7ee1-5a4a-495d-a692-665d88f59000',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwYZxibBAc2nvlcafNqnemngRCXIz90U4I2XLhwZXxc9YEXEO2YKFZ69eY+zmysXtc6kSJDnPSsSYt70Y3+IiQVuHG0DIaBJdVBu3sgT92WAEQ0yFaQ4/zUiXf3G0XH5w==',key_name='tempest-TestStampPattern-1276587428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72f7bfc1fb284defb6f92a77be8821e5',ramdisk_id='',reservation_id='r-adtwpcqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d409b021-ab98-4f9f-a80d-99fe05de7b69',image_min_disk='1',image_min_ram='0',image_owner_id='72f7bfc1fb284defb6f92a77be8821e5',image_owner_project_name='tempest-TestStampPattern-873602452',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-873602452-project-member',image_user_id='7c44464f6e84417cb8823d01c7aa669f',network_allocated='True',owner_project_name='tempest-TestStampPattern-873602452',owner_user_name='tempest-TestStampPattern-873602452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:53:11Z,user_data=None,user_id='7c44464f6e84417cb8823d01c7aa669f',uuid=01a9f7b2-805a-4ece-a29c-33ac0057cc9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec3a771c-4248-4c68-ab25-763dda6741ea", "address": "fa:16:3e:29:0d:42", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec3a771c-42", "ovs_interfaceid": "ec3a771c-4248-4c68-ab25-763dda6741ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Converting VIF {"id": "ec3a771c-4248-4c68-ab25-763dda6741ea", "address": "fa:16:3e:29:0d:42", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec3a771c-42", "ovs_interfaceid": "ec3a771c-4248-4c68-ab25-763dda6741ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:0d:42,bridge_name='br-int',has_traffic_filtering=True,id=ec3a771c-4248-4c68-ab25-763dda6741ea,network=Network(d52cca87-60dc-45ab-b7fe-f5a26a33e0ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec3a771c-42') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.objects.instance [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lazy-loading 'pci_devices' on Instance uuid 01a9f7b2-805a-4ece-a29c-33ac0057cc9b {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:53:15 user nova-compute[73258]:   <uuid>01a9f7b2-805a-4ece-a29c-33ac0057cc9b</uuid>
Aug 27 06:53:15 user nova-compute[73258]:   <name>instance-00000024</name>
Aug 27 06:53:15 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:53:15 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:53:15 user nova-compute[73258]:   <metadata>
Aug 27 06:53:15 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:53:15 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:53:15 user nova-compute[73258]:       <nova:name>tempest-TestStampPattern-server-858831142</nova:name>
Aug 27 06:53:15 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:53:15</nova:creationTime>
Aug 27 06:53:15 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:53:15 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:53:15 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:53:15 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:53:15 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:53:15 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:53:15 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:53:15 user nova-compute[73258]:       <nova:owner>
Aug 27 06:53:15 user nova-compute[73258]:         <nova:user uuid="7c44464f6e84417cb8823d01c7aa669f">tempest-TestStampPattern-873602452-project-member</nova:user>
Aug 27 06:53:15 user nova-compute[73258]:         <nova:project uuid="72f7bfc1fb284defb6f92a77be8821e5">tempest-TestStampPattern-873602452</nova:project>
Aug 27 06:53:15 user nova-compute[73258]:       </nova:owner>
Aug 27 06:53:15 user nova-compute[73258]:       <nova:root type="image" uuid="8abd7ee1-5a4a-495d-a692-665d88f59000"/>
Aug 27 06:53:15 user nova-compute[73258]:       <nova:ports>
Aug 27 06:53:15 user nova-compute[73258]:         <nova:port uuid="ec3a771c-4248-4c68-ab25-763dda6741ea">
Aug 27 06:53:15 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 06:53:15 user nova-compute[73258]:         </nova:port>
Aug 27 06:53:15 user nova-compute[73258]:       </nova:ports>
Aug 27 06:53:15 user nova-compute[73258]:     </nova:instance>
Aug 27 06:53:15 user nova-compute[73258]:   </metadata>
Aug 27 06:53:15 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:53:15 user nova-compute[73258]:     <system>
Aug 27 06:53:15 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:53:15 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:53:15 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:53:15 user nova-compute[73258]:       <entry name="serial">01a9f7b2-805a-4ece-a29c-33ac0057cc9b</entry>
Aug 27 06:53:15 user nova-compute[73258]:       <entry name="uuid">01a9f7b2-805a-4ece-a29c-33ac0057cc9b</entry>
Aug 27 06:53:15 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:53:15 user nova-compute[73258]:     </system>
Aug 27 06:53:15 user nova-compute[73258]:   </sysinfo>
Aug 27 06:53:15 user nova-compute[73258]:   <os>
Aug 27 06:53:15 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:53:15 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:53:15 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:53:15 user nova-compute[73258]:   </os>
Aug 27 06:53:15 user nova-compute[73258]:   <features>
Aug 27 06:53:15 user nova-compute[73258]:     <acpi/>
Aug 27 06:53:15 user nova-compute[73258]:     <apic/>
Aug 27 06:53:15 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:53:15 user nova-compute[73258]:   </features>
Aug 27 06:53:15 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:53:15 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:53:15 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:53:15 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:53:15 user nova-compute[73258]:   </clock>
Aug 27 06:53:15 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:53:15 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:53:15 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:53:15 user nova-compute[73258]:   </cpu>
Aug 27 06:53:15 user nova-compute[73258]:   <devices>
Aug 27 06:53:15 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:53:15 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:53:15 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/disk"/>
Aug 27 06:53:15 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:53:15 user nova-compute[73258]:     </disk>
Aug 27 06:53:15 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:53:15 user nova-compute[73258]:       <mac address="fa:16:3e:29:0d:42"/>
Aug 27 06:53:15 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:53:15 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:53:15 user nova-compute[73258]:       <target dev="tapec3a771c-42"/>
Aug 27 06:53:15 user nova-compute[73258]:     </interface>
Aug 27 06:53:15 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:53:15 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/console.log" append="off"/>
Aug 27 06:53:15 user nova-compute[73258]:     </serial>
Aug 27 06:53:15 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:53:15 user nova-compute[73258]:     <video>
Aug 27 06:53:15 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:53:15 user nova-compute[73258]:     </video>
Aug 27 06:53:15 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:53:15 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:53:15 user nova-compute[73258]:     </rng>
Aug 27 06:53:15 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:53:15 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:53:15 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:53:15 user nova-compute[73258]:     </memballoon>
Aug 27 06:53:15 user nova-compute[73258]:   </devices>
Aug 27 06:53:15 user nova-compute[73258]: </domain>
Aug 27 06:53:15 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-858831142',display_name='tempest-TestStampPattern-server-858831142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-858831142',id=36,image_ref='8abd7ee1-5a4a-495d-a692-665d88f59000',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwYZxibBAc2nvlcafNqnemngRCXIz90U4I2XLhwZXxc9YEXEO2YKFZ69eY+zmysXtc6kSJDnPSsSYt70Y3+IiQVuHG0DIaBJdVBu3sgT92WAEQ0yFaQ4/zUiXf3G0XH5w==',key_name='tempest-TestStampPattern-1276587428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72f7bfc1fb284defb6f92a77be8821e5',ramdisk_id='',reservation_id='r-adtwpcqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d409b021-ab98-4f9f-a80d-99fe05de7b69',image_min_disk='1',image_min_ram='0',image_owner_id='72f7bfc1fb284defb6f92a77be8821e5',image_owner_project_name='tempest-TestStampPattern-873602452',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-873602452-project-member',image_user_id='7c44464f6e84417cb8823d01c7aa669f',network_allocated='True',owner_project_name='tempest-TestStampPattern-873602452',owner_user_name='tempest-TestStampPattern-873602452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:53:11Z,user_data=None,user_id='7c44464f6e84417cb8823d01c7aa669f',uuid=01a9f7b2-805a-4ece-a29c-33ac0057cc9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec3a771c-4248-4c68-ab25-763dda6741ea", "address": "fa:16:3e:29:0d:42", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec3a771c-42", "ovs_interfaceid": "ec3a771c-4248-4c68-ab25-763dda6741ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Converting VIF {"id": "ec3a771c-4248-4c68-ab25-763dda6741ea", "address": "fa:16:3e:29:0d:42", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec3a771c-42", "ovs_interfaceid": "ec3a771c-4248-4c68-ab25-763dda6741ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:0d:42,bridge_name='br-int',has_traffic_filtering=True,id=ec3a771c-4248-4c68-ab25-763dda6741ea,network=Network(d52cca87-60dc-45ab-b7fe-f5a26a33e0ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec3a771c-42') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG os_vif [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:0d:42,bridge_name='br-int',has_traffic_filtering=True,id=ec3a771c-4248-4c68-ab25-763dda6741ea,network=Network(d52cca87-60dc-45ab-b7fe-f5a26a33e0ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec3a771c-42') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec3a771c-42, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec3a771c-42, col_values=(('external_ids', {'iface-id': 'ec3a771c-4248-4c68-ab25-763dda6741ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:0d:42', 'vm-uuid': '01a9f7b2-805a-4ece-a29c-33ac0057cc9b'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:15 user nova-compute[73258]: INFO os_vif [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:0d:42,bridge_name='br-int',has_traffic_filtering=True,id=ec3a771c-4248-4c68-ab25-763dda6741ea,network=Network(d52cca87-60dc-45ab-b7fe-f5a26a33e0ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec3a771c-42')
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119180.5077186, bcd29636-071b-4699-8360-e0d189df3f95 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:53:15 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: bcd29636-071b-4699-8360-e0d189df3f95] VM Stopped (Lifecycle Event)
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] No VIF found with MAC fa:16:3e:29:0d:42, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.compute.manager [None req-482b1c5c-9944-4051-a7f4-1f2f4da867bf None None] [instance: bcd29636-071b-4699-8360-e0d189df3f95] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.network.neutron [req-35213dd6-0e76-40a1-adf1-ca598211f52b req-acd282e4-7ed9-4626-9d50-1a1c775cec6d service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Updated VIF entry in instance network info cache for port ec3a771c-4248-4c68-ab25-763dda6741ea. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG nova.network.neutron [req-35213dd6-0e76-40a1-adf1-ca598211f52b req-acd282e4-7ed9-4626-9d50-1a1c775cec6d service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Updating instance_info_cache with network_info: [{"id": "ec3a771c-4248-4c68-ab25-763dda6741ea", "address": "fa:16:3e:29:0d:42", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec3a771c-42", "ovs_interfaceid": "ec3a771c-4248-4c68-ab25-763dda6741ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:53:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-35213dd6-0e76-40a1-adf1-ca598211f52b req-acd282e4-7ed9-4626-9d50-1a1c775cec6d service nova] Releasing lock "refresh_cache-01a9f7b2-805a-4ece-a29c-33ac0057cc9b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:53:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-e7793b9e-d5d1-4111-ad31-e11e02298556 req-aa9b8a13-047b-4484-b888-d7047649598c service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Received event network-vif-plugged-ec3a771c-4248-4c68-ab25-763dda6741ea {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:53:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e7793b9e-d5d1-4111-ad31-e11e02298556 req-aa9b8a13-047b-4484-b888-d7047649598c service nova] Acquiring lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e7793b9e-d5d1-4111-ad31-e11e02298556 req-aa9b8a13-047b-4484-b888-d7047649598c service nova] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e7793b9e-d5d1-4111-ad31-e11e02298556 req-aa9b8a13-047b-4484-b888-d7047649598c service nova] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-e7793b9e-d5d1-4111-ad31-e11e02298556 req-aa9b8a13-047b-4484-b888-d7047649598c service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] No waiting events found dispatching network-vif-plugged-ec3a771c-4248-4c68-ab25-763dda6741ea {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:53:17 user nova-compute[73258]: WARNING nova.compute.manager [req-e7793b9e-d5d1-4111-ad31-e11e02298556 req-aa9b8a13-047b-4484-b888-d7047649598c service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Received unexpected event network-vif-plugged-ec3a771c-4248-4c68-ab25-763dda6741ea for instance with vm_state building and task_state spawning.
Aug 27 06:53:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-b397e437-7bd8-479f-b16b-632e9a46fde2 req-2cceb95e-27bb-4975-80f3-cd4f184ad8c2 service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Received event network-vif-plugged-ec3a771c-4248-4c68-ab25-763dda6741ea {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:53:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b397e437-7bd8-479f-b16b-632e9a46fde2 req-2cceb95e-27bb-4975-80f3-cd4f184ad8c2 service nova] Acquiring lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b397e437-7bd8-479f-b16b-632e9a46fde2 req-2cceb95e-27bb-4975-80f3-cd4f184ad8c2 service nova] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b397e437-7bd8-479f-b16b-632e9a46fde2 req-2cceb95e-27bb-4975-80f3-cd4f184ad8c2 service nova] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-b397e437-7bd8-479f-b16b-632e9a46fde2 req-2cceb95e-27bb-4975-80f3-cd4f184ad8c2 service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] No waiting events found dispatching network-vif-plugged-ec3a771c-4248-4c68-ab25-763dda6741ea {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:53:19 user nova-compute[73258]: WARNING nova.compute.manager [req-b397e437-7bd8-479f-b16b-632e9a46fde2 req-2cceb95e-27bb-4975-80f3-cd4f184ad8c2 service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Received unexpected event network-vif-plugged-ec3a771c-4248-4c68-ab25-763dda6741ea for instance with vm_state building and task_state spawning.
Aug 27 06:53:19 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119199.4129748, 01a9f7b2-805a-4ece-a29c-33ac0057cc9b => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:53:19 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] VM Resumed (Lifecycle Event)
Aug 27 06:53:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:53:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:53:19 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Instance spawned successfully.
Aug 27 06:53:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:53:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:53:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:53:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:53:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:53:19 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:53:19 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119199.4211428, 01a9f7b2-805a-4ece-a29c-33ac0057cc9b => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:53:19 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] VM Started (Lifecycle Event)
Aug 27 06:53:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:53:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:53:19 user nova-compute[73258]: INFO nova.compute.manager [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Took 8.57 seconds to spawn the instance on the hypervisor.
Aug 27 06:53:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:53:19 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:53:19 user nova-compute[73258]: INFO nova.compute.manager [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Took 9.52 seconds to build instance.
Aug 27 06:53:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-60238ae9-b655-4b4a-ad90-f079b84f7cd8 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.644s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "0c16951e-8620-493f-8af4-fbdc64e1c131" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:37 user nova-compute[73258]: DEBUG nova.compute.manager [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:53:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:37 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:53:37 user nova-compute[73258]: INFO nova.compute.claims [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Claim successful on node user
Aug 27 06:53:37 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:53:37 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:53:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:37 user nova-compute[73258]: DEBUG nova.compute.manager [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:53:37 user nova-compute[73258]: DEBUG nova.compute.manager [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:53:37 user nova-compute[73258]: DEBUG nova.network.neutron [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:53:38 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:53:38 user nova-compute[73258]: DEBUG nova.compute.manager [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:53:38 user nova-compute[73258]: INFO nova.virt.block_device [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Booting with volume 7ad57bda-1e6b-42da-b681-1a8d6a4baa16 at /dev/vda
Aug 27 06:53:38 user nova-compute[73258]: DEBUG nova.policy [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a31d853a46bd447e9bc757694d6cbf5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d7b80576d482a9b88ac09acdd2a55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG os_brick.utils [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[500801cc-cab8-409e-9d06-cef40cefd2e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd35de2c-d345-434c-873f-f99b838ea889]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cd134d-c462-465e-866f-3d7d4319de34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f576e94-2140-43f9-bc0c-70c09ec177ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:53:38 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:53:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[538e3a4a-74ba-4d2c-8e4d-0a27ec4132b7]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG os_brick.utils [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Updating existing volume attachment record: f0b69c8a-cf1c-4889-a57a-bbe97b6eb77e {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:38 user nova-compute[73258]: DEBUG nova.network.neutron [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Successfully created port: 1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:53:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:39 user nova-compute[73258]: DEBUG nova.network.neutron [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Successfully updated port: 1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:53:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:53:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquired lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:53:39 user nova-compute[73258]: DEBUG nova.network.neutron [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:53:40 user nova-compute[73258]: DEBUG nova.compute.manager [req-0cfa86da-3a9d-4310-92e2-253d606f45f9 req-d3e71224-d564-4e2b-b6fd-923dce29b0fe service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received event network-changed-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:53:40 user nova-compute[73258]: DEBUG nova.compute.manager [req-0cfa86da-3a9d-4310-92e2-253d606f45f9 req-d3e71224-d564-4e2b-b6fd-923dce29b0fe service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Refreshing instance network info cache due to event network-changed-1e7db346-1c0e-4a29-a6e9-053cd736b399. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:53:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0cfa86da-3a9d-4310-92e2-253d606f45f9 req-d3e71224-d564-4e2b-b6fd-923dce29b0fe service nova] Acquiring lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:53:40 user nova-compute[73258]: DEBUG nova.network.neutron [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:53:40 user nova-compute[73258]: DEBUG nova.network.neutron [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Updating instance_info_cache with network_info: [{"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:53:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Releasing lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:53:40 user nova-compute[73258]: DEBUG nova.compute.manager [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Instance network_info: |[{"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:53:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0cfa86da-3a9d-4310-92e2-253d606f45f9 req-d3e71224-d564-4e2b-b6fd-923dce29b0fe service nova] Acquired lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:53:40 user nova-compute[73258]: DEBUG nova.network.neutron [req-0cfa86da-3a9d-4310-92e2-253d606f45f9 req-d3e71224-d564-4e2b-b6fd-923dce29b0fe service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Refreshing network info cache for port 1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:53:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:40 user nova-compute[73258]: DEBUG nova.network.neutron [req-0cfa86da-3a9d-4310-92e2-253d606f45f9 req-d3e71224-d564-4e2b-b6fd-923dce29b0fe service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Updated VIF entry in instance network info cache for port 1e7db346-1c0e-4a29-a6e9-053cd736b399. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:53:40 user nova-compute[73258]: DEBUG nova.network.neutron [req-0cfa86da-3a9d-4310-92e2-253d606f45f9 req-d3e71224-d564-4e2b-b6fd-923dce29b0fe service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Updating instance_info_cache with network_info: [{"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:53:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0cfa86da-3a9d-4310-92e2-253d606f45f9 req-d3e71224-d564-4e2b-b6fd-923dce29b0fe service nova] Releasing lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:53:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "a296fb1e-1999-475c-9a15-eeeedfa11247" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:53:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:42 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:53:42 user nova-compute[73258]: INFO nova.compute.claims [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Claim successful on node user
Aug 27 06:53:43 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:53:43 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:53:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:53:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:53:43 user nova-compute[73258]: DEBUG nova.network.neutron [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:53:43 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:53:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:53:43 user nova-compute[73258]: DEBUG nova.policy [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36c0faed29a446aa9fa6ff8692581aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cf34590d8d4b8b89b9626c6e150df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:53:43 user nova-compute[73258]: INFO nova.virt.block_device [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Booting with volume-backed-image a1da8f3b-7558-465b-96c4-208255c7b142 at /dev/vda
Aug 27 06:53:44 user nova-compute[73258]: DEBUG nova.network.neutron [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Successfully created port: ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:53:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:45 user nova-compute[73258]: DEBUG nova.network.neutron [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Successfully updated port: ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:53:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "refresh_cache-a296fb1e-1999-475c-9a15-eeeedfa11247" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:53:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquired lock "refresh_cache-a296fb1e-1999-475c-9a15-eeeedfa11247" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:53:45 user nova-compute[73258]: DEBUG nova.network.neutron [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:53:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:45 user nova-compute[73258]: DEBUG nova.compute.manager [req-1faa6809-c90a-46b0-9fa1-2004453f257c req-dc42d8fe-29df-40a1-9fdc-3454d17071df service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received event network-changed-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:53:45 user nova-compute[73258]: DEBUG nova.compute.manager [req-1faa6809-c90a-46b0-9fa1-2004453f257c req-dc42d8fe-29df-40a1-9fdc-3454d17071df service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Refreshing instance network info cache due to event network-changed-ae8b8c03-b302-4043-ac07-b3561b7bf6f3. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:53:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1faa6809-c90a-46b0-9fa1-2004453f257c req-dc42d8fe-29df-40a1-9fdc-3454d17071df service nova] Acquiring lock "refresh_cache-a296fb1e-1999-475c-9a15-eeeedfa11247" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:53:45 user nova-compute[73258]: DEBUG nova.network.neutron [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:53:45 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:53:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:53:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Didn't find any instances for network info cache update. {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 06:53:45 user nova-compute[73258]: DEBUG nova.network.neutron [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Updating instance_info_cache with network_info: [{"id": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "address": "fa:16:3e:dd:b3:4a", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8b8c03-b3", "ovs_interfaceid": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:53:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Releasing lock "refresh_cache-a296fb1e-1999-475c-9a15-eeeedfa11247" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:53:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Instance network_info: |[{"id": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "address": "fa:16:3e:dd:b3:4a", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8b8c03-b3", "ovs_interfaceid": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:53:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1faa6809-c90a-46b0-9fa1-2004453f257c req-dc42d8fe-29df-40a1-9fdc-3454d17071df service nova] Acquired lock "refresh_cache-a296fb1e-1999-475c-9a15-eeeedfa11247" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:53:45 user nova-compute[73258]: DEBUG nova.network.neutron [req-1faa6809-c90a-46b0-9fa1-2004453f257c req-dc42d8fe-29df-40a1-9fdc-3454d17071df service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Refreshing network info cache for port ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:53:46 user nova-compute[73258]: DEBUG nova.network.neutron [req-1faa6809-c90a-46b0-9fa1-2004453f257c req-dc42d8fe-29df-40a1-9fdc-3454d17071df service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Updated VIF entry in instance network info cache for port ae8b8c03-b302-4043-ac07-b3561b7bf6f3. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:53:46 user nova-compute[73258]: DEBUG nova.network.neutron [req-1faa6809-c90a-46b0-9fa1-2004453f257c req-dc42d8fe-29df-40a1-9fdc-3454d17071df service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Updating instance_info_cache with network_info: [{"id": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "address": "fa:16:3e:dd:b3:4a", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8b8c03-b3", "ovs_interfaceid": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:53:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1faa6809-c90a-46b0-9fa1-2004453f257c req-dc42d8fe-29df-40a1-9fdc-3454d17071df service nova] Releasing lock "refresh_cache-a296fb1e-1999-475c-9a15-eeeedfa11247" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:53:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:46 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:53:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:46 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:53:46 user nova-compute[73258]: INFO nova.compute.claims [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Claim successful on node user
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_power_states {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:53:47 user nova-compute[73258]: WARNING nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] While synchronizing instance power states, found 14 instances in the database and 11 instances on the hypervisor.
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid 1672aa9f-be6f-4357-877f-a48f62119df4 {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid a836678e-240d-4ead-b0b5-64d146910a23 {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid 7ee743f1-9611-4165-838e-54fccb332f1a {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid bc3cebb3-0e29-4899-94aa-d13a2a9ca86a {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid ede6423b-ad91-4002-91d1-5849c6a4e26b {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid b22b7599-5a37-4370-b440-f04e3dc88f98 {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid d409b021-ab98-4f9f-a80d-99fe05de7b69 {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5 {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid 01a9f7b2-805a-4ece-a29c-33ac0057cc9b {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid 0c16951e-8620-493f-8af4-fbdc64e1c131 {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid a296fb1e-1999-475c-9a15-eeeedfa11247 {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "1672aa9f-be6f-4357-877f-a48f62119df4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "a836678e-240d-4ead-b0b5-64d146910a23" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "a836678e-240d-4ead-b0b5-64d146910a23" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "7ee743f1-9611-4165-838e-54fccb332f1a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "7ee743f1-9611-4165-838e-54fccb332f1a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "ede6423b-ad91-4002-91d1-5849c6a4e26b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "b22b7599-5a37-4370-b440-f04e3dc88f98" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "d409b021-ab98-4f9f-a80d-99fe05de7b69" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "0c16951e-8620-493f-8af4-fbdc64e1c131" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "a296fb1e-1999-475c-9a15-eeeedfa11247" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "a836678e-240d-4ead-b0b5-64d146910a23" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "1672aa9f-be6f-4357-877f-a48f62119df4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "7ee743f1-9611-4165-838e-54fccb332f1a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.645s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:53:47 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.policy [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e3b8e4e749b4d039b4d5ebdc6469151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191ca81ae335419aa935b1b7576b12ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:53:47 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Creating image(s)
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "/opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "/opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "/opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.207s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk 1073741824" returned: 0 in 0.065s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:48 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Successfully created port: 6eec761c-f898-4839-ad70-aa9d7ac1a525 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:53:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.196s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:48 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:53:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:48 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Cannot resize image /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:53:48 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:53:48 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Ensure instance console log exists: /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:53:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:48 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Successfully updated port: 6eec761c-f898-4839-ad70-aa9d7ac1a525 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "refresh_cache-0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquired lock "refresh_cache-0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-71dcb43f-78e7-4526-a165-369380e4dc81 req-7c5fe018-e02a-4fd7-9413-bdbd82bae86e service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Received event network-changed-6eec761c-f898-4839-ad70-aa9d7ac1a525 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-71dcb43f-78e7-4526-a165-369380e4dc81 req-7c5fe018-e02a-4fd7-9413-bdbd82bae86e service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Refreshing instance network info cache due to event network-changed-6eec761c-f898-4839-ad70-aa9d7ac1a525. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-71dcb43f-78e7-4526-a165-369380e4dc81 req-7c5fe018-e02a-4fd7-9413-bdbd82bae86e service nova] Acquiring lock "refresh_cache-0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Updating instance_info_cache with network_info: [{"id": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "address": "fa:16:3e:42:89:97", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eec761c-f8", "ovs_interfaceid": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Releasing lock "refresh_cache-0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Instance network_info: |[{"id": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "address": "fa:16:3e:42:89:97", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eec761c-f8", "ovs_interfaceid": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-71dcb43f-78e7-4526-a165-369380e4dc81 req-7c5fe018-e02a-4fd7-9413-bdbd82bae86e service nova] Acquired lock "refresh_cache-0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.network.neutron [req-71dcb43f-78e7-4526-a165-369380e4dc81 req-7c5fe018-e02a-4fd7-9413-bdbd82bae86e service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Refreshing network info cache for port 6eec761c-f898-4839-ad70-aa9d7ac1a525 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Start _get_guest_xml network_info=[{"id": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "address": "fa:16:3e:42:89:97", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eec761c-f8", "ovs_interfaceid": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:53:49 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:53:49 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:53:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-854491628',display_name='tempest-AttachVolumeTestJSON-server-854491628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-854491628',id=39,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDLZycggjDg5s64PuctBTitQ9WYXvHoZECt1ZDntDuN+UeBkkvHFSoBx5c8+HS7LZdVJ6XuRs93OzCSow0i2KYhjVOrmlrYFf2TG2Xt4lq43lqsCGKX0bOkPqHcFT5hUA==',key_name='tempest-keypair-187464713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='191ca81ae335419aa935b1b7576b12ff',ramdisk_id='',reservation_id='r-3xahh2d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1777325696',owner_user_name='tempest-AttachVolumeTestJSON-1777325696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:53:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e3b8e4e749b4d039b4d5ebdc6469151',uuid=0bd74dd7-a64c-4233-b8e9-6574eb2a75d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "address": "fa:16:3e:42:89:97", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eec761c-f8", "ovs_interfaceid": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converting VIF {"id": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "address": "fa:16:3e:42:89:97", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eec761c-f8", "ovs_interfaceid": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:89:97,bridge_name='br-int',has_traffic_filtering=True,id=6eec761c-f898-4839-ad70-aa9d7ac1a525,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eec761c-f8') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.objects.instance [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:53:49 user nova-compute[73258]:   <uuid>0bd74dd7-a64c-4233-b8e9-6574eb2a75d6</uuid>
Aug 27 06:53:49 user nova-compute[73258]:   <name>instance-00000027</name>
Aug 27 06:53:49 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:53:49 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:53:49 user nova-compute[73258]:   <metadata>
Aug 27 06:53:49 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:53:49 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:53:49 user nova-compute[73258]:       <nova:name>tempest-AttachVolumeTestJSON-server-854491628</nova:name>
Aug 27 06:53:49 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:53:49</nova:creationTime>
Aug 27 06:53:49 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:53:49 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:53:49 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:53:49 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:53:49 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:53:49 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:53:49 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:53:49 user nova-compute[73258]:       <nova:owner>
Aug 27 06:53:49 user nova-compute[73258]:         <nova:user uuid="9e3b8e4e749b4d039b4d5ebdc6469151">tempest-AttachVolumeTestJSON-1777325696-project-member</nova:user>
Aug 27 06:53:49 user nova-compute[73258]:         <nova:project uuid="191ca81ae335419aa935b1b7576b12ff">tempest-AttachVolumeTestJSON-1777325696</nova:project>
Aug 27 06:53:49 user nova-compute[73258]:       </nova:owner>
Aug 27 06:53:49 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:53:49 user nova-compute[73258]:       <nova:ports>
Aug 27 06:53:49 user nova-compute[73258]:         <nova:port uuid="6eec761c-f898-4839-ad70-aa9d7ac1a525">
Aug 27 06:53:49 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 06:53:49 user nova-compute[73258]:         </nova:port>
Aug 27 06:53:49 user nova-compute[73258]:       </nova:ports>
Aug 27 06:53:49 user nova-compute[73258]:     </nova:instance>
Aug 27 06:53:49 user nova-compute[73258]:   </metadata>
Aug 27 06:53:49 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:53:49 user nova-compute[73258]:     <system>
Aug 27 06:53:49 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:53:49 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:53:49 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:53:49 user nova-compute[73258]:       <entry name="serial">0bd74dd7-a64c-4233-b8e9-6574eb2a75d6</entry>
Aug 27 06:53:49 user nova-compute[73258]:       <entry name="uuid">0bd74dd7-a64c-4233-b8e9-6574eb2a75d6</entry>
Aug 27 06:53:49 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:53:49 user nova-compute[73258]:     </system>
Aug 27 06:53:49 user nova-compute[73258]:   </sysinfo>
Aug 27 06:53:49 user nova-compute[73258]:   <os>
Aug 27 06:53:49 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:53:49 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:53:49 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:53:49 user nova-compute[73258]:   </os>
Aug 27 06:53:49 user nova-compute[73258]:   <features>
Aug 27 06:53:49 user nova-compute[73258]:     <acpi/>
Aug 27 06:53:49 user nova-compute[73258]:     <apic/>
Aug 27 06:53:49 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:53:49 user nova-compute[73258]:   </features>
Aug 27 06:53:49 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:53:49 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:53:49 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:53:49 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:53:49 user nova-compute[73258]:   </clock>
Aug 27 06:53:49 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:53:49 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:53:49 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:53:49 user nova-compute[73258]:   </cpu>
Aug 27 06:53:49 user nova-compute[73258]:   <devices>
Aug 27 06:53:49 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:53:49 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:53:49 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk"/>
Aug 27 06:53:49 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:53:49 user nova-compute[73258]:     </disk>
Aug 27 06:53:49 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:53:49 user nova-compute[73258]:       <mac address="fa:16:3e:42:89:97"/>
Aug 27 06:53:49 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:53:49 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:53:49 user nova-compute[73258]:       <target dev="tap6eec761c-f8"/>
Aug 27 06:53:49 user nova-compute[73258]:     </interface>
Aug 27 06:53:49 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:53:49 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/console.log" append="off"/>
Aug 27 06:53:49 user nova-compute[73258]:     </serial>
Aug 27 06:53:49 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:53:49 user nova-compute[73258]:     <video>
Aug 27 06:53:49 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:53:49 user nova-compute[73258]:     </video>
Aug 27 06:53:49 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:53:49 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:53:49 user nova-compute[73258]:     </rng>
Aug 27 06:53:49 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:53:49 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:53:49 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:53:49 user nova-compute[73258]:     </memballoon>
Aug 27 06:53:49 user nova-compute[73258]:   </devices>
Aug 27 06:53:49 user nova-compute[73258]: </domain>
Aug 27 06:53:49 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:53:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-854491628',display_name='tempest-AttachVolumeTestJSON-server-854491628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-854491628',id=39,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDLZycggjDg5s64PuctBTitQ9WYXvHoZECt1ZDntDuN+UeBkkvHFSoBx5c8+HS7LZdVJ6XuRs93OzCSow0i2KYhjVOrmlrYFf2TG2Xt4lq43lqsCGKX0bOkPqHcFT5hUA==',key_name='tempest-keypair-187464713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='191ca81ae335419aa935b1b7576b12ff',ramdisk_id='',reservation_id='r-3xahh2d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1777325696',owner_user_name='tempest-AttachVolumeTestJSON-1777325696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:53:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e3b8e4e749b4d039b4d5ebdc6469151',uuid=0bd74dd7-a64c-4233-b8e9-6574eb2a75d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "address": "fa:16:3e:42:89:97", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eec761c-f8", "ovs_interfaceid": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converting VIF {"id": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "address": "fa:16:3e:42:89:97", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eec761c-f8", "ovs_interfaceid": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:89:97,bridge_name='br-int',has_traffic_filtering=True,id=6eec761c-f898-4839-ad70-aa9d7ac1a525,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eec761c-f8') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG os_vif [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:89:97,bridge_name='br-int',has_traffic_filtering=True,id=6eec761c-f898-4839-ad70-aa9d7ac1a525,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eec761c-f8') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6eec761c-f8, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6eec761c-f8, col_values=(('external_ids', {'iface-id': '6eec761c-f898-4839-ad70-aa9d7ac1a525', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:89:97', 'vm-uuid': '0bd74dd7-a64c-4233-b8e9-6574eb2a75d6'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:49 user nova-compute[73258]: INFO os_vif [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:89:97,bridge_name='br-int',has_traffic_filtering=True,id=6eec761c-f898-4839-ad70-aa9d7ac1a525,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eec761c-f8')
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] No VIF found with MAC fa:16:3e:42:89:97, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:53:49 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:53:50 user nova-compute[73258]: DEBUG nova.network.neutron [req-71dcb43f-78e7-4526-a165-369380e4dc81 req-7c5fe018-e02a-4fd7-9413-bdbd82bae86e service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Updated VIF entry in instance network info cache for port 6eec761c-f898-4839-ad70-aa9d7ac1a525. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:53:50 user nova-compute[73258]: DEBUG nova.network.neutron [req-71dcb43f-78e7-4526-a165-369380e4dc81 req-7c5fe018-e02a-4fd7-9413-bdbd82bae86e service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Updating instance_info_cache with network_info: [{"id": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "address": "fa:16:3e:42:89:97", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eec761c-f8", "ovs_interfaceid": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:53:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-71dcb43f-78e7-4526-a165-369380e4dc81 req-7c5fe018-e02a-4fd7-9413-bdbd82bae86e service nova] Releasing lock "refresh_cache-0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:53:50 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:53:50 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:53:50 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:53:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:51 user nova-compute[73258]: DEBUG nova.compute.manager [req-22a300cd-99bf-4bb0-96de-a48254fbc099 req-13f15769-fa43-40e1-965f-97ffc7185692 service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Received event network-vif-plugged-6eec761c-f898-4839-ad70-aa9d7ac1a525 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:53:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-22a300cd-99bf-4bb0-96de-a48254fbc099 req-13f15769-fa43-40e1-965f-97ffc7185692 service nova] Acquiring lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-22a300cd-99bf-4bb0-96de-a48254fbc099 req-13f15769-fa43-40e1-965f-97ffc7185692 service nova] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-22a300cd-99bf-4bb0-96de-a48254fbc099 req-13f15769-fa43-40e1-965f-97ffc7185692 service nova] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:51 user nova-compute[73258]: DEBUG nova.compute.manager [req-22a300cd-99bf-4bb0-96de-a48254fbc099 req-13f15769-fa43-40e1-965f-97ffc7185692 service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] No waiting events found dispatching network-vif-plugged-6eec761c-f898-4839-ad70-aa9d7ac1a525 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:53:51 user nova-compute[73258]: WARNING nova.compute.manager [req-22a300cd-99bf-4bb0-96de-a48254fbc099 req-13f15769-fa43-40e1-965f-97ffc7185692 service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Received unexpected event network-vif-plugged-6eec761c-f898-4839-ad70-aa9d7ac1a525 for instance with vm_state building and task_state spawning.
Aug 27 06:53:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:53:52 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Creating image(s)
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Did not create local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Ensure instance console log exists: /opt/stack/data/nova/instances/0c16951e-8620-493f-8af4-fbdc64e1c131/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Start _get_guest_xml network_info=[{"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbFOBqYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0c16951e-8620-493f-8af4-fbdc64e1c131', 'attached_at': '', 'detached_at': '', 'volume_id': '7ad57bda-1e6b-42da-b681-1a8d6a4baa16', 'serial': '7ad57bda-1e6b-42da-b681-1a8d6a4baa16'}, 'attachment_id': 'f0b69c8a-cf1c-4889-a57a-bbe97b6eb77e', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:53:52 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:53:52 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbFOBqYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:53:52 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:53:52 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:53:52 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2adc41-4ec9-48a4-a063-babb8f5c7037]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:53:52 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad8bdd0-3c32-4240-9e31-3ab48a1d24ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16] added
Aug 27 06:53:52 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00b6c3b-8e49-42b7-92ba-23cb973ee93a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[431d322c-0b3f-4194-8ad2-113954e152b9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KbFOBqYG {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KbFOBqYG" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8af965-e4d7-495e-be33-9f57ebdf81f3]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KbFOBqYG'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f292ece0-13e5-46ea-8545-d441c9f58c07]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c850fa-e977-4b79-b61f-a87c4876e7da]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:53:52 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:53:52 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:53:52 user nova-compute[73258]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:53:52 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:53:52 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:53:52 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:53:52 user nova-compute[73258]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:53:52 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee660e3-9f90-4670-acad-226be45bdda6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16, portal: 172.16.0.220,3260]
Aug 27 06:53:52 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16, portal: 172.16.0.220,3260] successful.
Aug 27 06:53:52 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b441eb-f332-41fb-ac92-28d901336c6d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c7ef4c-2af0-413d-9bc3-6e44fbe290dc]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:53:52 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:53:52 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:53:52 user nova-compute[73258]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:53:52 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:53:52 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:53:52 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:53:52 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:53:52 user nova-compute[73258]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:53:52 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:53:52 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bc0db1-efbd-41cf-b8ee-efc4393564e0]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:52 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119233.477606, 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:53:53 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] VM Resumed (Lifecycle Event)
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:53:53 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Instance spawned successfully.
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:53:53 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119233.4813406, 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:53:53 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] VM Started (Lifecycle Event)
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.compute.manager [req-217de371-8d5e-4a49-b37c-57a0774630c6 req-ad7dffba-13aa-4531-816e-3520a2cfd1dd service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Received event network-vif-plugged-6eec761c-f898-4839-ad70-aa9d7ac1a525 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-217de371-8d5e-4a49-b37c-57a0774630c6 req-ad7dffba-13aa-4531-816e-3520a2cfd1dd service nova] Acquiring lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-217de371-8d5e-4a49-b37c-57a0774630c6 req-ad7dffba-13aa-4531-816e-3520a2cfd1dd service nova] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-217de371-8d5e-4a49-b37c-57a0774630c6 req-ad7dffba-13aa-4531-816e-3520a2cfd1dd service nova] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.compute.manager [req-217de371-8d5e-4a49-b37c-57a0774630c6 req-ad7dffba-13aa-4531-816e-3520a2cfd1dd service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] No waiting events found dispatching network-vif-plugged-6eec761c-f898-4839-ad70-aa9d7ac1a525 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:53:53 user nova-compute[73258]: WARNING nova.compute.manager [req-217de371-8d5e-4a49-b37c-57a0774630c6 req-ad7dffba-13aa-4531-816e-3520a2cfd1dd service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Received unexpected event network-vif-plugged-6eec761c-f898-4839-ad70-aa9d7ac1a525 for instance with vm_state building and task_state spawning.
Aug 27 06:53:53 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:53:53 user nova-compute[73258]: INFO nova.compute.manager [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Took 5.88 seconds to spawn the instance on the hypervisor.
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:53:53 user nova-compute[73258]: INFO nova.compute.manager [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Took 6.90 seconds to build instance.
Aug 27 06:53:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78a54bb2-a2c3-4cc3-814f-72eda48c1495 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.004s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.602s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbFOBqYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23461356434343463', 'path': '/dev/sdd'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461356434343463', 'path': '/dev/sdd'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1310771159',display_name='tempest-TestShelveInstance-server-1310771159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1310771159',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuaT2R5PPsAjc4NYciVpWptrbTp6s6w2hKpiAve1cx+pMVmkK9XU7VZvJEmmRfJw5taHvUwTh9xmdg2Dr/ClFtvIClQmBmDLE/7t8SdzixfG5H7Wm1+fm9Ad5ILDjSUXg==',key_name='tempest-TestShelveInstance-1450465266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14d7b80576d482a9b88ac09acdd2a55',ramdisk_id='',reservation_id='r-hyw6wngo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1338223853',owner_user_name='tempest-TestShelveInstance-1338223853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:53:38Z,user_data=None,user_id='a31d853a46bd447e9bc757694d6cbf5a',uuid=0c16951e-8620-493f-8af4-fbdc64e1c131,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Converting VIF {"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=1e7db346-1c0e-4a29-a6e9-053cd736b399,network=Network(43c6935e-b9dd-46c2-a9b1-619444517b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7db346-1c') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.objects.instance [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c16951e-8620-493f-8af4-fbdc64e1c131 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:53:53 user nova-compute[73258]:   <uuid>0c16951e-8620-493f-8af4-fbdc64e1c131</uuid>
Aug 27 06:53:53 user nova-compute[73258]:   <name>instance-00000025</name>
Aug 27 06:53:53 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:53:53 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:53:53 user nova-compute[73258]:   <metadata>
Aug 27 06:53:53 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:53:53 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:53:53 user nova-compute[73258]:       <nova:name>tempest-TestShelveInstance-server-1310771159</nova:name>
Aug 27 06:53:53 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:53:52</nova:creationTime>
Aug 27 06:53:53 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:53:53 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:53:53 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:53:53 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:53:53 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:53:53 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:53:53 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:53:53 user nova-compute[73258]:       <nova:owner>
Aug 27 06:53:53 user nova-compute[73258]:         <nova:user uuid="a31d853a46bd447e9bc757694d6cbf5a">tempest-TestShelveInstance-1338223853-project-member</nova:user>
Aug 27 06:53:53 user nova-compute[73258]:         <nova:project uuid="c14d7b80576d482a9b88ac09acdd2a55">tempest-TestShelveInstance-1338223853</nova:project>
Aug 27 06:53:53 user nova-compute[73258]:       </nova:owner>
Aug 27 06:53:53 user nova-compute[73258]:       <nova:ports>
Aug 27 06:53:53 user nova-compute[73258]:         <nova:port uuid="1e7db346-1c0e-4a29-a6e9-053cd736b399">
Aug 27 06:53:53 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 06:53:53 user nova-compute[73258]:         </nova:port>
Aug 27 06:53:53 user nova-compute[73258]:       </nova:ports>
Aug 27 06:53:53 user nova-compute[73258]:     </nova:instance>
Aug 27 06:53:53 user nova-compute[73258]:   </metadata>
Aug 27 06:53:53 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:53:53 user nova-compute[73258]:     <system>
Aug 27 06:53:53 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:53:53 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:53:53 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:53:53 user nova-compute[73258]:       <entry name="serial">0c16951e-8620-493f-8af4-fbdc64e1c131</entry>
Aug 27 06:53:53 user nova-compute[73258]:       <entry name="uuid">0c16951e-8620-493f-8af4-fbdc64e1c131</entry>
Aug 27 06:53:53 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:53:53 user nova-compute[73258]:     </system>
Aug 27 06:53:53 user nova-compute[73258]:   </sysinfo>
Aug 27 06:53:53 user nova-compute[73258]:   <os>
Aug 27 06:53:53 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:53:53 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:53:53 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:53:53 user nova-compute[73258]:   </os>
Aug 27 06:53:53 user nova-compute[73258]:   <features>
Aug 27 06:53:53 user nova-compute[73258]:     <acpi/>
Aug 27 06:53:53 user nova-compute[73258]:     <apic/>
Aug 27 06:53:53 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:53:53 user nova-compute[73258]:   </features>
Aug 27 06:53:53 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:53:53 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:53:53 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:53:53 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:53:53 user nova-compute[73258]:   </clock>
Aug 27 06:53:53 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:53:53 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:53:53 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:53:53 user nova-compute[73258]:   </cpu>
Aug 27 06:53:53 user nova-compute[73258]:   <devices>
Aug 27 06:53:53 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:53:53 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:53:53 user nova-compute[73258]:       <source dev="/dev/sdd"/>
Aug 27 06:53:53 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:53:53 user nova-compute[73258]:       <serial>7ad57bda-1e6b-42da-b681-1a8d6a4baa16</serial>
Aug 27 06:53:53 user nova-compute[73258]:     </disk>
Aug 27 06:53:53 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:53:53 user nova-compute[73258]:       <mac address="fa:16:3e:cc:56:5a"/>
Aug 27 06:53:53 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:53:53 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:53:53 user nova-compute[73258]:       <target dev="tap1e7db346-1c"/>
Aug 27 06:53:53 user nova-compute[73258]:     </interface>
Aug 27 06:53:53 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:53:53 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/0c16951e-8620-493f-8af4-fbdc64e1c131/console.log" append="off"/>
Aug 27 06:53:53 user nova-compute[73258]:     </serial>
Aug 27 06:53:53 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:53:53 user nova-compute[73258]:     <video>
Aug 27 06:53:53 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:53:53 user nova-compute[73258]:     </video>
Aug 27 06:53:53 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:53:53 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:53:53 user nova-compute[73258]:     </rng>
Aug 27 06:53:53 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:53:53 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:53:53 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:53:53 user nova-compute[73258]:     </memballoon>
Aug 27 06:53:53 user nova-compute[73258]:   </devices>
Aug 27 06:53:53 user nova-compute[73258]: </domain>
Aug 27 06:53:53 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1310771159',display_name='tempest-TestShelveInstance-server-1310771159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1310771159',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuaT2R5PPsAjc4NYciVpWptrbTp6s6w2hKpiAve1cx+pMVmkK9XU7VZvJEmmRfJw5taHvUwTh9xmdg2Dr/ClFtvIClQmBmDLE/7t8SdzixfG5H7Wm1+fm9Ad5ILDjSUXg==',key_name='tempest-TestShelveInstance-1450465266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14d7b80576d482a9b88ac09acdd2a55',ramdisk_id='',reservation_id='r-hyw6wngo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1338223853',owner_user_name='tempest-TestShelveInstance-1338223853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:53:38Z,user_data=None,user_id='a31d853a46bd447e9bc757694d6cbf5a',uuid=0c16951e-8620-493f-8af4-fbdc64e1c131,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Converting VIF {"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=1e7db346-1c0e-4a29-a6e9-053cd736b399,network=Network(43c6935e-b9dd-46c2-a9b1-619444517b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7db346-1c') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG os_vif [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=1e7db346-1c0e-4a29-a6e9-053cd736b399,network=Network(43c6935e-b9dd-46c2-a9b1-619444517b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7db346-1c') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e7db346-1c, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e7db346-1c, col_values=(('external_ids', {'iface-id': '1e7db346-1c0e-4a29-a6e9-053cd736b399', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:56:5a', 'vm-uuid': '0c16951e-8620-493f-8af4-fbdc64e1c131'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:53 user nova-compute[73258]: INFO os_vif [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=1e7db346-1c0e-4a29-a6e9-053cd736b399,network=Network(43c6935e-b9dd-46c2-a9b1-619444517b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7db346-1c')
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:53:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] No VIF found with MAC fa:16:3e:cc:56:5a, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:53:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:54 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:53:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:54 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:53:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:55 user nova-compute[73258]: DEBUG nova.compute.manager [req-1fe09cfe-b1e3-4ea9-9f4b-7b1e07b6a475 req-e75a65c2-a646-4901-bdd2-db8865174aaa service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received event network-vif-plugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:53:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1fe09cfe-b1e3-4ea9-9f4b-7b1e07b6a475 req-e75a65c2-a646-4901-bdd2-db8865174aaa service nova] Acquiring lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1fe09cfe-b1e3-4ea9-9f4b-7b1e07b6a475 req-e75a65c2-a646-4901-bdd2-db8865174aaa service nova] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1fe09cfe-b1e3-4ea9-9f4b-7b1e07b6a475 req-e75a65c2-a646-4901-bdd2-db8865174aaa service nova] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:55 user nova-compute[73258]: DEBUG nova.compute.manager [req-1fe09cfe-b1e3-4ea9-9f4b-7b1e07b6a475 req-e75a65c2-a646-4901-bdd2-db8865174aaa service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] No waiting events found dispatching network-vif-plugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:53:55 user nova-compute[73258]: WARNING nova.compute.manager [req-1fe09cfe-b1e3-4ea9-9f4b-7b1e07b6a475 req-e75a65c2-a646-4901-bdd2-db8865174aaa service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received unexpected event network-vif-plugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 for instance with vm_state building and task_state spawning.
Aug 27 06:53:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:53:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119237.615957, 0c16951e-8620-493f-8af4-fbdc64e1c131 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:53:57 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] VM Resumed (Lifecycle Event)
Aug 27 06:53:57 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Instance spawned successfully.
Aug 27 06:53:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:53:57 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:53:57 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119237.6258726, 0c16951e-8620-493f-8af4-fbdc64e1c131 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:53:57 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] VM Started (Lifecycle Event)
Aug 27 06:53:57 user nova-compute[73258]: DEBUG nova.compute.manager [req-aef74e3f-aebe-4096-bf3e-6e451d00d945 req-bacf67ce-826d-4768-a794-211edd468bf0 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received event network-vif-plugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-aef74e3f-aebe-4096-bf3e-6e451d00d945 req-bacf67ce-826d-4768-a794-211edd468bf0 service nova] Acquiring lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-aef74e3f-aebe-4096-bf3e-6e451d00d945 req-bacf67ce-826d-4768-a794-211edd468bf0 service nova] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-aef74e3f-aebe-4096-bf3e-6e451d00d945 req-bacf67ce-826d-4768-a794-211edd468bf0 service nova] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG nova.compute.manager [req-aef74e3f-aebe-4096-bf3e-6e451d00d945 req-bacf67ce-826d-4768-a794-211edd468bf0 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] No waiting events found dispatching network-vif-plugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:53:57 user nova-compute[73258]: WARNING nova.compute.manager [req-aef74e3f-aebe-4096-bf3e-6e451d00d945 req-bacf67ce-826d-4768-a794-211edd468bf0 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received unexpected event network-vif-plugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 for instance with vm_state building and task_state spawning.
Aug 27 06:53:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:53:57 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:53:57 user nova-compute[73258]: INFO nova.compute.manager [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Took 5.43 seconds to spawn the instance on the hypervisor.
Aug 27 06:53:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:57 user nova-compute[73258]: INFO nova.compute.manager [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Took 20.51 seconds to build instance.
Aug 27 06:53:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-faf83dab-2463-46be-a6eb-39230e6d607d tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.618s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.816s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:53:57 user nova-compute[73258]: INFO nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 27 06:53:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:53:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:53:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:53:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:58 user nova-compute[73258]: DEBUG nova.network.neutron [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Port c8024bd0-329f-4c9e-8974-4881fc97ada9 binding to destination host user is already ACTIVE {{(pid=73258) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 27 06:53:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:53:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquired lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:53:58 user nova-compute[73258]: DEBUG nova.network.neutron [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:53:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.256s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG nova.network.neutron [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Updating instance_info_cache with network_info: [{"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Releasing lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Creating tmpfile /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/tmpsvvucul_ to verify with other compute node that the instance is on the same shared storage. {{(pid=73258) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG os_brick.utils [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8e9b0b-0a35-48cb-a285-fcfc04961dab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[996fc2f8-c449-4663-93cd-7e86d423113f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e59b40-6c41-4047-92b5-ebec5c6cdfa9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[723587f4-8226-4d62-9a25-afa430854b85]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:53:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.331s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:54:00 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ccca3d-52ca-4bf4-bcfe-bd80930062b8]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG os_brick.utils [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] <== get_connector_properties: return (250ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Updating existing volume attachment record: 9d01d1c7-a30b-4e14-b4fb-5f56b5caa030 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG nova.compute.manager [req-869da728-f258-4a41-a3aa-a232abfb554f req-59c509f5-43dc-427d-b777-aa8485f75a20 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received event network-vif-unplugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-869da728-f258-4a41-a3aa-a232abfb554f req-59c509f5-43dc-427d-b777-aa8485f75a20 service nova] Acquiring lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-869da728-f258-4a41-a3aa-a232abfb554f req-59c509f5-43dc-427d-b777-aa8485f75a20 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-869da728-f258-4a41-a3aa-a232abfb554f req-59c509f5-43dc-427d-b777-aa8485f75a20 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG nova.compute.manager [req-869da728-f258-4a41-a3aa-a232abfb554f req-59c509f5-43dc-427d-b777-aa8485f75a20 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] No waiting events found dispatching network-vif-unplugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:54:00 user nova-compute[73258]: WARNING nova.compute.manager [req-869da728-f258-4a41-a3aa-a232abfb554f req-59c509f5-43dc-427d-b777-aa8485f75a20 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received unexpected event network-vif-unplugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 for instance with vm_state resized and task_state resize_reverting.
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:00 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Instance destroyed successfully.
Aug 27 06:54:00 user nova-compute[73258]: DEBUG nova.objects.instance [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lazy-loading 'resources' on Instance uuid bc3cebb3-0e29-4899-94aa-d13a2a9ca86a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1707767622',display_name='tempest-ServerActionsTestOtherB-server-1707767622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1707767622',id=28,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCup9tVy/ES6sbgueL/45Bba8K9LkjKsB0AzSdwXqHLd/SJJd00ZmJLNSvj/I/yfKqYtF7c1wkGM0pTAca7U7ASXDTxzPj0yMtlZAbKBP15oOn8TvN1fkhhoEIFexZqUw==',key_name='tempest-keypair-903561007',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:52:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf1d43b7929c4f60a9948f0d9ed35fce',ramdisk_id='',reservation_id='r-rpya4ij3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-895910456',owner_user_name='tempest-ServerActionsTestOtherB-895910456-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:52:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ec7b0ff818840ab9d77576254aaf89e',uuid=bc3cebb3-0e29-4899-94aa-d13a2a9ca86a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Converting VIF {"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG os_vif [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8024bd0-32, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:54:00 user nova-compute[73258]: INFO os_vif [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32')
Aug 27 06:54:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olbJMszc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:54:00 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:54:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7268759d-aaa0-4d85-9c95-e70f9b93b4af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a498f6-324e-43b6-8941-f7fc47e1c387]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:54:00 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:54:00 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:54:00 user nova-compute[73258]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:54:00 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:54:00 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:54:00 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:54:00 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:54:00 user nova-compute[73258]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:54:00 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:54:00 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa410526ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd'): ({'sdg'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Removing single pathed devices sdg {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a220a7-7966-49be-909c-a8ff750cf6ea]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7299534a-59c6-4b2b-84f8-845a22ef4bb0]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Flushing IO for device /dev/sdg {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.044s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[41431831-bb85-43f8-95c1-2b62a9b77b5b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b8ca66-5b2b-4d70-9d24-1be704150c11]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] SCSI volumes sdg have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[20139919-b8fc-45e9-a45e-235a68ac07eb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d82aefa-11d8-4d6a-888a-6af835c17ff9]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260]
Aug 27 06:54:01 user nova-compute[73258]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260] successful.
Aug 27 06:54:01 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f50cfd-ed6e-472e-a00f-166a79ece2d7]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.471s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] <== disconnect_volume: return (475ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:01 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:54:01 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=7072MB free_disk=23.738262176513672GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Applying migration context for instance bc3cebb3-0e29-4899-94aa-d13a2a9ca86a as it has an incoming, in-progress migration 7558c8cf-6d73-409d-a4f0-ace10cb843eb. Migration status is reverting {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 06:54:01 user nova-compute[73258]: INFO nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Updating resource usage from migration 7558c8cf-6d73-409d-a4f0-ace10cb843eb
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1672aa9f-be6f-4357-877f-a48f62119df4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a836678e-240d-4ead-b0b5-64d146910a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 7ee743f1-9611-4165-838e-54fccb332f1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance b22b7599-5a37-4370-b440-f04e3dc88f98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance d409b021-ab98-4f9f-a80d-99fe05de7b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance ede6423b-ad91-4002-91d1-5849c6a4e26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Migration 7558c8cf-6d73-409d-a4f0-ace10cb843eb is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bc3cebb3-0e29-4899-94aa-d13a2a9ca86a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 01a9f7b2-805a-4ece-a29c-33ac0057cc9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 0c16951e-8620-493f-8af4-fbdc64e1c131 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a296fb1e-1999-475c-9a15-eeeedfa11247 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:54:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=11264MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:54:02 user nova-compute[73258]: DEBUG nova.compute.manager [req-dd404029-26f3-4872-a612-2da9a881a077 req-20dcace3-3a24-499c-961d-2a618ac116a3 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received event network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:54:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-dd404029-26f3-4872-a612-2da9a881a077 req-20dcace3-3a24-499c-961d-2a618ac116a3 service nova] Acquiring lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:54:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-dd404029-26f3-4872-a612-2da9a881a077 req-20dcace3-3a24-499c-961d-2a618ac116a3 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:54:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-dd404029-26f3-4872-a612-2da9a881a077 req-20dcace3-3a24-499c-961d-2a618ac116a3 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:54:02 user nova-compute[73258]: DEBUG nova.compute.manager [req-dd404029-26f3-4872-a612-2da9a881a077 req-20dcace3-3a24-499c-961d-2a618ac116a3 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] No waiting events found dispatching network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:54:02 user nova-compute[73258]: WARNING nova.compute.manager [req-dd404029-26f3-4872-a612-2da9a881a077 req-20dcace3-3a24-499c-961d-2a618ac116a3 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received unexpected event network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 for instance with vm_state resized and task_state resize_reverting.
Aug 27 06:54:02 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:54:02 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:54:02 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:54:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.752s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:54:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:54:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:54:02 user nova-compute[73258]: DEBUG nova.objects.instance [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lazy-loading 'migration_context' on Instance uuid bc3cebb3-0e29-4899-94aa-d13a2a9ca86a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:54:02 user nova-compute[73258]: DEBUG nova.objects.base [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Object Instance<bc3cebb3-0e29-4899-94aa-d13a2a9ca86a> lazy-loaded attributes: resources,migration_context {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:54:03 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:54:03 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:54:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.615s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:54:03 user nova-compute[73258]: INFO nova.compute.manager [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Swapping old allocation on dict_keys(['13f05024-5078-4590-94a5-110d29d864c8']) held by migration 7558c8cf-6d73-409d-a4f0-ace10cb843eb for instance
Aug 27 06:54:03 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Overwriting current allocation {'allocations': {'13f05024-5078-4590-94a5-110d29d864c8': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 48}}, 'project_id': 'cf1d43b7929c4f60a9948f0d9ed35fce', 'user_id': '6ec7b0ff818840ab9d77576254aaf89e', 'consumer_generation': 1} on consumer bc3cebb3-0e29-4899-94aa-d13a2a9ca86a {{(pid=73258) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 27 06:54:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:54:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquired lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:54:03 user nova-compute[73258]: DEBUG nova.network.neutron [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG nova.network.neutron [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Updating instance_info_cache with network_info: [{"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Releasing lock "refresh_cache-bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG os_brick.utils [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f56d5e0-b215-4e61-8634-b3f7c4086279]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d3d68f-fb69-4ae8-90b4-6e70dc7d478b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f95cf24-f729-4107-ba05-47bbc0491d41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a75222-eaf3-4fc2-a820-5ea172a7587d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:54:04 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:54:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b861218-9321-413f-a746-8ef91288e825]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:54:04 user nova-compute[73258]: DEBUG os_brick.utils [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:54:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.compute.manager [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:54:15 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Creating image(s)
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Did not create local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Ensure instance console log exists: /opt/stack/data/nova/instances/a296fb1e-1999-475c-9a15-eeeedfa11247/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Start _get_guest_xml network_info=[{"id": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "address": "fa:16:3e:dd:b3:4a", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8b8c03-b3", "ovs_interfaceid": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvqxKAsl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a296fb1e-1999-475c-9a15-eeeedfa11247', 'attached_at': '', 'detached_at': '', 'volume_id': '72986f09-60ad-4b9d-b257-813afd12e5d8', 'serial': '72986f09-60ad-4b9d-b257-813afd12e5d8'}, 'attachment_id': '9d01d1c7-a30b-4e14-b4fb-5f56b5caa030', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:54:15 user nova-compute[73258]: INFO nova.compute.manager [None req-405dbe8b-ab0b-44ca-89cd-da4d28e64314 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Get console output
Aug 27 06:54:15 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:54:15 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvqxKAsl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:54:15 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:54:15 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.318s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:54:15 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:15 user nova-compute[73258]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[520538ff-98c3-40d1-8dc3-2100f0054890]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:54:15 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119240.629011, bc3cebb3-0e29-4899-94aa-d13a2a9ca86a => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:54:15 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] VM Stopped (Lifecycle Event)
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[404a1a76-3f2f-4e10-b85c-e8d0a3bf3890]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8] added
Aug 27 06:54:15 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG nova.compute.manager [None req-c618bd3a-36a6-4161-8018-555df855a939 None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6624fa91-facf-4dcd-919a-91888b2e3cac]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[99413cf1-3d80-4f6e-8f05-d4e8881a8b96]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GvqxKAsl {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GvqxKAsl" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d8f1dc-4a0a-4c63-9dcd-3f8176794c69]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GvqxKAsl'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5349832b-eac9-42ac-aa75-6ddc4de0b962]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae0a751-8bdc-42a2-95b6-f91e458369c6]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:54:15 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:54:15 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:54:15 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:54:15 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:54:15 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:54:15 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:54:15 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:54:15 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f499e300-ebfc-4fa5-bf28-a61fdd1c9285]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8, portal: 172.16.0.220,3260]
Aug 27 06:54:15 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8, portal: 172.16.0.220,3260] successful.
Aug 27 06:54:15 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4038699-3774-4615-b21a-d1391952a588]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[01039499-66d7-4b8a-9558-02c4ffbd8fc8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:54:15 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:54:15 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:54:15 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:54:15 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:54:15 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:54:15 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:54:15 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:54:15 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:54:15 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:54:15 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d258ab7-4e2c-4a0c-bc74-bf337478c2c1]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:54:15 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvqxKAsl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:54:16 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.722s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:54:16 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] <== connect_volume: return (1724ms) {'type': 'block', 'scsi_wwn': '26165643738333831', 'path': '/dev/sdf'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:54:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165643738333831', 'path': '/dev/sdf'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:54:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1066864047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1066864047',id=38,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81cf34590d8d4b8b89b9626c6e150df6',ramdisk_id='',reservation_id='r-psnz6f1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:53:44Z,user_data=None,user_id='36c0faed29a446aa9fa6ff8692581aba',uuid=a296fb1e-1999-475c-9a15-eeeedfa11247,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "address": "fa:16:3e:dd:b3:4a", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8b8c03-b3", "ovs_interfaceid": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:54:17 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converting VIF {"id": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "address": "fa:16:3e:dd:b3:4a", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8b8c03-b3", "ovs_interfaceid": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:54:17 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b3:4a,bridge_name='br-int',has_traffic_filtering=True,id=ae8b8c03-b302-4043-ac07-b3561b7bf6f3,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8b8c03-b3') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:54:17 user nova-compute[73258]: DEBUG nova.objects.instance [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'pci_devices' on Instance uuid a296fb1e-1999-475c-9a15-eeeedfa11247 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:54:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:54:17 user nova-compute[73258]:   <uuid>a296fb1e-1999-475c-9a15-eeeedfa11247</uuid>
Aug 27 06:54:17 user nova-compute[73258]:   <name>instance-00000026</name>
Aug 27 06:54:17 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:54:17 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:54:17 user nova-compute[73258]:   <metadata>
Aug 27 06:54:17 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:54:17 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:54:17 user nova-compute[73258]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1066864047</nova:name>
Aug 27 06:54:17 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:54:15</nova:creationTime>
Aug 27 06:54:17 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:54:17 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:54:17 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:54:17 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:54:17 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:54:17 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:54:17 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:54:17 user nova-compute[73258]:       <nova:owner>
Aug 27 06:54:17 user nova-compute[73258]:         <nova:user uuid="36c0faed29a446aa9fa6ff8692581aba">tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member</nova:user>
Aug 27 06:54:17 user nova-compute[73258]:         <nova:project uuid="81cf34590d8d4b8b89b9626c6e150df6">tempest-ServerBootFromVolumeStableRescueTest-1306655557</nova:project>
Aug 27 06:54:17 user nova-compute[73258]:       </nova:owner>
Aug 27 06:54:17 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:54:17 user nova-compute[73258]:       <nova:ports>
Aug 27 06:54:17 user nova-compute[73258]:         <nova:port uuid="ae8b8c03-b302-4043-ac07-b3561b7bf6f3">
Aug 27 06:54:17 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 06:54:17 user nova-compute[73258]:         </nova:port>
Aug 27 06:54:17 user nova-compute[73258]:       </nova:ports>
Aug 27 06:54:17 user nova-compute[73258]:     </nova:instance>
Aug 27 06:54:17 user nova-compute[73258]:   </metadata>
Aug 27 06:54:17 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:54:17 user nova-compute[73258]:     <system>
Aug 27 06:54:17 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:54:17 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:54:17 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:54:17 user nova-compute[73258]:       <entry name="serial">a296fb1e-1999-475c-9a15-eeeedfa11247</entry>
Aug 27 06:54:17 user nova-compute[73258]:       <entry name="uuid">a296fb1e-1999-475c-9a15-eeeedfa11247</entry>
Aug 27 06:54:17 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:54:17 user nova-compute[73258]:     </system>
Aug 27 06:54:17 user nova-compute[73258]:   </sysinfo>
Aug 27 06:54:17 user nova-compute[73258]:   <os>
Aug 27 06:54:17 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:54:17 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:54:17 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:54:17 user nova-compute[73258]:   </os>
Aug 27 06:54:17 user nova-compute[73258]:   <features>
Aug 27 06:54:17 user nova-compute[73258]:     <acpi/>
Aug 27 06:54:17 user nova-compute[73258]:     <apic/>
Aug 27 06:54:17 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:54:17 user nova-compute[73258]:   </features>
Aug 27 06:54:17 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:54:17 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:54:17 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:54:17 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:54:17 user nova-compute[73258]:   </clock>
Aug 27 06:54:17 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:54:17 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:54:17 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:54:17 user nova-compute[73258]:   </cpu>
Aug 27 06:54:17 user nova-compute[73258]:   <devices>
Aug 27 06:54:17 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:54:17 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:54:17 user nova-compute[73258]:       <source dev="/dev/sdf"/>
Aug 27 06:54:17 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:54:17 user nova-compute[73258]:       <serial>72986f09-60ad-4b9d-b257-813afd12e5d8</serial>
Aug 27 06:54:17 user nova-compute[73258]:     </disk>
Aug 27 06:54:17 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:54:17 user nova-compute[73258]:       <mac address="fa:16:3e:dd:b3:4a"/>
Aug 27 06:54:17 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:54:17 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:54:17 user nova-compute[73258]:       <target dev="tapae8b8c03-b3"/>
Aug 27 06:54:17 user nova-compute[73258]:     </interface>
Aug 27 06:54:17 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:54:17 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/a296fb1e-1999-475c-9a15-eeeedfa11247/console.log" append="off"/>
Aug 27 06:54:17 user nova-compute[73258]:     </serial>
Aug 27 06:54:17 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:54:17 user nova-compute[73258]:     <video>
Aug 27 06:54:17 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:54:17 user nova-compute[73258]:     </video>
Aug 27 06:54:17 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:54:17 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:54:17 user nova-compute[73258]:     </rng>
Aug 27 06:54:17 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:54:17 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:54:17 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:54:17 user nova-compute[73258]:     </memballoon>
Aug 27 06:54:17 user nova-compute[73258]:   </devices>
Aug 27 06:54:17 user nova-compute[73258]: </domain>
Aug 27 06:54:17 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:54:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1066864047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1066864047',id=38,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81cf34590d8d4b8b89b9626c6e150df6',ramdisk_id='',reservation_id='r-psnz6f1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:53:44Z,user_data=None,user_id='36c0faed29a446aa9fa6ff8692581aba',uuid=a296fb1e-1999-475c-9a15-eeeedfa11247,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "address": "fa:16:3e:dd:b3:4a", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8b8c03-b3", "ovs_interfaceid": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:54:17 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converting VIF {"id": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "address": "fa:16:3e:dd:b3:4a", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8b8c03-b3", "ovs_interfaceid": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:54:17 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b3:4a,bridge_name='br-int',has_traffic_filtering=True,id=ae8b8c03-b302-4043-ac07-b3561b7bf6f3,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8b8c03-b3') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:54:17 user nova-compute[73258]: DEBUG os_vif [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b3:4a,bridge_name='br-int',has_traffic_filtering=True,id=ae8b8c03-b302-4043-ac07-b3561b7bf6f3,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8b8c03-b3') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:54:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:54:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:54:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae8b8c03-b3, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:54:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae8b8c03-b3, col_values=(('external_ids', {'iface-id': 'ae8b8c03-b302-4043-ac07-b3561b7bf6f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:b3:4a', 'vm-uuid': 'a296fb1e-1999-475c-9a15-eeeedfa11247'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:54:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:54:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:17 user nova-compute[73258]: INFO os_vif [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b3:4a,bridge_name='br-int',has_traffic_filtering=True,id=ae8b8c03-b302-4043-ac07-b3561b7bf6f3,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8b8c03-b3')
Aug 27 06:54:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:54:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] No VIF found with MAC fa:16:3e:dd:b3:4a, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:54:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-722c7bc8-58c9-405a-a4ad-f5fa783b5c89 req-a135680d-9514-4963-8661-4c4ecb63be21 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received event network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:54:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-722c7bc8-58c9-405a-a4ad-f5fa783b5c89 req-a135680d-9514-4963-8661-4c4ecb63be21 service nova] Acquiring lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:54:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-722c7bc8-58c9-405a-a4ad-f5fa783b5c89 req-a135680d-9514-4963-8661-4c4ecb63be21 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:54:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-722c7bc8-58c9-405a-a4ad-f5fa783b5c89 req-a135680d-9514-4963-8661-4c4ecb63be21 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:54:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-722c7bc8-58c9-405a-a4ad-f5fa783b5c89 req-a135680d-9514-4963-8661-4c4ecb63be21 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] No waiting events found dispatching network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:54:18 user nova-compute[73258]: WARNING nova.compute.manager [req-722c7bc8-58c9-405a-a4ad-f5fa783b5c89 req-a135680d-9514-4963-8661-4c4ecb63be21 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received unexpected event network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 for instance with vm_state building and task_state spawning.
Aug 27 06:54:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Starting finish_revert_migration {{(pid=73258) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Start _get_guest_xml network_info=[{"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olbJMszc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'bc3cebb3-0e29-4899-94aa-d13a2a9ca86a', 'attached_at': '2023-08-27T06:54:19.000000', 'detached_at': '', 'volume_id': 'e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd', 'serial': 'e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd'}, 'attachment_id': '0ed5b898-fb5e-47d3-9668-7abf21eb29f5', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:54:19 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:54:19 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.objects.instance [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lazy-loading 'vcpu_model' on Instance uuid bc3cebb3-0e29-4899-94aa-d13a2a9ca86a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olbJMszc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:54:19 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:54:19 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:54:19 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f39345e-3802-402a-b1bf-bc4798e91569]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:54:19 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4c53eb-037a-46d5-baf3-eaa5583c98c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd] added
Aug 27 06:54:19 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b9d9b7-b863-4ba6-a84b-a7be6846d355]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bf3fe7-c7bd-4717-85b7-20daf79f6522]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v olbJMszc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v olbJMszc" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[972efe34-2e81-4942-8c3e-6fd3e9c06581]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'olbJMszc'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2762a3-6a0d-48f8-a3a7-868f4b464aa5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[743437e0-255c-48e7-951c-9c1dda8a8eb1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --login" returned: 0 in 0.175s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[735649a9-25ad-44ed-a8d0-b37eec2d0264]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260]
Aug 27 06:54:19 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260] successful.
Aug 27 06:54:19 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bb06cc-fd8d-4215-8420-0353fa2953ff]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7d5670-bdb2-4807-981e-a4aeb6f36fd9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:54:19 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:54:19 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:54:19 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.437s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] HCTL ('38', '-', '-', 0) found on session 39 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43816cc-35b0-448b-a779-4ec7c9351b15]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Searching for a device in session 39 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:54:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olbJMszc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.478s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] <== connect_volume: return (1480ms) {'type': 'block', 'scsi_wwn': '23866313138333131', 'path': '/dev/sdg'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866313138333131', 'path': '/dev/sdg'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1707767622',display_name='tempest-ServerActionsTestOtherB-server-1707767622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1707767622',id=28,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCup9tVy/ES6sbgueL/45Bba8K9LkjKsB0AzSdwXqHLd/SJJd00ZmJLNSvj/I/yfKqYtF7c1wkGM0pTAca7U7ASXDTxzPj0yMtlZAbKBP15oOn8TvN1fkhhoEIFexZqUw==',key_name='tempest-keypair-903561007',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:52:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cf1d43b7929c4f60a9948f0d9ed35fce',ramdisk_id='',reservation_id='r-rpya4ij3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-895910456',owner_user_name='tempest-ServerActionsTestOtherB-895910456-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:53:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ec7b0ff818840ab9d77576254aaf89e',uuid=bc3cebb3-0e29-4899-94aa-d13a2a9ca86a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Converting VIF {"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:54:20 user nova-compute[73258]:   <uuid>bc3cebb3-0e29-4899-94aa-d13a2a9ca86a</uuid>
Aug 27 06:54:20 user nova-compute[73258]:   <name>instance-0000001c</name>
Aug 27 06:54:20 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:54:20 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:54:20 user nova-compute[73258]:   <metadata>
Aug 27 06:54:20 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:54:20 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:54:20 user nova-compute[73258]:       <nova:name>tempest-ServerActionsTestOtherB-server-1707767622</nova:name>
Aug 27 06:54:20 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:54:19</nova:creationTime>
Aug 27 06:54:20 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:54:20 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:54:20 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:54:20 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:54:20 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:54:20 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:54:20 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:54:20 user nova-compute[73258]:       <nova:owner>
Aug 27 06:54:20 user nova-compute[73258]:         <nova:user uuid="6ec7b0ff818840ab9d77576254aaf89e">tempest-ServerActionsTestOtherB-895910456-project-member</nova:user>
Aug 27 06:54:20 user nova-compute[73258]:         <nova:project uuid="cf1d43b7929c4f60a9948f0d9ed35fce">tempest-ServerActionsTestOtherB-895910456</nova:project>
Aug 27 06:54:20 user nova-compute[73258]:       </nova:owner>
Aug 27 06:54:20 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:54:20 user nova-compute[73258]:       <nova:ports>
Aug 27 06:54:20 user nova-compute[73258]:         <nova:port uuid="c8024bd0-329f-4c9e-8974-4881fc97ada9">
Aug 27 06:54:20 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 06:54:20 user nova-compute[73258]:         </nova:port>
Aug 27 06:54:20 user nova-compute[73258]:       </nova:ports>
Aug 27 06:54:20 user nova-compute[73258]:     </nova:instance>
Aug 27 06:54:20 user nova-compute[73258]:   </metadata>
Aug 27 06:54:20 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:54:20 user nova-compute[73258]:     <system>
Aug 27 06:54:20 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:54:20 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:54:20 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:54:20 user nova-compute[73258]:       <entry name="serial">bc3cebb3-0e29-4899-94aa-d13a2a9ca86a</entry>
Aug 27 06:54:20 user nova-compute[73258]:       <entry name="uuid">bc3cebb3-0e29-4899-94aa-d13a2a9ca86a</entry>
Aug 27 06:54:20 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:54:20 user nova-compute[73258]:     </system>
Aug 27 06:54:20 user nova-compute[73258]:   </sysinfo>
Aug 27 06:54:20 user nova-compute[73258]:   <os>
Aug 27 06:54:20 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:54:20 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:54:20 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:54:20 user nova-compute[73258]:   </os>
Aug 27 06:54:20 user nova-compute[73258]:   <features>
Aug 27 06:54:20 user nova-compute[73258]:     <acpi/>
Aug 27 06:54:20 user nova-compute[73258]:     <apic/>
Aug 27 06:54:20 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:54:20 user nova-compute[73258]:   </features>
Aug 27 06:54:20 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:54:20 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:54:20 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:54:20 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:54:20 user nova-compute[73258]:   </clock>
Aug 27 06:54:20 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:54:20 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:54:20 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:54:20 user nova-compute[73258]:   </cpu>
Aug 27 06:54:20 user nova-compute[73258]:   <devices>
Aug 27 06:54:20 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:54:20 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:54:20 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk"/>
Aug 27 06:54:20 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:54:20 user nova-compute[73258]:     </disk>
Aug 27 06:54:20 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:54:20 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:54:20 user nova-compute[73258]:       <source dev="/dev/sdg"/>
Aug 27 06:54:20 user nova-compute[73258]:       <target dev="vdb" bus="virtio"/>
Aug 27 06:54:20 user nova-compute[73258]:       <serial>e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd</serial>
Aug 27 06:54:20 user nova-compute[73258]:     </disk>
Aug 27 06:54:20 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:54:20 user nova-compute[73258]:       <mac address="fa:16:3e:6d:e9:55"/>
Aug 27 06:54:20 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:54:20 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:54:20 user nova-compute[73258]:       <target dev="tapc8024bd0-32"/>
Aug 27 06:54:20 user nova-compute[73258]:     </interface>
Aug 27 06:54:20 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:54:20 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/console.log" append="off"/>
Aug 27 06:54:20 user nova-compute[73258]:     </serial>
Aug 27 06:54:20 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:54:20 user nova-compute[73258]:     <video>
Aug 27 06:54:20 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:54:20 user nova-compute[73258]:     </video>
Aug 27 06:54:20 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:54:20 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:54:20 user nova-compute[73258]:     </rng>
Aug 27 06:54:20 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:54:20 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:54:20 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:54:20 user nova-compute[73258]:     </memballoon>
Aug 27 06:54:20 user nova-compute[73258]:   </devices>
Aug 27 06:54:20 user nova-compute[73258]: </domain>
Aug 27 06:54:20 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1707767622',display_name='tempest-ServerActionsTestOtherB-server-1707767622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1707767622',id=28,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCup9tVy/ES6sbgueL/45Bba8K9LkjKsB0AzSdwXqHLd/SJJd00ZmJLNSvj/I/yfKqYtF7c1wkGM0pTAca7U7ASXDTxzPj0yMtlZAbKBP15oOn8TvN1fkhhoEIFexZqUw==',key_name='tempest-keypair-903561007',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:52:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cf1d43b7929c4f60a9948f0d9ed35fce',ramdisk_id='',reservation_id='r-rpya4ij3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-895910456',owner_user_name='tempest-ServerActionsTestOtherB-895910456-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:53:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ec7b0ff818840ab9d77576254aaf89e',uuid=bc3cebb3-0e29-4899-94aa-d13a2a9ca86a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Converting VIF {"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG os_vif [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8024bd0-32, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8024bd0-32, col_values=(('external_ids', {'iface-id': 'c8024bd0-329f-4c9e-8974-4881fc97ada9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:e9:55', 'vm-uuid': 'bc3cebb3-0e29-4899-94aa-d13a2a9ca86a'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:20 user nova-compute[73258]: INFO os_vif [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32')
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-27479044-1bcd-4b13-8dfa-406bdf6af589 req-9b21ae17-424d-465b-b38a-1ca7c0de5603 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received event network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-27479044-1bcd-4b13-8dfa-406bdf6af589 req-9b21ae17-424d-465b-b38a-1ca7c0de5603 service nova] Acquiring lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-27479044-1bcd-4b13-8dfa-406bdf6af589 req-9b21ae17-424d-465b-b38a-1ca7c0de5603 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-27479044-1bcd-4b13-8dfa-406bdf6af589 req-9b21ae17-424d-465b-b38a-1ca7c0de5603 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-27479044-1bcd-4b13-8dfa-406bdf6af589 req-9b21ae17-424d-465b-b38a-1ca7c0de5603 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] No waiting events found dispatching network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:54:20 user nova-compute[73258]: WARNING nova.compute.manager [req-27479044-1bcd-4b13-8dfa-406bdf6af589 req-9b21ae17-424d-465b-b38a-1ca7c0de5603 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received unexpected event network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 for instance with vm_state building and task_state spawning.
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119260.7796493, a296fb1e-1999-475c-9a15-eeeedfa11247 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:54:20 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] VM Resumed (Lifecycle Event)
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:54:20 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Instance spawned successfully.
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:54:20 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119260.7847066, a296fb1e-1999-475c-9a15-eeeedfa11247 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:54:20 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] VM Started (Lifecycle Event)
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:54:20 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:54:20 user nova-compute[73258]: INFO nova.compute.manager [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Took 5.73 seconds to spawn the instance on the hypervisor.
Aug 27 06:54:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:54:21 user nova-compute[73258]: INFO nova.compute.manager [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Took 38.31 seconds to build instance.
Aug 27 06:54:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ac3a61d3-08e6-4c2e-bd2a-6e6020b5c4dc tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.450s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:54:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 33.976s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:54:21 user nova-compute[73258]: INFO nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 27 06:54:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.004s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:54:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:22 user nova-compute[73258]: DEBUG nova.compute.manager [req-aa28cd81-b6a6-438e-816c-eb69890b2f3c req-1546658e-a091-41d8-8795-1b6d35fff2d9 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received event network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:54:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-aa28cd81-b6a6-438e-816c-eb69890b2f3c req-1546658e-a091-41d8-8795-1b6d35fff2d9 service nova] Acquiring lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:54:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-aa28cd81-b6a6-438e-816c-eb69890b2f3c req-1546658e-a091-41d8-8795-1b6d35fff2d9 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:54:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-aa28cd81-b6a6-438e-816c-eb69890b2f3c req-1546658e-a091-41d8-8795-1b6d35fff2d9 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:54:22 user nova-compute[73258]: DEBUG nova.compute.manager [req-aa28cd81-b6a6-438e-816c-eb69890b2f3c req-1546658e-a091-41d8-8795-1b6d35fff2d9 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] No waiting events found dispatching network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:54:22 user nova-compute[73258]: WARNING nova.compute.manager [req-aa28cd81-b6a6-438e-816c-eb69890b2f3c req-1546658e-a091-41d8-8795-1b6d35fff2d9 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received unexpected event network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 for instance with vm_state resized and task_state resize_reverting.
Aug 27 06:54:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:24 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119264.8667457, bc3cebb3-0e29-4899-94aa-d13a2a9ca86a => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:54:24 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] VM Resumed (Lifecycle Event)
Aug 27 06:54:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:54:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-07d9638e-cd14-4a4e-9fb1-53eb76290608 req-6210699f-a224-47c7-a5c6-9bec76e6cc29 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received event network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:54:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-07d9638e-cd14-4a4e-9fb1-53eb76290608 req-6210699f-a224-47c7-a5c6-9bec76e6cc29 service nova] Acquiring lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:54:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-07d9638e-cd14-4a4e-9fb1-53eb76290608 req-6210699f-a224-47c7-a5c6-9bec76e6cc29 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:54:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-07d9638e-cd14-4a4e-9fb1-53eb76290608 req-6210699f-a224-47c7-a5c6-9bec76e6cc29 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:54:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-07d9638e-cd14-4a4e-9fb1-53eb76290608 req-6210699f-a224-47c7-a5c6-9bec76e6cc29 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] No waiting events found dispatching network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:54:24 user nova-compute[73258]: WARNING nova.compute.manager [req-07d9638e-cd14-4a4e-9fb1-53eb76290608 req-6210699f-a224-47c7-a5c6-9bec76e6cc29 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received unexpected event network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 for instance with vm_state resized and task_state resize_reverting.
Aug 27 06:54:24 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Instance running successfully.
Aug 27 06:54:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] finish_revert_migration finished successfully. {{(pid=73258) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 27 06:54:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:54:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:54:24 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 27 06:54:24 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119264.8694234, bc3cebb3-0e29-4899-94aa-d13a2a9ca86a => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:54:24 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] VM Started (Lifecycle Event)
Aug 27 06:54:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:54:25 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:54:25 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 27 06:54:25 user nova-compute[73258]: INFO nova.compute.manager [None req-ac3c40bc-d3e9-410a-970d-859370f3ec68 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Updating instance to original state: 'active'
Aug 27 06:54:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:42 user nova-compute[73258]: DEBUG nova.compute.manager [req-64f97e10-48a7-42b6-aa8f-5de84398f790 req-a62dabd9-1c48-49de-bc06-0ec7ac9cc8bc service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received event network-changed-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:54:42 user nova-compute[73258]: DEBUG nova.compute.manager [req-64f97e10-48a7-42b6-aa8f-5de84398f790 req-a62dabd9-1c48-49de-bc06-0ec7ac9cc8bc service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Refreshing instance network info cache due to event network-changed-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:54:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-64f97e10-48a7-42b6-aa8f-5de84398f790 req-a62dabd9-1c48-49de-bc06-0ec7ac9cc8bc service nova] Acquiring lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:54:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-64f97e10-48a7-42b6-aa8f-5de84398f790 req-a62dabd9-1c48-49de-bc06-0ec7ac9cc8bc service nova] Acquired lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:54:42 user nova-compute[73258]: DEBUG nova.network.neutron [req-64f97e10-48a7-42b6-aa8f-5de84398f790 req-a62dabd9-1c48-49de-bc06-0ec7ac9cc8bc service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Refreshing network info cache for port 8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:54:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "b22b7599-5a37-4370-b440-f04e3dc88f98" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:54:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:54:42 user nova-compute[73258]: DEBUG nova.network.neutron [req-64f97e10-48a7-42b6-aa8f-5de84398f790 req-a62dabd9-1c48-49de-bc06-0ec7ac9cc8bc service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Updated VIF entry in instance network info cache for port 8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:54:42 user nova-compute[73258]: DEBUG nova.network.neutron [req-64f97e10-48a7-42b6-aa8f-5de84398f790 req-a62dabd9-1c48-49de-bc06-0ec7ac9cc8bc service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Updating instance_info_cache with network_info: [{"id": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "address": "fa:16:3e:2a:36:5c", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e94cae8-ea", "ovs_interfaceid": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:54:42 user nova-compute[73258]: INFO nova.compute.manager [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Detaching volume b803adad-6f72-4910-b65c-6d62cb5d30b8
Aug 27 06:54:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-64f97e10-48a7-42b6-aa8f-5de84398f790 req-a62dabd9-1c48-49de-bc06-0ec7ac9cc8bc service nova] Releasing lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:54:42 user nova-compute[73258]: INFO nova.virt.block_device [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Attempting to driver detach volume b803adad-6f72-4910-b65c-6d62cb5d30b8 from mountpoint /dev/vdb
Aug 27 06:54:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Attempting to detach device vdb from instance b22b7599-5a37-4370-b440-f04e3dc88f98 from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:54:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:54:42 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:54:42 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 06:54:42 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:54:42 user nova-compute[73258]:   <serial>b803adad-6f72-4910-b65c-6d62cb5d30b8</serial>
Aug 27 06:54:42 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:54:42 user nova-compute[73258]: </disk>
Aug 27 06:54:42 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:54:42 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Successfully detached device vdb from instance b22b7599-5a37-4370-b440-f04e3dc88f98 from the persistent domain config.
Aug 27 06:54:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b22b7599-5a37-4370-b440-f04e3dc88f98 from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:54:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:54:42 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:54:42 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 06:54:42 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:54:42 user nova-compute[73258]:   <serial>b803adad-6f72-4910-b65c-6d62cb5d30b8</serial>
Aug 27 06:54:42 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:54:42 user nova-compute[73258]: </disk>
Aug 27 06:54:42 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693119283.3891656, b22b7599-5a37-4370-b440-f04e3dc88f98 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b22b7599-5a37-4370-b440-f04e3dc88f98 {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:54:43 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Successfully detached device vdb from instance b22b7599-5a37-4370-b440-f04e3dc88f98 from the live domain config.
Aug 27 06:54:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixlFOBzw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:54:43 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:54:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65b30ed-085a-43a5-9bc2-c7fec828725c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b5d67b-7612-419c-9e33-34f63409e105]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:54:43 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:54:43 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:54:43 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:54:43 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:54:43 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:54:43 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:54:43 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:54:43 user nova-compute[73258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 (non-flash)
Aug 27 06:54:43 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:54:43 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:54:43 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:54:43 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4303465f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8'): ({'sdc'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Removing single pathed devices sdc {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c96009d-274d-4f31-a2c1-a5f08cc93988]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24df03b-cae4-4df8-9d5a-3a51508b8b2b]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Flushing IO for device /dev/sdc {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41b99eb-7625-445b-9895-e2f1ffd1f7ab]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e090d76b-23a0-4868-a69a-7423a7b56444]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09e3757-f7f4-4dd6-a2e0-1d44cb1cf240]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fe5489-6ca9-4466-8563-9c79b555cf1d]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8, portal: 172.16.0.220,3260]
Aug 27 06:54:43 user nova-compute[73258]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8, portal: 172.16.0.220,3260] successful.
Aug 27 06:54:43 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b803adad-6f72-4910-b65c-6d62cb5d30b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3422d231-f5e1-4e10-9861-32d244fc62a4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] <== disconnect_volume: return (328ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:54:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:54:44 user nova-compute[73258]: DEBUG nova.compute.manager [req-baede349-ae08-4f38-9204-8859c236887c req-f2d6c847-5b45-45d0-b7a7-b5a6dc856ca2 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received event network-changed-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:54:44 user nova-compute[73258]: DEBUG nova.compute.manager [req-baede349-ae08-4f38-9204-8859c236887c req-f2d6c847-5b45-45d0-b7a7-b5a6dc856ca2 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Refreshing instance network info cache due to event network-changed-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:54:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-baede349-ae08-4f38-9204-8859c236887c req-f2d6c847-5b45-45d0-b7a7-b5a6dc856ca2 service nova] Acquiring lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:54:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-baede349-ae08-4f38-9204-8859c236887c req-f2d6c847-5b45-45d0-b7a7-b5a6dc856ca2 service nova] Acquired lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:54:44 user nova-compute[73258]: DEBUG nova.network.neutron [req-baede349-ae08-4f38-9204-8859c236887c req-f2d6c847-5b45-45d0-b7a7-b5a6dc856ca2 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Refreshing network info cache for port 8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:54:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:44 user nova-compute[73258]: DEBUG nova.network.neutron [req-baede349-ae08-4f38-9204-8859c236887c req-f2d6c847-5b45-45d0-b7a7-b5a6dc856ca2 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Updated VIF entry in instance network info cache for port 8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:54:44 user nova-compute[73258]: DEBUG nova.network.neutron [req-baede349-ae08-4f38-9204-8859c236887c req-f2d6c847-5b45-45d0-b7a7-b5a6dc856ca2 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Updating instance_info_cache with network_info: [{"id": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "address": "fa:16:3e:2a:36:5c", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e94cae8-ea", "ovs_interfaceid": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:54:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-baede349-ae08-4f38-9204-8859c236887c req-f2d6c847-5b45-45d0-b7a7-b5a6dc856ca2 service nova] Releasing lock "refresh_cache-b22b7599-5a37-4370-b440-f04e3dc88f98" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:54:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:51 user nova-compute[73258]: DEBUG nova.objects.instance [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'flavor' on Instance uuid b22b7599-5a37-4370-b440-f04e3dc88f98 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:54:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-57f660ae-c5dc-4783-8bc8-783e6daaad10 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.527s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:54:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:54 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:54:54 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:54:54 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:54:54 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 06:54:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:54:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:54:54 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:54:54 user nova-compute[73258]: DEBUG nova.objects.instance [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lazy-loading 'info_cache' on Instance uuid 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:54:55 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Updating instance_info_cache with network_info: [{"id": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "address": "fa:16:3e:82:0b:22", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f7670e-c9", "ovs_interfaceid": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:54:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:54:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:54:55 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:54:55 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:54:55 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:54:55 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:54:55 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:54:55 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:54:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:54:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:55 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:54:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:54:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:54:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:54:55 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:54:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:54:56 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:54:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:54:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:54:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:54:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:54:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:54:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:54:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:01 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:55:01 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:55:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=6675MB free_disk=23.715049743652344GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:55:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:55:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1672aa9f-be6f-4357-877f-a48f62119df4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:55:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:55:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a836678e-240d-4ead-b0b5-64d146910a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:55:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 7ee743f1-9611-4165-838e-54fccb332f1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:55:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance b22b7599-5a37-4370-b440-f04e3dc88f98 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:55:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance d409b021-ab98-4f9f-a80d-99fe05de7b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:55:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance ede6423b-ad91-4002-91d1-5849c6a4e26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:55:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:55:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bc3cebb3-0e29-4899-94aa-d13a2a9ca86a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:55:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 01a9f7b2-805a-4ece-a29c-33ac0057cc9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:55:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 0c16951e-8620-493f-8af4-fbdc64e1c131 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:55:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a296fb1e-1999-475c-9a15-eeeedfa11247 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:55:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:55:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:55:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:55:02 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:55:02 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:55:02 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:55:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:02 user nova-compute[73258]: DEBUG nova.compute.manager [req-d1e8598d-f518-4461-a8df-bbf4319d14cb req-cd32e278-6a91-4a60-b57c-0e345607735c service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Received event network-changed-ec3a771c-4248-4c68-ab25-763dda6741ea {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:55:02 user nova-compute[73258]: DEBUG nova.compute.manager [req-d1e8598d-f518-4461-a8df-bbf4319d14cb req-cd32e278-6a91-4a60-b57c-0e345607735c service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Refreshing instance network info cache due to event network-changed-ec3a771c-4248-4c68-ab25-763dda6741ea. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:55:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d1e8598d-f518-4461-a8df-bbf4319d14cb req-cd32e278-6a91-4a60-b57c-0e345607735c service nova] Acquiring lock "refresh_cache-01a9f7b2-805a-4ece-a29c-33ac0057cc9b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:55:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d1e8598d-f518-4461-a8df-bbf4319d14cb req-cd32e278-6a91-4a60-b57c-0e345607735c service nova] Acquired lock "refresh_cache-01a9f7b2-805a-4ece-a29c-33ac0057cc9b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:55:02 user nova-compute[73258]: DEBUG nova.network.neutron [req-d1e8598d-f518-4461-a8df-bbf4319d14cb req-cd32e278-6a91-4a60-b57c-0e345607735c service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Refreshing network info cache for port ec3a771c-4248-4c68-ab25-763dda6741ea {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG nova.objects.instance [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lazy-loading 'flavor' on Instance uuid 01a9f7b2-805a-4ece-a29c-33ac0057cc9b {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:03 user nova-compute[73258]: INFO nova.compute.manager [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Attaching volume 0661f102-96a0-4d32-98c4-b7dc4be11ea4 to /dev/vdb
Aug 27 06:55:03 user nova-compute[73258]: DEBUG os_brick.utils [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad6f9ad-2341-4028-be08-3c7d827fa945]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2035b0-e7a7-4a1f-8c59-dafde683a370]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b06bffb-93a8-4db8-b285-addb2b696391]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1123b7-9923-49a6-ab78-9382d1982c0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:55:03 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b532ea-11fc-41fc-b808-a058db23a3b3]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG os_brick.utils [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Updating existing volume attachment record: 26e74642-64d4-41a1-ab58-253cbee90d76 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG nova.network.neutron [req-d1e8598d-f518-4461-a8df-bbf4319d14cb req-cd32e278-6a91-4a60-b57c-0e345607735c service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Updated VIF entry in instance network info cache for port ec3a771c-4248-4c68-ab25-763dda6741ea. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG nova.network.neutron [req-d1e8598d-f518-4461-a8df-bbf4319d14cb req-cd32e278-6a91-4a60-b57c-0e345607735c service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Updating instance_info_cache with network_info: [{"id": "ec3a771c-4248-4c68-ab25-763dda6741ea", "address": "fa:16:3e:29:0d:42", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec3a771c-42", "ovs_interfaceid": "ec3a771c-4248-4c68-ab25-763dda6741ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:55:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d1e8598d-f518-4461-a8df-bbf4319d14cb req-cd32e278-6a91-4a60-b57c-0e345607735c service nova] Releasing lock "refresh_cache-01a9f7b2-805a-4ece-a29c-33ac0057cc9b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:55:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:55:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:07 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:55:07 user nova-compute[73258]: INFO nova.compute.claims [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Claim successful on node user
Aug 27 06:55:07 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:55:07 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:55:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.651s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:07 user nova-compute[73258]: DEBUG nova.compute.manager [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:55:07 user nova-compute[73258]: DEBUG nova.compute.manager [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:55:07 user nova-compute[73258]: DEBUG nova.network.neutron [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:55:07 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:55:07 user nova-compute[73258]: DEBUG nova.compute.manager [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:55:07 user nova-compute[73258]: DEBUG nova.policy [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9beefbe3addc4db1b2b1092601853ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5caed6c4efcf4ebab7c5dc47d0d7736c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:55:07 user nova-compute[73258]: DEBUG nova.compute.manager [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:55:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:55:07 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Creating image(s)
Aug 27 06:55:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "/opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "/opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "/opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.206s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.197s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk 1073741824" returned: 0 in 0.053s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG nova.network.neutron [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Successfully created port: be41900c-5aad-4659-9e21-fc2c0c0b8bd1 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.242s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Cannot resize image /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Ensure instance console log exists: /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.network.neutron [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Successfully updated port: be41900c-5aad-4659-9e21-fc2c0c0b8bd1 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "refresh_cache-54697fcb-9ffe-4660-b7d2-7b89dfd72439" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquired lock "refresh_cache-54697fcb-9ffe-4660-b7d2-7b89dfd72439" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.network.neutron [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-e342ac78-27ca-41bd-a798-1b4615441ca3 req-0f674a27-3d36-44bd-a4fe-0ae751e81fea service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Received event network-changed-be41900c-5aad-4659-9e21-fc2c0c0b8bd1 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-e342ac78-27ca-41bd-a798-1b4615441ca3 req-0f674a27-3d36-44bd-a4fe-0ae751e81fea service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Refreshing instance network info cache due to event network-changed-be41900c-5aad-4659-9e21-fc2c0c0b8bd1. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e342ac78-27ca-41bd-a798-1b4615441ca3 req-0f674a27-3d36-44bd-a4fe-0ae751e81fea service nova] Acquiring lock "refresh_cache-54697fcb-9ffe-4660-b7d2-7b89dfd72439" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.network.neutron [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.network.neutron [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Updating instance_info_cache with network_info: [{"id": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "address": "fa:16:3e:0a:85:cd", "network": {"id": "8868be84-8d19-484f-9732-0a212f789a1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1368955490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5caed6c4efcf4ebab7c5dc47d0d7736c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe41900c-5a", "ovs_interfaceid": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Releasing lock "refresh_cache-54697fcb-9ffe-4660-b7d2-7b89dfd72439" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.compute.manager [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Instance network_info: |[{"id": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "address": "fa:16:3e:0a:85:cd", "network": {"id": "8868be84-8d19-484f-9732-0a212f789a1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1368955490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5caed6c4efcf4ebab7c5dc47d0d7736c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe41900c-5a", "ovs_interfaceid": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e342ac78-27ca-41bd-a798-1b4615441ca3 req-0f674a27-3d36-44bd-a4fe-0ae751e81fea service nova] Acquired lock "refresh_cache-54697fcb-9ffe-4660-b7d2-7b89dfd72439" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.network.neutron [req-e342ac78-27ca-41bd-a798-1b4615441ca3 req-0f674a27-3d36-44bd-a4fe-0ae751e81fea service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Refreshing network info cache for port be41900c-5aad-4659-9e21-fc2c0c0b8bd1 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Start _get_guest_xml network_info=[{"id": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "address": "fa:16:3e:0a:85:cd", "network": {"id": "8868be84-8d19-484f-9732-0a212f789a1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1368955490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5caed6c4efcf4ebab7c5dc47d0d7736c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe41900c-5a", "ovs_interfaceid": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:55:09 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:55:09 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:55:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1140115155',display_name='tempest-SnapshotDataIntegrityTests-server-1140115155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1140115155',id=40,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6XxxUWvpp9AyShA4tf/HafMN5QFAven2ZPhwUZGpBiN5PxSVqcDrkjF7gdlWh2x/O0vCN4qqcAZOu4WYNelEVNtIP6M+JVS/B4oqwJSNLRwSpXvufmqXzwDB0X9TZPig==',key_name='tempest-keypair-827887380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5caed6c4efcf4ebab7c5dc47d0d7736c',ramdisk_id='',reservation_id='r-23lwt5gw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-464395838',owner_user_name='tempest-SnapshotDataIntegrityTests-464395838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:55:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9beefbe3addc4db1b2b1092601853ca8',uuid=54697fcb-9ffe-4660-b7d2-7b89dfd72439,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "address": "fa:16:3e:0a:85:cd", "network": {"id": "8868be84-8d19-484f-9732-0a212f789a1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1368955490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5caed6c4efcf4ebab7c5dc47d0d7736c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe41900c-5a", "ovs_interfaceid": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Converting VIF {"id": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "address": "fa:16:3e:0a:85:cd", "network": {"id": "8868be84-8d19-484f-9732-0a212f789a1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1368955490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5caed6c4efcf4ebab7c5dc47d0d7736c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe41900c-5a", "ovs_interfaceid": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:85:cd,bridge_name='br-int',has_traffic_filtering=True,id=be41900c-5aad-4659-9e21-fc2c0c0b8bd1,network=Network(8868be84-8d19-484f-9732-0a212f789a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe41900c-5a') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:55:09 user nova-compute[73258]: DEBUG nova.objects.instance [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lazy-loading 'pci_devices' on Instance uuid 54697fcb-9ffe-4660-b7d2-7b89dfd72439 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:55:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:55:10 user nova-compute[73258]:   <uuid>54697fcb-9ffe-4660-b7d2-7b89dfd72439</uuid>
Aug 27 06:55:10 user nova-compute[73258]:   <name>instance-00000028</name>
Aug 27 06:55:10 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:55:10 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:55:10 user nova-compute[73258]:   <metadata>
Aug 27 06:55:10 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:55:10 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:55:10 user nova-compute[73258]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1140115155</nova:name>
Aug 27 06:55:10 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:55:09</nova:creationTime>
Aug 27 06:55:10 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:55:10 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:55:10 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:55:10 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:55:10 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:55:10 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:55:10 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:55:10 user nova-compute[73258]:       <nova:owner>
Aug 27 06:55:10 user nova-compute[73258]:         <nova:user uuid="9beefbe3addc4db1b2b1092601853ca8">tempest-SnapshotDataIntegrityTests-464395838-project-member</nova:user>
Aug 27 06:55:10 user nova-compute[73258]:         <nova:project uuid="5caed6c4efcf4ebab7c5dc47d0d7736c">tempest-SnapshotDataIntegrityTests-464395838</nova:project>
Aug 27 06:55:10 user nova-compute[73258]:       </nova:owner>
Aug 27 06:55:10 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:55:10 user nova-compute[73258]:       <nova:ports>
Aug 27 06:55:10 user nova-compute[73258]:         <nova:port uuid="be41900c-5aad-4659-9e21-fc2c0c0b8bd1">
Aug 27 06:55:10 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 06:55:10 user nova-compute[73258]:         </nova:port>
Aug 27 06:55:10 user nova-compute[73258]:       </nova:ports>
Aug 27 06:55:10 user nova-compute[73258]:     </nova:instance>
Aug 27 06:55:10 user nova-compute[73258]:   </metadata>
Aug 27 06:55:10 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:55:10 user nova-compute[73258]:     <system>
Aug 27 06:55:10 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:55:10 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:55:10 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:55:10 user nova-compute[73258]:       <entry name="serial">54697fcb-9ffe-4660-b7d2-7b89dfd72439</entry>
Aug 27 06:55:10 user nova-compute[73258]:       <entry name="uuid">54697fcb-9ffe-4660-b7d2-7b89dfd72439</entry>
Aug 27 06:55:10 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:55:10 user nova-compute[73258]:     </system>
Aug 27 06:55:10 user nova-compute[73258]:   </sysinfo>
Aug 27 06:55:10 user nova-compute[73258]:   <os>
Aug 27 06:55:10 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:55:10 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:55:10 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:55:10 user nova-compute[73258]:   </os>
Aug 27 06:55:10 user nova-compute[73258]:   <features>
Aug 27 06:55:10 user nova-compute[73258]:     <acpi/>
Aug 27 06:55:10 user nova-compute[73258]:     <apic/>
Aug 27 06:55:10 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:55:10 user nova-compute[73258]:   </features>
Aug 27 06:55:10 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:55:10 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:55:10 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:55:10 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:55:10 user nova-compute[73258]:   </clock>
Aug 27 06:55:10 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:55:10 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:55:10 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:55:10 user nova-compute[73258]:   </cpu>
Aug 27 06:55:10 user nova-compute[73258]:   <devices>
Aug 27 06:55:10 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:55:10 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:55:10 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk"/>
Aug 27 06:55:10 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:55:10 user nova-compute[73258]:     </disk>
Aug 27 06:55:10 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:55:10 user nova-compute[73258]:       <mac address="fa:16:3e:0a:85:cd"/>
Aug 27 06:55:10 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:55:10 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:55:10 user nova-compute[73258]:       <target dev="tapbe41900c-5a"/>
Aug 27 06:55:10 user nova-compute[73258]:     </interface>
Aug 27 06:55:10 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:55:10 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/console.log" append="off"/>
Aug 27 06:55:10 user nova-compute[73258]:     </serial>
Aug 27 06:55:10 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:55:10 user nova-compute[73258]:     <video>
Aug 27 06:55:10 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:55:10 user nova-compute[73258]:     </video>
Aug 27 06:55:10 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:55:10 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:55:10 user nova-compute[73258]:     </rng>
Aug 27 06:55:10 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:55:10 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:55:10 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:55:10 user nova-compute[73258]:     </memballoon>
Aug 27 06:55:10 user nova-compute[73258]:   </devices>
Aug 27 06:55:10 user nova-compute[73258]: </domain>
Aug 27 06:55:10 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:55:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:55:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1140115155',display_name='tempest-SnapshotDataIntegrityTests-server-1140115155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1140115155',id=40,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6XxxUWvpp9AyShA4tf/HafMN5QFAven2ZPhwUZGpBiN5PxSVqcDrkjF7gdlWh2x/O0vCN4qqcAZOu4WYNelEVNtIP6M+JVS/B4oqwJSNLRwSpXvufmqXzwDB0X9TZPig==',key_name='tempest-keypair-827887380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5caed6c4efcf4ebab7c5dc47d0d7736c',ramdisk_id='',reservation_id='r-23lwt5gw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-464395838',owner_user_name='tempest-SnapshotDataIntegrityTests-464395838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:55:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9beefbe3addc4db1b2b1092601853ca8',uuid=54697fcb-9ffe-4660-b7d2-7b89dfd72439,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "address": "fa:16:3e:0a:85:cd", "network": {"id": "8868be84-8d19-484f-9732-0a212f789a1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1368955490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5caed6c4efcf4ebab7c5dc47d0d7736c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe41900c-5a", "ovs_interfaceid": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:55:10 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Converting VIF {"id": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "address": "fa:16:3e:0a:85:cd", "network": {"id": "8868be84-8d19-484f-9732-0a212f789a1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1368955490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5caed6c4efcf4ebab7c5dc47d0d7736c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe41900c-5a", "ovs_interfaceid": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:55:10 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:85:cd,bridge_name='br-int',has_traffic_filtering=True,id=be41900c-5aad-4659-9e21-fc2c0c0b8bd1,network=Network(8868be84-8d19-484f-9732-0a212f789a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe41900c-5a') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:55:10 user nova-compute[73258]: DEBUG os_vif [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:85:cd,bridge_name='br-int',has_traffic_filtering=True,id=be41900c-5aad-4659-9e21-fc2c0c0b8bd1,network=Network(8868be84-8d19-484f-9732-0a212f789a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe41900c-5a') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:55:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:55:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:55:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe41900c-5a, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:55:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe41900c-5a, col_values=(('external_ids', {'iface-id': 'be41900c-5aad-4659-9e21-fc2c0c0b8bd1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:85:cd', 'vm-uuid': '54697fcb-9ffe-4660-b7d2-7b89dfd72439'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:55:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:55:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:10 user nova-compute[73258]: INFO os_vif [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:85:cd,bridge_name='br-int',has_traffic_filtering=True,id=be41900c-5aad-4659-9e21-fc2c0c0b8bd1,network=Network(8868be84-8d19-484f-9732-0a212f789a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe41900c-5a')
Aug 27 06:55:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:55:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] No VIF found with MAC fa:16:3e:0a:85:cd, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:55:10 user nova-compute[73258]: DEBUG nova.network.neutron [req-e342ac78-27ca-41bd-a798-1b4615441ca3 req-0f674a27-3d36-44bd-a4fe-0ae751e81fea service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Updated VIF entry in instance network info cache for port be41900c-5aad-4659-9e21-fc2c0c0b8bd1. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:55:10 user nova-compute[73258]: DEBUG nova.network.neutron [req-e342ac78-27ca-41bd-a798-1b4615441ca3 req-0f674a27-3d36-44bd-a4fe-0ae751e81fea service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Updating instance_info_cache with network_info: [{"id": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "address": "fa:16:3e:0a:85:cd", "network": {"id": "8868be84-8d19-484f-9732-0a212f789a1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1368955490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5caed6c4efcf4ebab7c5dc47d0d7736c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe41900c-5a", "ovs_interfaceid": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:55:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e342ac78-27ca-41bd-a798-1b4615441ca3 req-0f674a27-3d36-44bd-a4fe-0ae751e81fea service nova] Releasing lock "refresh_cache-54697fcb-9ffe-4660-b7d2-7b89dfd72439" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:55:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:11 user nova-compute[73258]: DEBUG nova.compute.manager [req-045bfd72-72cf-4ab7-afa7-67edf227e909 req-21d693e7-c3d2-4b6d-b10a-b2f1e5011a39 service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Received event network-vif-plugged-be41900c-5aad-4659-9e21-fc2c0c0b8bd1 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:55:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-045bfd72-72cf-4ab7-afa7-67edf227e909 req-21d693e7-c3d2-4b6d-b10a-b2f1e5011a39 service nova] Acquiring lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-045bfd72-72cf-4ab7-afa7-67edf227e909 req-21d693e7-c3d2-4b6d-b10a-b2f1e5011a39 service nova] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-045bfd72-72cf-4ab7-afa7-67edf227e909 req-21d693e7-c3d2-4b6d-b10a-b2f1e5011a39 service nova] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:11 user nova-compute[73258]: DEBUG nova.compute.manager [req-045bfd72-72cf-4ab7-afa7-67edf227e909 req-21d693e7-c3d2-4b6d-b10a-b2f1e5011a39 service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] No waiting events found dispatching network-vif-plugged-be41900c-5aad-4659-9e21-fc2c0c0b8bd1 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:55:11 user nova-compute[73258]: WARNING nova.compute.manager [req-045bfd72-72cf-4ab7-afa7-67edf227e909 req-21d693e7-c3d2-4b6d-b10a-b2f1e5011a39 service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Received unexpected event network-vif-plugged-be41900c-5aad-4659-9e21-fc2c0c0b8bd1 for instance with vm_state building and task_state spawning.
Aug 27 06:55:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-4e144b43-4ebe-4a5c-858d-7b5bc11831c9 req-31f29dff-04c5-495c-8a46-ceb1956f86ec service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Received event network-vif-plugged-be41900c-5aad-4659-9e21-fc2c0c0b8bd1 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:55:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4e144b43-4ebe-4a5c-858d-7b5bc11831c9 req-31f29dff-04c5-495c-8a46-ceb1956f86ec service nova] Acquiring lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4e144b43-4ebe-4a5c-858d-7b5bc11831c9 req-31f29dff-04c5-495c-8a46-ceb1956f86ec service nova] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4e144b43-4ebe-4a5c-858d-7b5bc11831c9 req-31f29dff-04c5-495c-8a46-ceb1956f86ec service nova] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-4e144b43-4ebe-4a5c-858d-7b5bc11831c9 req-31f29dff-04c5-495c-8a46-ceb1956f86ec service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] No waiting events found dispatching network-vif-plugged-be41900c-5aad-4659-9e21-fc2c0c0b8bd1 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:55:13 user nova-compute[73258]: WARNING nova.compute.manager [req-4e144b43-4ebe-4a5c-858d-7b5bc11831c9 req-31f29dff-04c5-495c-8a46-ceb1956f86ec service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Received unexpected event network-vif-plugged-be41900c-5aad-4659-9e21-fc2c0c0b8bd1 for instance with vm_state building and task_state spawning.
Aug 27 06:55:14 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119314.013509, 54697fcb-9ffe-4660-b7d2-7b89dfd72439 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:55:14 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] VM Resumed (Lifecycle Event)
Aug 27 06:55:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:55:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:55:14 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Instance spawned successfully.
Aug 27 06:55:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:55:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:55:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:55:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:55:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:55:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:55:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:55:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:55:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:55:14 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:55:14 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119314.0212448, 54697fcb-9ffe-4660-b7d2-7b89dfd72439 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:55:14 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] VM Started (Lifecycle Event)
Aug 27 06:55:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:55:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:55:14 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:55:14 user nova-compute[73258]: INFO nova.compute.manager [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Took 6.19 seconds to spawn the instance on the hypervisor.
Aug 27 06:55:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:55:14 user nova-compute[73258]: INFO nova.compute.manager [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Took 7.28 seconds to build instance.
Aug 27 06:55:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19709c2e-587f-4db4-820d-b52c23a18d4a tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.383s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "ede6423b-ad91-4002-91d1-5849c6a4e26b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:16 user nova-compute[73258]: INFO nova.compute.manager [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Terminating instance
Aug 27 06:55:16 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:55:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-4d4f752e-ea5f-48a6-aee7-425a3dec32cf req-6c7cb1da-976d-4d25-b102-352018500858 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Received event network-vif-unplugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4d4f752e-ea5f-48a6-aee7-425a3dec32cf req-6c7cb1da-976d-4d25-b102-352018500858 service nova] Acquiring lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4d4f752e-ea5f-48a6-aee7-425a3dec32cf req-6c7cb1da-976d-4d25-b102-352018500858 service nova] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4d4f752e-ea5f-48a6-aee7-425a3dec32cf req-6c7cb1da-976d-4d25-b102-352018500858 service nova] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-4d4f752e-ea5f-48a6-aee7-425a3dec32cf req-6c7cb1da-976d-4d25-b102-352018500858 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] No waiting events found dispatching network-vif-unplugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-4d4f752e-ea5f-48a6-aee7-425a3dec32cf req-6c7cb1da-976d-4d25-b102-352018500858 service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Received event network-vif-unplugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:55:17 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Instance destroyed successfully.
Aug 27 06:55:17 user nova-compute[73258]: DEBUG nova.objects.instance [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lazy-loading 'resources' on Instance uuid ede6423b-ad91-4002-91d1-5849c6a4e26b {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:48:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-247234727',display_name='tempest-ServerActionsTestOtherA-server-247234727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-247234727',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/KYWUE6gNqqFSSqcTnsAI5+JZTptdXjLfwtgiVKLM8n2N6Y2L8s6Bg81l6XDxMjw3BfYNizv1BnMF+y6NIh1U/xVCMRNK16iGCh/62JzPGiCS6K24meGZJ+ETPM0mnhw==',key_name='tempest-keypair-1255305482',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:50:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57faf7cb6c704c05aba06857a6cdd29f',ramdisk_id='',reservation_id='r-lb0avote',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1477462030',owner_user_name='tempest-ServerActionsTestOtherA-1477462030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:52:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f8a06ab5634f60b6ed2d1d9b2c342e',uuid=ede6423b-ad91-4002-91d1-5849c6a4e26b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converting VIF {"id": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "address": "fa:16:3e:a4:da:75", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7639f1-aa", "ovs_interfaceid": "0d7639f1-aadd-4f15-9292-8cef2591ce8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:da:75,bridge_name='br-int',has_traffic_filtering=True,id=0d7639f1-aadd-4f15-9292-8cef2591ce8d,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7639f1-aa') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_vif [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:da:75,bridge_name='br-int',has_traffic_filtering=True,id=0d7639f1-aadd-4f15-9292-8cef2591ce8d,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7639f1-aa') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d7639f1-aa, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:17 user nova-compute[73258]: INFO os_vif [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:da:75,bridge_name='br-int',has_traffic_filtering=True,id=0d7639f1-aadd-4f15-9292-8cef2591ce8d,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7639f1-aa')
Aug 27 06:55:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yaSCwxVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:55:17 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0e91f1-0b37-4f7c-af6e-b82fd58c63c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce58f3e-7101-4ec8-b87f-4f4d62d5c4eb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:55:17 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:55:17 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:55:17 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:55:17 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:55:17 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:55:17 user nova-compute[73258]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 (non-flash)
Aug 27 06:55:17 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:55:17 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:55:17 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:55:17 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa410717d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f775524e-2fa2-4a3c-8c1c-1ef636398cac]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9304a6ff-1a16-4c68-aa11-026023ad26cc]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9f3b6a-ca0d-4633-8f1f-09e8727eb110]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b14570-1e5d-49bf-ba51-7e092a58d569]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23432386439373366', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_82a47ec7', '/dev/disk/by-id/scsi-1SCST_BIO82a47ec7-428d973f48766a08') {{(pid=84389) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe506f9-fb83-4490-8cc6-9261fcf171e3]: (4, None) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f61ed32-8c37-4ef9-96ef-4f250a7c7bc2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e50f02c-bd27-4098-a5cc-da2e7876fbaa]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550, portal: 172.16.0.220,3260]
Aug 27 06:55:17 user nova-compute[73258]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550, portal: 172.16.0.220,3260] successful.
Aug 27 06:55:17 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c199006a-92aa-4e38-8f04-059c7642b550 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f353c0a-f9f1-4034-980b-616d13622e8d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] <== disconnect_volume: return (373ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:55:17 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Deleting instance files /opt/stack/data/nova/instances/ede6423b-ad91-4002-91d1-5849c6a4e26b_del
Aug 27 06:55:17 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Deletion of /opt/stack/data/nova/instances/ede6423b-ad91-4002-91d1-5849c6a4e26b_del complete
Aug 27 06:55:17 user nova-compute[73258]: INFO nova.compute.manager [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfKznmlg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:55:17 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:55:17 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:55:17 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a13156-ab2e-4f70-9644-43796536a508]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:55:17 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[60869965-3063-41bc-86e3-16114a82a498]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4] added
Aug 27 06:55:17 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4313db8-754e-4bb1-9961-1d8a41954f34]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4542c469-e514-458f-995a-18fc0a4bc3b6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BfKznmlg {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BfKznmlg" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae655ff-a1eb-4dc0-b410-8d50b43f5412]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BfKznmlg'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.056s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e306b381-f170-4e84-94da-fb24d65157a6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f15e7f-c67f-47c7-93c2-bde0b8063db0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:55:18 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:55:18 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:55:18 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:55:18 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:55:18 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:55:18 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:55:18 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:55:18 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --login" returned: 0 in 0.167s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5432cc-bb67-40f0-ac8c-c6e34bd0cec2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4, portal: 172.16.0.220,3260]
Aug 27 06:55:18 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4, portal: 172.16.0.220,3260] successful.
Aug 27 06:55:18 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.052s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b27609f-84ff-4bf6-8988-524c35b5301a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e78bd2-8fc8-4545-8ad1-6486bf06a5ba]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:55:18 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:55:18 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:55:18 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:55:18 user nova-compute[73258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 (non-flash)
Aug 27 06:55:18 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:55:18 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:55:18 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:55:18 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:55:18 user nova-compute[73258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 (non-flash)
Aug 27 06:55:18 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.526s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d925234-c995-4d1c-bd3d-47d391334413]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfKznmlg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:55:18 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:55:18 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Took 1.19 seconds to deallocate network for instance.
Aug 27 06:55:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-fe55f201-188a-438c-a8c9-fca912f511b4 req-03d0176d-db5a-4de9-af9e-0051d5348c6c service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Received event network-vif-deleted-0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:55:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-89c2df0d-0267-4859-9c2f-8e82c8ab4f10 req-24294c84-92d6-4044-82f1-2efafd8225ab service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Received event network-vif-plugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:55:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-89c2df0d-0267-4859-9c2f-8e82c8ab4f10 req-24294c84-92d6-4044-82f1-2efafd8225ab service nova] Acquiring lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-89c2df0d-0267-4859-9c2f-8e82c8ab4f10 req-24294c84-92d6-4044-82f1-2efafd8225ab service nova] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-89c2df0d-0267-4859-9c2f-8e82c8ab4f10 req-24294c84-92d6-4044-82f1-2efafd8225ab service nova] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-89c2df0d-0267-4859-9c2f-8e82c8ab4f10 req-24294c84-92d6-4044-82f1-2efafd8225ab service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] No waiting events found dispatching network-vif-plugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:55:19 user nova-compute[73258]: WARNING nova.compute.manager [req-89c2df0d-0267-4859-9c2f-8e82c8ab4f10 req-24294c84-92d6-4044-82f1-2efafd8225ab service nova] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Received unexpected event network-vif-plugged-0d7639f1-aadd-4f15-9292-8cef2591ce8d for instance with vm_state active and task_state deleting.
Aug 27 06:55:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.578s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:55:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] <== connect_volume: return (1581ms) {'type': 'block', 'scsi_wwn': '23831666635666339', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:55:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831666635666339', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:55:19 user nova-compute[73258]: DEBUG nova.objects.instance [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lazy-loading 'flavor' on Instance uuid 01a9f7b2-805a-4ece-a29c-33ac0057cc9b {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:55:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:55:19 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:55:19 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:55:19 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:55:19 user nova-compute[73258]:   <serial>0661f102-96a0-4d32-98c4-b7dc4be11ea4</serial>
Aug 27 06:55:19 user nova-compute[73258]: </disk>
Aug 27 06:55:19 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:55:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:55:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:55:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] No VIF found with MAC fa:16:3e:29:0d:42, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:55:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-88f29506-1f72-4717-a541-efb037409db4 tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.596s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:22 user nova-compute[73258]: INFO nova.compute.manager [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Detaching volume 0661f102-96a0-4d32-98c4-b7dc4be11ea4
Aug 27 06:55:22 user nova-compute[73258]: INFO nova.virt.block_device [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Attempting to driver detach volume 0661f102-96a0-4d32-98c4-b7dc4be11ea4 from mountpoint /dev/vdb
Aug 27 06:55:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Attempting to detach device vdb from instance 01a9f7b2-805a-4ece-a29c-33ac0057cc9b from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:55:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:55:22 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:55:22 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:55:22 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:55:22 user nova-compute[73258]:   <serial>0661f102-96a0-4d32-98c4-b7dc4be11ea4</serial>
Aug 27 06:55:22 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:55:22 user nova-compute[73258]: </disk>
Aug 27 06:55:22 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:55:22 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Successfully detached device vdb from instance 01a9f7b2-805a-4ece-a29c-33ac0057cc9b from the persistent domain config.
Aug 27 06:55:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01a9f7b2-805a-4ece-a29c-33ac0057cc9b from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:55:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:55:22 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:55:22 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:55:22 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:55:22 user nova-compute[73258]:   <serial>0661f102-96a0-4d32-98c4-b7dc4be11ea4</serial>
Aug 27 06:55:22 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:55:22 user nova-compute[73258]: </disk>
Aug 27 06:55:22 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693119323.0328074, 01a9f7b2-805a-4ece-a29c-33ac0057cc9b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01a9f7b2-805a-4ece-a29c-33ac0057cc9b {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:55:23 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Successfully detached device vdb from instance 01a9f7b2-805a-4ece-a29c-33ac0057cc9b from the live domain config.
Aug 27 06:55:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfKznmlg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:55:23 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:55:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd930c0-d4e1-47f2-852b-127f6b2da873]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5616790-a41c-4704-9a84-0287454ecf1d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:55:23 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:55:23 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:55:23 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:55:23 user nova-compute[73258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 (non-flash)
Aug 27 06:55:23 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:55:23 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:55:23 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:55:23 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:55:23 user nova-compute[73258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 (non-flash)
Aug 27 06:55:23 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa430346e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[39526915-5e9a-465b-9d6f-199e3d156c54]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[11976a08-f035-4a8c-ac5e-67bd7221baa3]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[374c3c91-e8f8-4039-9f40-d6b820b4aab9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad0ab11-4678-4e8c-9304-6e34e95153b6]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af5bea5-bcb9-4d1f-a65c-a9efde2113c8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6fb33a-34ec-4432-9c8d-f0b1b66d5653]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4, portal: 172.16.0.220,3260]
Aug 27 06:55:23 user nova-compute[73258]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4, portal: 172.16.0.220,3260] successful.
Aug 27 06:55:23 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0661f102-96a0-4d32-98c4-b7dc4be11ea4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8ee86d-73ad-4f50-9454-a80d2be7888d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] <== disconnect_volume: return (331ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:55:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:55:24 user nova-compute[73258]: DEBUG nova.objects.instance [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lazy-loading 'flavor' on Instance uuid 01a9f7b2-805a-4ece-a29c-33ac0057cc9b {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:55:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3de50de0-63dc-4a83-9014-d4348f7a01ca tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.853s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:26 user nova-compute[73258]: INFO nova.compute.manager [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Took 7.88 seconds to detach 1 volumes for instance.
Aug 27 06:55:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Deleting volume: c199006a-92aa-4e38-8f04-059c7642b550 {{(pid=73258) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 06:55:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:27 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:55:27 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:55:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:27 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Deleted allocations for instance ede6423b-ad91-4002-91d1-5849c6a4e26b
Aug 27 06:55:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9331fc5a-6b57-4771-b10e-945601fbec3c tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "ede6423b-ad91-4002-91d1-5849c6a4e26b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.162s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:29 user nova-compute[73258]: DEBUG nova.compute.manager [req-2de402c3-6cf4-425c-93b6-b0043a15832a req-cc672bbb-6858-43df-80d6-652e21cbbf6e service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received event network-changed-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:55:29 user nova-compute[73258]: DEBUG nova.compute.manager [req-2de402c3-6cf4-425c-93b6-b0043a15832a req-cc672bbb-6858-43df-80d6-652e21cbbf6e service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Refreshing instance network info cache due to event network-changed-1e7db346-1c0e-4a29-a6e9-053cd736b399. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:55:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2de402c3-6cf4-425c-93b6-b0043a15832a req-cc672bbb-6858-43df-80d6-652e21cbbf6e service nova] Acquiring lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:55:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2de402c3-6cf4-425c-93b6-b0043a15832a req-cc672bbb-6858-43df-80d6-652e21cbbf6e service nova] Acquired lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:55:29 user nova-compute[73258]: DEBUG nova.network.neutron [req-2de402c3-6cf4-425c-93b6-b0043a15832a req-cc672bbb-6858-43df-80d6-652e21cbbf6e service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Refreshing network info cache for port 1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:55:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "0c16951e-8620-493f-8af4-fbdc64e1c131" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:30 user nova-compute[73258]: INFO nova.compute.manager [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Shelve offloading
Aug 27 06:55:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:30 user nova-compute[73258]: DEBUG nova.network.neutron [req-2de402c3-6cf4-425c-93b6-b0043a15832a req-cc672bbb-6858-43df-80d6-652e21cbbf6e service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Updated VIF entry in instance network info cache for port 1e7db346-1c0e-4a29-a6e9-053cd736b399. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:55:30 user nova-compute[73258]: DEBUG nova.network.neutron [req-2de402c3-6cf4-425c-93b6-b0043a15832a req-cc672bbb-6858-43df-80d6-652e21cbbf6e service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Updating instance_info_cache with network_info: [{"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:55:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2de402c3-6cf4-425c-93b6-b0043a15832a req-cc672bbb-6858-43df-80d6-652e21cbbf6e service nova] Releasing lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:55:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-7a28f497-80cc-408f-98e9-ed9d255b52d9 req-a9e09103-0c4f-4e88-846b-2afe9f3dc6c9 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received event network-vif-unplugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:55:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7a28f497-80cc-408f-98e9-ed9d255b52d9 req-a9e09103-0c4f-4e88-846b-2afe9f3dc6c9 service nova] Acquiring lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7a28f497-80cc-408f-98e9-ed9d255b52d9 req-a9e09103-0c4f-4e88-846b-2afe9f3dc6c9 service nova] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7a28f497-80cc-408f-98e9-ed9d255b52d9 req-a9e09103-0c4f-4e88-846b-2afe9f3dc6c9 service nova] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-7a28f497-80cc-408f-98e9-ed9d255b52d9 req-a9e09103-0c4f-4e88-846b-2afe9f3dc6c9 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] No waiting events found dispatching network-vif-unplugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:55:30 user nova-compute[73258]: WARNING nova.compute.manager [req-7a28f497-80cc-408f-98e9-ed9d255b52d9 req-a9e09103-0c4f-4e88-846b-2afe9f3dc6c9 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received unexpected event network-vif-unplugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 for instance with vm_state active and task_state shelving.
Aug 27 06:55:31 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Instance destroyed successfully.
Aug 27 06:55:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:55:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:55:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquired lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:55:31 user nova-compute[73258]: DEBUG nova.network.neutron [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:55:31 user nova-compute[73258]: DEBUG nova.network.neutron [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Updating instance_info_cache with network_info: [{"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:55:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Releasing lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119317.0112627, ede6423b-ad91-4002-91d1-5849c6a4e26b => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:55:32 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] VM Stopped (Lifecycle Event)
Aug 27 06:55:32 user nova-compute[73258]: DEBUG nova.compute.manager [None req-13d969dc-94de-4f44-a36a-4a25a012a862 None None] [instance: ede6423b-ad91-4002-91d1-5849c6a4e26b] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:32 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Instance destroyed successfully.
Aug 27 06:55:32 user nova-compute[73258]: DEBUG nova.objects.instance [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lazy-loading 'resources' on Instance uuid 0c16951e-8620-493f-8af4-fbdc64e1c131 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1310771159',display_name='tempest-TestShelveInstance-server-1310771159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1310771159',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuaT2R5PPsAjc4NYciVpWptrbTp6s6w2hKpiAve1cx+pMVmkK9XU7VZvJEmmRfJw5taHvUwTh9xmdg2Dr/ClFtvIClQmBmDLE/7t8SdzixfG5H7Wm1+fm9Ad5ILDjSUXg==',key_name='tempest-TestShelveInstance-1450465266',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c14d7b80576d482a9b88ac09acdd2a55',ramdisk_id='',reservation_id='r-hyw6wngo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1338223853',owner_user_name='tempest-TestShelveInstance-1338223853-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:53:58Z,user_data=None,user_id='a31d853a46bd447e9bc757694d6cbf5a',uuid=0c16951e-8620-493f-8af4-fbdc64e1c131,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Converting VIF {"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=1e7db346-1c0e-4a29-a6e9-053cd736b399,network=Network(43c6935e-b9dd-46c2-a9b1-619444517b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7db346-1c') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG os_vif [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=1e7db346-1c0e-4a29-a6e9-053cd736b399,network=Network(43c6935e-b9dd-46c2-a9b1-619444517b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7db346-1c') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e7db346-1c, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:55:32 user nova-compute[73258]: INFO os_vif [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=1e7db346-1c0e-4a29-a6e9-053cd736b399,network=Network(43c6935e-b9dd-46c2-a9b1-619444517b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7db346-1c')
Aug 27 06:55:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbFOBqYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:55:32 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:55:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-ad613db5-4084-4102-ac4c-9308b4bdafcb req-29aee590-759a-4cc0-bac0-7d4feb237a84 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received event network-changed-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-ad613db5-4084-4102-ac4c-9308b4bdafcb req-29aee590-759a-4cc0-bac0-7d4feb237a84 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Refreshing instance network info cache due to event network-changed-1e7db346-1c0e-4a29-a6e9-053cd736b399. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ad613db5-4084-4102-ac4c-9308b4bdafcb req-29aee590-759a-4cc0-bac0-7d4feb237a84 service nova] Acquiring lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ad613db5-4084-4102-ac4c-9308b4bdafcb req-29aee590-759a-4cc0-bac0-7d4feb237a84 service nova] Acquired lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG nova.network.neutron [req-ad613db5-4084-4102-ac4c-9308b4bdafcb req-29aee590-759a-4cc0-bac0-7d4feb237a84 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Refreshing network info cache for port 1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ebda98-2cb5-4edc-8649-2b03fe74baee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1a3f3e-019c-49fe-a7ca-8dd6aea6fed9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:55:32 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:55:32 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:55:32 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:55:32 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:55:32 user nova-compute[73258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:55:32 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:55:32 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:55:32 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa44d309fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16'): ({'sdd'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Removing single pathed devices sdd {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98a451b-9d90-4aff-8732-bc2117292804]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee324763-4af6-4c2b-ae11-ee5c775e7aae]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Flushing IO for device /dev/sdd {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2e8664-ccd9-4508-9f2d-e038bb6b5d18]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a1fd2a-0917-439c-b9c8-86c13b6be58c]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] SCSI volumes sdd have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d171fc1-25e1-4c53-a969-ba7eb4418050]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-3ce928db-0d5c-4569-a010-e2eb951511ef req-04455d43-277a-4f7b-8383-5daf27c7fa57 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received event network-vif-plugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3ce928db-0d5c-4569-a010-e2eb951511ef req-04455d43-277a-4f7b-8383-5daf27c7fa57 service nova] Acquiring lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3ce928db-0d5c-4569-a010-e2eb951511ef req-04455d43-277a-4f7b-8383-5daf27c7fa57 service nova] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3ce928db-0d5c-4569-a010-e2eb951511ef req-04455d43-277a-4f7b-8383-5daf27c7fa57 service nova] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-3ce928db-0d5c-4569-a010-e2eb951511ef req-04455d43-277a-4f7b-8383-5daf27c7fa57 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] No waiting events found dispatching network-vif-plugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:55:32 user nova-compute[73258]: WARNING nova.compute.manager [req-3ce928db-0d5c-4569-a010-e2eb951511ef req-04455d43-277a-4f7b-8383-5daf27c7fa57 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received unexpected event network-vif-plugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 for instance with vm_state active and task_state shelving.
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47bbfa4-33da-49b7-8adc-88d529f76d81]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16, portal: 172.16.0.220,3260]
Aug 27 06:55:32 user nova-compute[73258]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16, portal: 172.16.0.220,3260] successful.
Aug 27 06:55:32 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4af0382-67db-4c6c-a267-6ca7abee3afe]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] <== disconnect_volume: return (341ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:55:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:55:32 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Deleting instance files /opt/stack/data/nova/instances/0c16951e-8620-493f-8af4-fbdc64e1c131_del
Aug 27 06:55:32 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Deletion of /opt/stack/data/nova/instances/0c16951e-8620-493f-8af4-fbdc64e1c131_del complete
Aug 27 06:55:33 user nova-compute[73258]: DEBUG nova.network.neutron [req-ad613db5-4084-4102-ac4c-9308b4bdafcb req-29aee590-759a-4cc0-bac0-7d4feb237a84 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Updated VIF entry in instance network info cache for port 1e7db346-1c0e-4a29-a6e9-053cd736b399. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:55:33 user nova-compute[73258]: DEBUG nova.network.neutron [req-ad613db5-4084-4102-ac4c-9308b4bdafcb req-29aee590-759a-4cc0-bac0-7d4feb237a84 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Updating instance_info_cache with network_info: [{"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": null, "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1e7db346-1c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:55:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "b22b7599-5a37-4370-b440-f04e3dc88f98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:33 user nova-compute[73258]: INFO nova.compute.manager [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Terminating instance
Aug 27 06:55:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:55:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ad613db5-4084-4102-ac4c-9308b4bdafcb req-29aee590-759a-4cc0-bac0-7d4feb237a84 service nova] Releasing lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:55:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:33 user nova-compute[73258]: INFO nova.compute.manager [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Rescuing
Aug 27 06:55:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "refresh_cache-a296fb1e-1999-475c-9a15-eeeedfa11247" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:55:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquired lock "refresh_cache-a296fb1e-1999-475c-9a15-eeeedfa11247" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:55:33 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:55:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:34 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Instance destroyed successfully.
Aug 27 06:55:34 user nova-compute[73258]: DEBUG nova.objects.instance [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'resources' on Instance uuid b22b7599-5a37-4370-b440-f04e3dc88f98 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:48:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1499776913',display_name='tempest-ServerRescueNegativeTestJSON-server-1499776913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1499776913',id=30,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErbhwcq7aMHPks7Q30Yl1JgTtz86nuYtLPWY4cd1Va/1/xuONf64c83ZqaEqnO0vQM+Iy3jGDNqDWdT2gBJMeVX8g/Qp/6AdHpxWA0fEmnlzHeTG2hi39F3l9DovV+GoA==',key_name='tempest-keypair-1178169413',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:51:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6efa67b959a473da5a06f9e0aa8795f',ramdisk_id='',reservation_id='r-onwvh0ae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1025141277',owner_user_name='tempest-ServerRescueNegativeTestJSON-1025141277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:52:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='685859ec81944e3398853037c24673a4',uuid=b22b7599-5a37-4370-b440-f04e3dc88f98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "address": "fa:16:3e:2a:36:5c", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e94cae8-ea", "ovs_interfaceid": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converting VIF {"id": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "address": "fa:16:3e:2a:36:5c", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e94cae8-ea", "ovs_interfaceid": "8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:36:5c,bridge_name='br-int',has_traffic_filtering=True,id=8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e94cae8-ea') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG os_vif [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:36:5c,bridge_name='br-int',has_traffic_filtering=True,id=8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e94cae8-ea') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e94cae8-ea, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:55:34 user nova-compute[73258]: INFO os_vif [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:36:5c,bridge_name='br-int',has_traffic_filtering=True,id=8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e94cae8-ea')
Aug 27 06:55:34 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Deleting instance files /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98_del
Aug 27 06:55:34 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Deletion of /opt/stack/data/nova/instances/b22b7599-5a37-4370-b440-f04e3dc88f98_del complete
Aug 27 06:55:34 user nova-compute[73258]: INFO nova.compute.manager [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 27 06:55:34 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Updating instance_info_cache with network_info: [{"id": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "address": "fa:16:3e:dd:b3:4a", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8b8c03-b3", "ovs_interfaceid": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Releasing lock "refresh_cache-a296fb1e-1999-475c-9a15-eeeedfa11247" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:34 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Deleted allocations for instance 0c16951e-8620-493f-8af4-fbdc64e1c131
Aug 27 06:55:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-4c43d1a8-1927-4052-bf24-f25c25708d74 req-51bc0271-e7fe-4f41-9064-a043ec1244b1 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received event network-vif-unplugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4c43d1a8-1927-4052-bf24-f25c25708d74 req-51bc0271-e7fe-4f41-9064-a043ec1244b1 service nova] Acquiring lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4c43d1a8-1927-4052-bf24-f25c25708d74 req-51bc0271-e7fe-4f41-9064-a043ec1244b1 service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4c43d1a8-1927-4052-bf24-f25c25708d74 req-51bc0271-e7fe-4f41-9064-a043ec1244b1 service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-4c43d1a8-1927-4052-bf24-f25c25708d74 req-51bc0271-e7fe-4f41-9064-a043ec1244b1 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] No waiting events found dispatching network-vif-unplugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-4c43d1a8-1927-4052-bf24-f25c25708d74 req-51bc0271-e7fe-4f41-9064-a043ec1244b1 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received event network-vif-unplugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-4c43d1a8-1927-4052-bf24-f25c25708d74 req-51bc0271-e7fe-4f41-9064-a043ec1244b1 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received event network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4c43d1a8-1927-4052-bf24-f25c25708d74 req-51bc0271-e7fe-4f41-9064-a043ec1244b1 service nova] Acquiring lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4c43d1a8-1927-4052-bf24-f25c25708d74 req-51bc0271-e7fe-4f41-9064-a043ec1244b1 service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4c43d1a8-1927-4052-bf24-f25c25708d74 req-51bc0271-e7fe-4f41-9064-a043ec1244b1 service nova] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-4c43d1a8-1927-4052-bf24-f25c25708d74 req-51bc0271-e7fe-4f41-9064-a043ec1244b1 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] No waiting events found dispatching network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:55:34 user nova-compute[73258]: WARNING nova.compute.manager [req-4c43d1a8-1927-4052-bf24-f25c25708d74 req-51bc0271-e7fe-4f41-9064-a043ec1244b1 service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received unexpected event network-vif-plugged-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 for instance with vm_state active and task_state deleting.
Aug 27 06:55:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG nova.objects.instance [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lazy-loading 'numa_topology' on Instance uuid 0c16951e-8620-493f-8af4-fbdc64e1c131 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG nova.objects.base [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Object Instance<0c16951e-8620-493f-8af4-fbdc64e1c131> lazy-loaded attributes: resources,numa_topology {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-e6e60fae-cfce-477a-9647-6daa06e77a4c req-83fa66a2-118a-46ca-8f96-0358761d70ab service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received event network-vif-unplugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e6e60fae-cfce-477a-9647-6daa06e77a4c req-83fa66a2-118a-46ca-8f96-0358761d70ab service nova] Acquiring lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e6e60fae-cfce-477a-9647-6daa06e77a4c req-83fa66a2-118a-46ca-8f96-0358761d70ab service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e6e60fae-cfce-477a-9647-6daa06e77a4c req-83fa66a2-118a-46ca-8f96-0358761d70ab service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-e6e60fae-cfce-477a-9647-6daa06e77a4c req-83fa66a2-118a-46ca-8f96-0358761d70ab service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] No waiting events found dispatching network-vif-unplugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:55:34 user nova-compute[73258]: WARNING nova.compute.manager [req-e6e60fae-cfce-477a-9647-6daa06e77a4c req-83fa66a2-118a-46ca-8f96-0358761d70ab service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received unexpected event network-vif-unplugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 for instance with vm_state active and task_state rescuing.
Aug 27 06:55:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:35 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Instance destroyed successfully.
Aug 27 06:55:35 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Attempting a stable device rescue
Aug 27 06:55:35 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73258) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 06:55:35 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Instance directory exists: not creating {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 06:55:35 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Creating image(s)
Aug 27 06:55:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "/opt/stack/data/nova/instances/a296fb1e-1999-475c-9a15-eeeedfa11247/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "/opt/stack/data/nova/instances/a296fb1e-1999-475c-9a15-eeeedfa11247/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "/opt/stack/data/nova/instances/a296fb1e-1999-475c-9a15-eeeedfa11247/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:35 user nova-compute[73258]: DEBUG nova.objects.instance [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'trusted_certs' on Instance uuid a296fb1e-1999-475c-9a15-eeeedfa11247 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:55:35 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:55:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "e94c0107d1099fb6a3bd29951c3382e0c8ff97d3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "e94c0107d1099fb6a3bd29951c3382e0c8ff97d3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:35 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:55:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.578s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f6c809e3-6ed8-4449-903b-d44a8ab5e3c4 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.258s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e94c0107d1099fb6a3bd29951c3382e0c8ff97d3.part --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:36 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:55:36 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Took 2.43 seconds to deallocate network for instance.
Aug 27 06:55:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e94c0107d1099fb6a3bd29951c3382e0c8ff97d3.part --force-share --output=json" returned: 0 in 0.181s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:36 user nova-compute[73258]: DEBUG nova.virt.images [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] 0ff071ba-3238-46a6-a699-e77672b28002 was qcow2, converting to raw {{(pid=73258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 06:55:36 user nova-compute[73258]: DEBUG nova.privsep.utils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 06:55:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e94c0107d1099fb6a3bd29951c3382e0c8ff97d3.part /opt/stack/data/nova/instances/_base/e94c0107d1099fb6a3bd29951c3382e0c8ff97d3.converted {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:36 user nova-compute[73258]: DEBUG nova.compute.manager [req-091ee9da-ca6e-4b41-8da6-d3827b78f990 req-a1ae96e8-e253-4144-ab67-a8285ffe43ab service nova] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Received event network-vif-deleted-8e94cae8-eae7-4deb-a7b7-c991e4c1e2f9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG nova.compute.manager [req-e7ae9858-45ba-4aa8-9cb7-067a3350f9f8 req-5d3f23f3-a4f7-4dc7-8982-6227339ecf93 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received event network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e7ae9858-45ba-4aa8-9cb7-067a3350f9f8 req-5d3f23f3-a4f7-4dc7-8982-6227339ecf93 service nova] Acquiring lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e7ae9858-45ba-4aa8-9cb7-067a3350f9f8 req-5d3f23f3-a4f7-4dc7-8982-6227339ecf93 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e7ae9858-45ba-4aa8-9cb7-067a3350f9f8 req-5d3f23f3-a4f7-4dc7-8982-6227339ecf93 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG nova.compute.manager [req-e7ae9858-45ba-4aa8-9cb7-067a3350f9f8 req-5d3f23f3-a4f7-4dc7-8982-6227339ecf93 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] No waiting events found dispatching network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:55:37 user nova-compute[73258]: WARNING nova.compute.manager [req-e7ae9858-45ba-4aa8-9cb7-067a3350f9f8 req-5d3f23f3-a4f7-4dc7-8982-6227339ecf93 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received unexpected event network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 for instance with vm_state active and task_state rescuing.
Aug 27 06:55:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e94c0107d1099fb6a3bd29951c3382e0c8ff97d3.part /opt/stack/data/nova/instances/_base/e94c0107d1099fb6a3bd29951c3382e0c8ff97d3.converted" returned: 0 in 0.561s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e94c0107d1099fb6a3bd29951c3382e0c8ff97d3.converted --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.661s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:37 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Deleted allocations for instance b22b7599-5a37-4370-b440-f04e3dc88f98
Aug 27 06:55:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e94c0107d1099fb6a3bd29951c3382e0c8ff97d3.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "e94c0107d1099fb6a3bd29951c3382e0c8ff97d3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.245s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "e94c0107d1099fb6a3bd29951c3382e0c8ff97d3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "e94c0107d1099fb6a3bd29951c3382e0c8ff97d3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e94c0107d1099fb6a3bd29951c3382e0c8ff97d3 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3b0d94b7-1289-41ba-8e42-d2424c23f3cf tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "b22b7599-5a37-4370-b440-f04e3dc88f98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.647s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e94c0107d1099fb6a3bd29951c3382e0c8ff97d3 --force-share --output=json" returned: 0 in 0.197s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e94c0107d1099fb6a3bd29951c3382e0c8ff97d3,backing_fmt=raw /opt/stack/data/nova/instances/a296fb1e-1999-475c-9a15-eeeedfa11247/disk.rescue {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e94c0107d1099fb6a3bd29951c3382e0c8ff97d3,backing_fmt=raw /opt/stack/data/nova/instances/a296fb1e-1999-475c-9a15-eeeedfa11247/disk.rescue" returned: 0 in 0.062s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "e94c0107d1099fb6a3bd29951c3382e0c8ff97d3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG nova.objects.instance [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'migration_context' on Instance uuid a296fb1e-1999-475c-9a15-eeeedfa11247 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG nova.objects.base [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Object Instance<a296fb1e-1999-475c-9a15-eeeedfa11247> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Start _get_guest_xml network_info=[{"id": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "address": "fa:16:3e:dd:b3:4a", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "vif_mac": "fa:16:3e:dd:b3:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8b8c03-b3", "ovs_interfaceid": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0ff071ba-3238-46a6-a699-e77672b28002', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvqxKAsl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'a296fb1e-1999-475c-9a15-eeeedfa11247', 'attached_at': '', 'detached_at': '', 'volume_id': '72986f09-60ad-4b9d-b257-813afd12e5d8', 'serial': '72986f09-60ad-4b9d-b257-813afd12e5d8'}, 'attachment_id': '9d01d1c7-a30b-4e14-b4fb-5f56b5caa030', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG nova.objects.instance [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'resources' on Instance uuid a296fb1e-1999-475c-9a15-eeeedfa11247 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG nova.objects.base [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Object Instance<a296fb1e-1999-475c-9a15-eeeedfa11247> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:55:37 user nova-compute[73258]: DEBUG nova.objects.instance [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'numa_topology' on Instance uuid a296fb1e-1999-475c-9a15-eeeedfa11247 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.objects.base [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Object Instance<a296fb1e-1999-475c-9a15-eeeedfa11247> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:55:38 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:55:38 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.objects.instance [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'vcpu_model' on Instance uuid a296fb1e-1999-475c-9a15-eeeedfa11247 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.objects.base [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Object Instance<a296fb1e-1999-475c-9a15-eeeedfa11247> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvqxKAsl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:55:38 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:55:38 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:55:38 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[13802eb7-602f-4fd7-a187-ae08f208a3c1]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = GvqxKAsl\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 27 06:55:38 user nova-compute[73258]: node.name = iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8
Aug 27 06:55:38 user nova-compute[73258]: node.tpgt = -1
Aug 27 06:55:38 user nova-compute[73258]: node.startup = automatic
Aug 27 06:55:38 user nova-compute[73258]: node.leading_login = No
Aug 27 06:55:38 user nova-compute[73258]: iface.iscsi_ifacename = default
Aug 27 06:55:38 user nova-compute[73258]: iface.net_ifacename = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.ipaddress = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.prefix_len = 0
Aug 27 06:55:38 user nova-compute[73258]: iface.hwaddress = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.transport_name = tcp
Aug 27 06:55:38 user nova-compute[73258]: iface.initiatorname = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.state = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.vlan_id = 0
Aug 27 06:55:38 user nova-compute[73258]: iface.vlan_priority = 0
Aug 27 06:55:38 user nova-compute[73258]: iface.vlan_state = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.iface_num = 0
Aug 27 06:55:38 user nova-compute[73258]: iface.mtu = 0
Aug 27 06:55:38 user nova-compute[73258]: iface.port = 0
Aug 27 06:55:38 user nova-compute[73258]: iface.bootproto = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.subnet_mask = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.gateway = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.dhcp_alt_client_id_state = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.dhcp_alt_client_id = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.dhcp_dns = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.dhcp_learn_iqn = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.dhcp_req_vendor_id_state = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.dhcp_vendor_id_state = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.dhcp_vendor_id = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.dhcp_slp_da = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.fragmentation = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.gratuitous_arp = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.incoming_forwarding = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.tos_state = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.tos = 0
Aug 27 06:55:38 user nova-compute[73258]: iface.ttl = 0
Aug 27 06:55:38 user nova-compute[73258]: iface.delayed_ack = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.tcp_nagle = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.tcp_wsf_state = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.tcp_wsf = 0
Aug 27 06:55:38 user nova-compute[73258]: iface.tcp_timer_scale = 0
Aug 27 06:55:38 user nova-compute[73258]: iface.tcp_timestamp = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.redirect = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.def_task_mgmt_timeout = 0
Aug 27 06:55:38 user nova-compute[73258]: iface.header_digest = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.data_digest = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.immediate_data = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.initial_r2t = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.data_seq_inorder = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.data_pdu_inorder = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.erl = 0
Aug 27 06:55:38 user nova-compute[73258]: iface.max_receive_data_len = 0
Aug 27 06:55:38 user nova-compute[73258]: iface.first_burst_len = 0
Aug 27 06:55:38 user nova-compute[73258]: iface.max_outstanding_r2t = 0
Aug 27 06:55:38 user nova-compute[73258]: iface.max_burst_len = 0
Aug 27 06:55:38 user nova-compute[73258]: iface.chap_auth = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.bidi_chap = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.strict_login_compliance = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.discovery_auth = <empty>
Aug 27 06:55:38 user nova-compute[73258]: iface.discovery_logout = <empty>
Aug 27 06:55:38 user nova-compute[73258]: node.discovery_address = <empty>
Aug 27 06:55:38 user nova-compute[73258]: node.discovery_port = 0
Aug 27 06:55:38 user nova-compute[73258]: node.discovery_type = static
Aug 27 06:55:38 user nova-compute[73258]: node.session.initial_cmdsn = 0
Aug 27 06:55:38 user nova-compute[73258]: node.session.initial_login_retry_max = 8
Aug 27 06:55:38 user nova-compute[73258]: node.session.xmit_thread_priority = -20
Aug 27 06:55:38 user nova-compute[73258]: node.session.cmds_max = 128
Aug 27 06:55:38 user nova-compute[73258]: node.session.queue_depth = 32
Aug 27 06:55:38 user nova-compute[73258]: node.session.nr_sessions = 1
Aug 27 06:55:38 user nova-compute[73258]: node.session.auth.authmethod = CHAP
Aug 27 06:55:38 user nova-compute[73258]: node.session.auth.username = GvqxKAsl
Aug 27 06:55:38 user nova-compute[73258]: node.session.auth.password = ***
Aug 27 06:55:38 user nova-compute[73258]: node.session.auth.username_in = <empty>
Aug 27 06:55:38 user nova-compute[73258]: node.session.auth.password_in = <empty>
Aug 27 06:55:38 user nova-compute[73258]: node.session.auth.chap_algs = MD5
Aug 27 06:55:38 user nova-compute[73258]: node.session.timeo.replacement_timeout = 120
Aug 27 06:55:38 user nova-compute[73258]: node.session.err_timeo.abort_timeout = 15
Aug 27 06:55:38 user nova-compute[73258]: node.session.err_timeo.lu_reset_timeout = 30
Aug 27 06:55:38 user nova-compute[73258]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 27 06:55:38 user nova-compute[73258]: node.session.err_timeo.host_reset_timeout = 60
Aug 27 06:55:38 user nova-compute[73258]: node.session.iscsi.FastAbort = Yes
Aug 27 06:55:38 user nova-compute[73258]: node.session.iscsi.InitialR2T = No
Aug 27 06:55:38 user nova-compute[73258]: node.session.iscsi.ImmediateData = Yes
Aug 27 06:55:38 user nova-compute[73258]: node.session.iscsi.FirstBurstLength = 262144
Aug 27 06:55:38 user nova-compute[73258]: node.session.iscsi.MaxBurstLength = 16776192
Aug 27 06:55:38 user nova-compute[73258]: node.session.iscsi.DefaultTime2Retain = 0
Aug 27 06:55:38 user nova-compute[73258]: node.session.iscsi.DefaultTime2Wait = 2
Aug 27 06:55:38 user nova-compute[73258]: node.session.iscsi.MaxConnections = 1
Aug 27 06:55:38 user nova-compute[73258]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 27 06:55:38 user nova-compute[73258]: node.session.iscsi.ERL = 0
Aug 27 06:55:38 user nova-compute[73258]: node.session.scan = manual
Aug 27 06:55:38 user nova-compute[73258]: node.session.reopen_max = 0
Aug 27 06:55:38 user nova-compute[73258]: node.conn[0].address = 172.16.0.220
Aug 27 06:55:38 user nova-compute[73258]: node.conn[0].port = 3260
Aug 27 06:55:38 user nova-compute[73258]: node.conn[0].startup = manual
Aug 27 06:55:38 user nova-compute[73258]: node.conn[0].tcp.window_size = 524288
Aug 27 06:55:38 user nova-compute[73258]: node.conn[0].tcp.type_of_service = 0
Aug 27 06:55:38 user nova-compute[73258]: node.conn[0].timeo.logout_timeout = 15
Aug 27 06:55:38 user nova-compute[73258]: node.conn[0].timeo.login_timeout = 15
Aug 27 06:55:38 user nova-compute[73258]: node.conn[0].timeo.auth_timeout = 45
Aug 27 06:55:38 user nova-compute[73258]: node.conn[0].timeo.noop_out_interval = 5
Aug 27 06:55:38 user nova-compute[73258]: node.conn[0].timeo.noop_out_timeout = 5
Aug 27 06:55:38 user nova-compute[73258]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 27 06:55:38 user nova-compute[73258]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 27 06:55:38 user nova-compute[73258]: node.conn[0].iscsi.HeaderDigest = None
Aug 27 06:55:38 user nova-compute[73258]: node.conn[0].iscsi.DataDigest = None
Aug 27 06:55:38 user nova-compute[73258]: node.conn[0].iscsi.IFMarker = No
Aug 27 06:55:38 user nova-compute[73258]: node.conn[0].iscsi.OFMarker = No
Aug 27 06:55:38 user nova-compute[73258]: # END RECORD
Aug 27 06:55:38 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4061b6-295f-4687-bccc-3347930fc0cc]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3796e2a8-a55e-4e45-a962-78b8539d65ec]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GvqxKAsl {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GvqxKAsl" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8fe5fd-e085-4e7b-91a3-ee8ee7ff2b77]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GvqxKAsl'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[78588489-e978-4256-9593-627193e15ce0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2341c1-8f45-4e10-9c48-90dfb874e57f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:55:38 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:55:38 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:55:38 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:55:38 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:55:38 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:55:38 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.165s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] HCTL ('37', '0', '0', 0) found on session 38 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[01aa22d8-96a4-440b-be45-d7af9dc9071f]: (4, ('0 0 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Searching for a device in session 38 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvqxKAsl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.196s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '26165643738333831', 'path': '/dev/sdf'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165643738333831', 'path': '/dev/sdf'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1066864047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1066864047',id=38,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:54:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81cf34590d8d4b8b89b9626c6e150df6',ramdisk_id='',reservation_id='r-psnz6f1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:54:21Z,user_data=None,user_id='36c0faed29a446aa9fa6ff8692581aba',uuid=a296fb1e-1999-475c-9a15-eeeedfa11247,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "address": "fa:16:3e:dd:b3:4a", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "vif_mac": "fa:16:3e:dd:b3:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8b8c03-b3", "ovs_interfaceid": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converting VIF {"id": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "address": "fa:16:3e:dd:b3:4a", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "vif_mac": "fa:16:3e:dd:b3:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8b8c03-b3", "ovs_interfaceid": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:b3:4a,bridge_name='br-int',has_traffic_filtering=True,id=ae8b8c03-b302-4043-ac07-b3561b7bf6f3,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8b8c03-b3') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.objects.instance [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'pci_devices' on Instance uuid a296fb1e-1999-475c-9a15-eeeedfa11247 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.objects.base [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Object Instance<a296fb1e-1999-475c-9a15-eeeedfa11247> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:55:38 user nova-compute[73258]:   <uuid>a296fb1e-1999-475c-9a15-eeeedfa11247</uuid>
Aug 27 06:55:38 user nova-compute[73258]:   <name>instance-00000026</name>
Aug 27 06:55:38 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:55:38 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:55:38 user nova-compute[73258]:   <metadata>
Aug 27 06:55:38 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:55:38 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:55:38 user nova-compute[73258]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1066864047</nova:name>
Aug 27 06:55:38 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:55:38</nova:creationTime>
Aug 27 06:55:38 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:55:38 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:55:38 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:55:38 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:55:38 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:55:38 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:55:38 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:55:38 user nova-compute[73258]:       <nova:owner>
Aug 27 06:55:38 user nova-compute[73258]:         <nova:user uuid="36c0faed29a446aa9fa6ff8692581aba">tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member</nova:user>
Aug 27 06:55:38 user nova-compute[73258]:         <nova:project uuid="81cf34590d8d4b8b89b9626c6e150df6">tempest-ServerBootFromVolumeStableRescueTest-1306655557</nova:project>
Aug 27 06:55:38 user nova-compute[73258]:       </nova:owner>
Aug 27 06:55:38 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:55:38 user nova-compute[73258]:       <nova:ports>
Aug 27 06:55:38 user nova-compute[73258]:         <nova:port uuid="ae8b8c03-b302-4043-ac07-b3561b7bf6f3">
Aug 27 06:55:38 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 06:55:38 user nova-compute[73258]:         </nova:port>
Aug 27 06:55:38 user nova-compute[73258]:       </nova:ports>
Aug 27 06:55:38 user nova-compute[73258]:     </nova:instance>
Aug 27 06:55:38 user nova-compute[73258]:   </metadata>
Aug 27 06:55:38 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:55:38 user nova-compute[73258]:     <system>
Aug 27 06:55:38 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:55:38 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:55:38 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:55:38 user nova-compute[73258]:       <entry name="serial">a296fb1e-1999-475c-9a15-eeeedfa11247</entry>
Aug 27 06:55:38 user nova-compute[73258]:       <entry name="uuid">a296fb1e-1999-475c-9a15-eeeedfa11247</entry>
Aug 27 06:55:38 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:55:38 user nova-compute[73258]:     </system>
Aug 27 06:55:38 user nova-compute[73258]:   </sysinfo>
Aug 27 06:55:38 user nova-compute[73258]:   <os>
Aug 27 06:55:38 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:55:38 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:55:38 user nova-compute[73258]:   </os>
Aug 27 06:55:38 user nova-compute[73258]:   <features>
Aug 27 06:55:38 user nova-compute[73258]:     <acpi/>
Aug 27 06:55:38 user nova-compute[73258]:     <apic/>
Aug 27 06:55:38 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:55:38 user nova-compute[73258]:   </features>
Aug 27 06:55:38 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:55:38 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:55:38 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:55:38 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:55:38 user nova-compute[73258]:   </clock>
Aug 27 06:55:38 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:55:38 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:55:38 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:55:38 user nova-compute[73258]:   </cpu>
Aug 27 06:55:38 user nova-compute[73258]:   <devices>
Aug 27 06:55:38 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:55:38 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:55:38 user nova-compute[73258]:       <source dev="/dev/sdf"/>
Aug 27 06:55:38 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:55:38 user nova-compute[73258]:       <serial>72986f09-60ad-4b9d-b257-813afd12e5d8</serial>
Aug 27 06:55:38 user nova-compute[73258]:     </disk>
Aug 27 06:55:38 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:55:38 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:55:38 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/a296fb1e-1999-475c-9a15-eeeedfa11247/disk.rescue"/>
Aug 27 06:55:38 user nova-compute[73258]:       <target dev="vdb" bus="virtio"/>
Aug 27 06:55:38 user nova-compute[73258]:       <boot order="1"/>
Aug 27 06:55:38 user nova-compute[73258]:     </disk>
Aug 27 06:55:38 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:55:38 user nova-compute[73258]:       <mac address="fa:16:3e:dd:b3:4a"/>
Aug 27 06:55:38 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:55:38 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:55:38 user nova-compute[73258]:       <target dev="tapae8b8c03-b3"/>
Aug 27 06:55:38 user nova-compute[73258]:     </interface>
Aug 27 06:55:38 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:55:38 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/a296fb1e-1999-475c-9a15-eeeedfa11247/console.log" append="off"/>
Aug 27 06:55:38 user nova-compute[73258]:     </serial>
Aug 27 06:55:38 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:55:38 user nova-compute[73258]:     <video>
Aug 27 06:55:38 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:55:38 user nova-compute[73258]:     </video>
Aug 27 06:55:38 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:55:38 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:55:38 user nova-compute[73258]:     </rng>
Aug 27 06:55:38 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:55:38 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:55:38 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:55:38 user nova-compute[73258]:     </memballoon>
Aug 27 06:55:38 user nova-compute[73258]:   </devices>
Aug 27 06:55:38 user nova-compute[73258]: </domain>
Aug 27 06:55:38 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:55:38 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Instance destroyed successfully.
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:55:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] No VIF found with MAC fa:16:3e:dd:b3:4a, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:55:39 user nova-compute[73258]: DEBUG nova.compute.manager [req-11b2e189-5630-4055-8127-4606204373d0 req-ee3bdeec-ffd8-4e19-9ffd-aca96b52ffc2 service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Received event network-changed-6eec761c-f898-4839-ad70-aa9d7ac1a525 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:55:39 user nova-compute[73258]: DEBUG nova.compute.manager [req-11b2e189-5630-4055-8127-4606204373d0 req-ee3bdeec-ffd8-4e19-9ffd-aca96b52ffc2 service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Refreshing instance network info cache due to event network-changed-6eec761c-f898-4839-ad70-aa9d7ac1a525. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:55:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-11b2e189-5630-4055-8127-4606204373d0 req-ee3bdeec-ffd8-4e19-9ffd-aca96b52ffc2 service nova] Acquiring lock "refresh_cache-0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:55:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-11b2e189-5630-4055-8127-4606204373d0 req-ee3bdeec-ffd8-4e19-9ffd-aca96b52ffc2 service nova] Acquired lock "refresh_cache-0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:55:39 user nova-compute[73258]: DEBUG nova.network.neutron [req-11b2e189-5630-4055-8127-4606204373d0 req-ee3bdeec-ffd8-4e19-9ffd-aca96b52ffc2 service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Refreshing network info cache for port 6eec761c-f898-4839-ad70-aa9d7ac1a525 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:55:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:39 user nova-compute[73258]: DEBUG nova.network.neutron [req-11b2e189-5630-4055-8127-4606204373d0 req-ee3bdeec-ffd8-4e19-9ffd-aca96b52ffc2 service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Updated VIF entry in instance network info cache for port 6eec761c-f898-4839-ad70-aa9d7ac1a525. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:55:39 user nova-compute[73258]: DEBUG nova.network.neutron [req-11b2e189-5630-4055-8127-4606204373d0 req-ee3bdeec-ffd8-4e19-9ffd-aca96b52ffc2 service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Updating instance_info_cache with network_info: [{"id": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "address": "fa:16:3e:42:89:97", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eec761c-f8", "ovs_interfaceid": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:55:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-11b2e189-5630-4055-8127-4606204373d0 req-ee3bdeec-ffd8-4e19-9ffd-aca96b52ffc2 service nova] Releasing lock "refresh_cache-0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:55:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:41 user nova-compute[73258]: DEBUG nova.compute.manager [req-ebb16157-01af-48ac-ae4c-432878dd5fad req-ebe4dc26-f9a6-4ced-b165-a35002a801a6 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received event network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:55:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ebb16157-01af-48ac-ae4c-432878dd5fad req-ebe4dc26-f9a6-4ced-b165-a35002a801a6 service nova] Acquiring lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ebb16157-01af-48ac-ae4c-432878dd5fad req-ebe4dc26-f9a6-4ced-b165-a35002a801a6 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ebb16157-01af-48ac-ae4c-432878dd5fad req-ebe4dc26-f9a6-4ced-b165-a35002a801a6 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:41 user nova-compute[73258]: DEBUG nova.compute.manager [req-ebb16157-01af-48ac-ae4c-432878dd5fad req-ebe4dc26-f9a6-4ced-b165-a35002a801a6 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] No waiting events found dispatching network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:55:41 user nova-compute[73258]: WARNING nova.compute.manager [req-ebb16157-01af-48ac-ae4c-432878dd5fad req-ebe4dc26-f9a6-4ced-b165-a35002a801a6 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received unexpected event network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 for instance with vm_state active and task_state rescuing.
Aug 27 06:55:41 user nova-compute[73258]: DEBUG nova.compute.manager [req-ebb16157-01af-48ac-ae4c-432878dd5fad req-ebe4dc26-f9a6-4ced-b165-a35002a801a6 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received event network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:55:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ebb16157-01af-48ac-ae4c-432878dd5fad req-ebe4dc26-f9a6-4ced-b165-a35002a801a6 service nova] Acquiring lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ebb16157-01af-48ac-ae4c-432878dd5fad req-ebe4dc26-f9a6-4ced-b165-a35002a801a6 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ebb16157-01af-48ac-ae4c-432878dd5fad req-ebe4dc26-f9a6-4ced-b165-a35002a801a6 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:41 user nova-compute[73258]: DEBUG nova.compute.manager [req-ebb16157-01af-48ac-ae4c-432878dd5fad req-ebe4dc26-f9a6-4ced-b165-a35002a801a6 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] No waiting events found dispatching network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:55:41 user nova-compute[73258]: WARNING nova.compute.manager [req-ebb16157-01af-48ac-ae4c-432878dd5fad req-ebe4dc26-f9a6-4ced-b165-a35002a801a6 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received unexpected event network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 for instance with vm_state active and task_state rescuing.
Aug 27 06:55:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Removed pending event for a296fb1e-1999-475c-9a15-eeeedfa11247 due to event {{(pid=73258) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 06:55:42 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119342.3951032, a296fb1e-1999-475c-9a15-eeeedfa11247 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:55:42 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] VM Resumed (Lifecycle Event)
Aug 27 06:55:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6082e4f9-da56-47ca-8770-f874c3ea9d9c tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:55:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:55:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:55:42 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 06:55:42 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119342.395451, a296fb1e-1999-475c-9a15-eeeedfa11247 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:55:42 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] VM Started (Lifecycle Event)
Aug 27 06:55:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:55:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:55:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:43 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'flavor' on Instance uuid 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:55:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:44 user nova-compute[73258]: INFO nova.compute.manager [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Attaching volume e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 to /dev/vdb
Aug 27 06:55:44 user nova-compute[73258]: DEBUG os_brick.utils [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c9ebb5-32e0-41ca-b490-93b0439e9dd3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dffc89-190b-4aa3-b988-380103726c73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2ecf88-4df2-402c-8706-ceef7413d86f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fe4096-3090-43b5-af16-65a02afe8fd5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:55:44 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:55:44 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f278fa-a0c9-4224-b15a-7f66a47d2cc2]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG os_brick.utils [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Updating existing volume attachment record: 7af72e9e-b5bf-49f2-a6a5-352eeda39181 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:55:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:46 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119331.0887265, 0c16951e-8620-493f-8af4-fbdc64e1c131 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:55:46 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] VM Stopped (Lifecycle Event)
Aug 27 06:55:46 user nova-compute[73258]: DEBUG nova.compute.manager [None req-87668a63-2197-4b91-a909-e9bf238d015e None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:55:47 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:55:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:55:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:55:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:55:47 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:55:48 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Updating instance_info_cache with network_info: [{"id": "217b1702-a403-4f3a-bdae-7793382e5f38", "address": "fa:16:3e:5d:4e:76", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217b1702-a4", "ovs_interfaceid": "217b1702-a403-4f3a-bdae-7793382e5f38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:55:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-1672aa9f-be6f-4357-877f-a48f62119df4" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:55:48 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:55:48 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:55:48 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:55:49 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119334.01944, b22b7599-5a37-4370-b440-f04e3dc88f98 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:55:49 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] VM Stopped (Lifecycle Event)
Aug 27 06:55:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-0330a5b2-a7ff-4b95-b755-6c5bf4d46704 None None] [instance: b22b7599-5a37-4370-b440-f04e3dc88f98] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:55:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:49 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:55:50 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:55:51 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:55:51 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:55:52 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:55:53 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:55:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiuIoady', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:55:57 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:55:57 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:55:57 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[949a0465-2935-4a73-bdbc-bf0bbcfb2156]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:55:57 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee43ddc8-5c83-41a4-b82b-88da55ad3422]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95] added
Aug 27 06:55:57 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa53acf-d0dc-451a-b1e8-8fd59b5b82c9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca859b7e-d41f-4d96-b587-43e0cba2873b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NiuIoady {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NiuIoady" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4d9449-bb67-47d1-84bf-0e3f0f01ac0e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NiuIoady'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5091e47e-1ae3-4a75-9abd-db8ef07b2d98]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ca431d-6e49-4c46-8d93-52ac76070a42]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:55:57 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:55:57 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:55:57 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:55:57 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:55:57 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:55:57 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[93179996-f6ea-43e2-9c7d-bcb48ec62f7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95, portal: 172.16.0.220,3260]
Aug 27 06:55:57 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95, portal: 172.16.0.220,3260] successful.
Aug 27 06:55:57 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0e0979-eb36-404e-9ffe-a32cd13d79e7]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47b17bd-2ac2-430b-b9f6-d6f0600cc2d1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:55:57 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:55:57 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:55:57 user nova-compute[73258]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 (non-flash)
Aug 27 06:55:57 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:55:57 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:55:57 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:55:57 user nova-compute[73258]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 (non-flash)
Aug 27 06:55:57 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b45ad1-97ff-40bf-8573-806771816bc3]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiuIoady', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:57 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:55:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:55:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26466666637333330', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:55:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466666637333330', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:55:58 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'flavor' on Instance uuid 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:55:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:55:59 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:55:59 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:55:59 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:55:59 user nova-compute[73258]:   <serial>e8f9b09a-5709-4dd0-a83a-a465d8eaaf95</serial>
Aug 27 06:55:59 user nova-compute[73258]: </disk>
Aug 27 06:55:59 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:55:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:55:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:55:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] No VIF found with MAC fa:16:3e:42:89:97, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:55:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:55:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:55:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a74d6406-f8a1-4575-b888-0af760db5d9a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.616s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:55:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:55:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:55:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a296fb1e-1999-475c-9a15-eeeedfa11247/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a296fb1e-1999-475c-9a15-eeeedfa11247/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a296fb1e-1999-475c-9a15-eeeedfa11247/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a296fb1e-1999-475c-9a15-eeeedfa11247/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:56:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:56:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:56:03 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:56:03 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:56:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=7026MB free_disk=23.605636596679688GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1672aa9f-be6f-4357-877f-a48f62119df4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a836678e-240d-4ead-b0b5-64d146910a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 7ee743f1-9611-4165-838e-54fccb332f1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance d409b021-ab98-4f9f-a80d-99fe05de7b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bc3cebb3-0e29-4899-94aa-d13a2a9ca86a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 01a9f7b2-805a-4ece-a29c-33ac0057cc9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a296fb1e-1999-475c-9a15-eeeedfa11247 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:56:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:56:04 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:56:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:04 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:56:04 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:56:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG nova.objects.instance [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'flavor' on Instance uuid 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:05 user nova-compute[73258]: INFO nova.compute.manager [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Attaching volume 83d28b37-7841-4a33-8b54-0133d1f7f191 to /dev/vdc
Aug 27 06:56:05 user nova-compute[73258]: DEBUG os_brick.utils [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[facb9f2e-4f67-4ccc-a84b-dadb42481ffb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1fba8f-d07c-487b-ada7-acdd7f47410e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5e03b5-0fc7-44bd-ae98-970adfc421b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[db257339-ae67-4dab-af25-723fd3b8896b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:56:05 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:56:05 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[184e1eed-6631-4887-b6a6-240a8ea619ed]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG os_brick.utils [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:56:05 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Updating existing volume attachment record: 8b10e286-e5a2-46b8-8280-01726646d890 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:56:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-8dbd6e7c-9eea-4645-964f-47e02fde935c req-47300daa-f3b0-48d3-acf4-f25291163caf service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Received event network-changed-ec3a771c-4248-4c68-ab25-763dda6741ea {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-8dbd6e7c-9eea-4645-964f-47e02fde935c req-47300daa-f3b0-48d3-acf4-f25291163caf service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Refreshing instance network info cache due to event network-changed-ec3a771c-4248-4c68-ab25-763dda6741ea. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:56:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8dbd6e7c-9eea-4645-964f-47e02fde935c req-47300daa-f3b0-48d3-acf4-f25291163caf service nova] Acquiring lock "refresh_cache-01a9f7b2-805a-4ece-a29c-33ac0057cc9b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:56:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8dbd6e7c-9eea-4645-964f-47e02fde935c req-47300daa-f3b0-48d3-acf4-f25291163caf service nova] Acquired lock "refresh_cache-01a9f7b2-805a-4ece-a29c-33ac0057cc9b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:56:13 user nova-compute[73258]: DEBUG nova.network.neutron [req-8dbd6e7c-9eea-4645-964f-47e02fde935c req-47300daa-f3b0-48d3-acf4-f25291163caf service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Refreshing network info cache for port ec3a771c-4248-4c68-ab25-763dda6741ea {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:56:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:13 user nova-compute[73258]: INFO nova.compute.manager [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Terminating instance
Aug 27 06:56:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:56:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG nova.network.neutron [req-8dbd6e7c-9eea-4645-964f-47e02fde935c req-47300daa-f3b0-48d3-acf4-f25291163caf service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Updated VIF entry in instance network info cache for port ec3a771c-4248-4c68-ab25-763dda6741ea. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG nova.network.neutron [req-8dbd6e7c-9eea-4645-964f-47e02fde935c req-47300daa-f3b0-48d3-acf4-f25291163caf service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Updating instance_info_cache with network_info: [{"id": "ec3a771c-4248-4c68-ab25-763dda6741ea", "address": "fa:16:3e:29:0d:42", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec3a771c-42", "ovs_interfaceid": "ec3a771c-4248-4c68-ab25-763dda6741ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG nova.compute.manager [req-0c6a74c1-9a82-4c97-b7cf-3def47d9fe02 req-a315795d-3e5f-41e5-a635-b14b4ad25888 service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Received event network-vif-unplugged-ec3a771c-4248-4c68-ab25-763dda6741ea {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0c6a74c1-9a82-4c97-b7cf-3def47d9fe02 req-a315795d-3e5f-41e5-a635-b14b4ad25888 service nova] Acquiring lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0c6a74c1-9a82-4c97-b7cf-3def47d9fe02 req-a315795d-3e5f-41e5-a635-b14b4ad25888 service nova] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0c6a74c1-9a82-4c97-b7cf-3def47d9fe02 req-a315795d-3e5f-41e5-a635-b14b4ad25888 service nova] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG nova.compute.manager [req-0c6a74c1-9a82-4c97-b7cf-3def47d9fe02 req-a315795d-3e5f-41e5-a635-b14b4ad25888 service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] No waiting events found dispatching network-vif-unplugged-ec3a771c-4248-4c68-ab25-763dda6741ea {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG nova.compute.manager [req-0c6a74c1-9a82-4c97-b7cf-3def47d9fe02 req-a315795d-3e5f-41e5-a635-b14b4ad25888 service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Received event network-vif-unplugged-ec3a771c-4248-4c68-ab25-763dda6741ea for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8dbd6e7c-9eea-4645-964f-47e02fde935c req-47300daa-f3b0-48d3-acf4-f25291163caf service nova] Releasing lock "refresh_cache-01a9f7b2-805a-4ece-a29c-33ac0057cc9b" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:56:14 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Instance destroyed successfully.
Aug 27 06:56:14 user nova-compute[73258]: DEBUG nova.objects.instance [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lazy-loading 'resources' on Instance uuid 01a9f7b2-805a-4ece-a29c-33ac0057cc9b {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-858831142',display_name='tempest-TestStampPattern-server-858831142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-858831142',id=36,image_ref='8abd7ee1-5a4a-495d-a692-665d88f59000',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwYZxibBAc2nvlcafNqnemngRCXIz90U4I2XLhwZXxc9YEXEO2YKFZ69eY+zmysXtc6kSJDnPSsSYt70Y3+IiQVuHG0DIaBJdVBu3sgT92WAEQ0yFaQ4/zUiXf3G0XH5w==',key_name='tempest-TestStampPattern-1276587428',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:53:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72f7bfc1fb284defb6f92a77be8821e5',ramdisk_id='',reservation_id='r-adtwpcqr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d409b021-ab98-4f9f-a80d-99fe05de7b69',image_min_disk='1',image_min_ram='0',image_owner_id='72f7bfc1fb284defb6f92a77be8821e5',image_owner_project_name='tempest-TestStampPattern-873602452',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-873602452-project-member',image_user_id='7c44464f6e84417cb8823d01c7aa669f',owner_project_name='tempest-TestStampPattern-873602452',owner_user_name='tempest-TestStampPattern-873602452-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:53:20Z,user_data=None,user_id='7c44464f6e84417cb8823d01c7aa669f',uuid=01a9f7b2-805a-4ece-a29c-33ac0057cc9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec3a771c-4248-4c68-ab25-763dda6741ea", "address": "fa:16:3e:29:0d:42", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec3a771c-42", "ovs_interfaceid": "ec3a771c-4248-4c68-ab25-763dda6741ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Converting VIF {"id": "ec3a771c-4248-4c68-ab25-763dda6741ea", "address": "fa:16:3e:29:0d:42", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec3a771c-42", "ovs_interfaceid": "ec3a771c-4248-4c68-ab25-763dda6741ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:0d:42,bridge_name='br-int',has_traffic_filtering=True,id=ec3a771c-4248-4c68-ab25-763dda6741ea,network=Network(d52cca87-60dc-45ab-b7fe-f5a26a33e0ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec3a771c-42') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG os_vif [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:0d:42,bridge_name='br-int',has_traffic_filtering=True,id=ec3a771c-4248-4c68-ab25-763dda6741ea,network=Network(d52cca87-60dc-45ab-b7fe-f5a26a33e0ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec3a771c-42') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec3a771c-42, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:56:14 user nova-compute[73258]: INFO os_vif [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:0d:42,bridge_name='br-int',has_traffic_filtering=True,id=ec3a771c-4248-4c68-ab25-763dda6741ea,network=Network(d52cca87-60dc-45ab-b7fe-f5a26a33e0ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec3a771c-42')
Aug 27 06:56:14 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Deleting instance files /opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b_del
Aug 27 06:56:14 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Deletion of /opt/stack/data/nova/instances/01a9f7b2-805a-4ece-a29c-33ac0057cc9b_del complete
Aug 27 06:56:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:14 user nova-compute[73258]: INFO nova.compute.manager [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Terminating instance
Aug 27 06:56:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:56:14 user nova-compute[73258]: INFO nova.compute.manager [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 27 06:56:14 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:15 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Instance destroyed successfully.
Aug 27 06:56:15 user nova-compute[73258]: DEBUG nova.objects.instance [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lazy-loading 'resources' on Instance uuid 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1407957058',display_name='tempest-ServerActionsTestOtherA-server-1407957058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1407957058',id=3,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/KYWUE6gNqqFSSqcTnsAI5+JZTptdXjLfwtgiVKLM8n2N6Y2L8s6Bg81l6XDxMjw3BfYNizv1BnMF+y6NIh1U/xVCMRNK16iGCh/62JzPGiCS6K24meGZJ+ETPM0mnhw==',key_name='tempest-keypair-1255305482',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:37:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57faf7cb6c704c05aba06857a6cdd29f',ramdisk_id='',reservation_id='r-v66hy8sm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1477462030',owner_user_name='tempest-ServerActionsTestOtherA-1477462030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:37:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67f8a06ab5634f60b6ed2d1d9b2c342e',uuid=75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "address": "fa:16:3e:82:0b:22", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f7670e-c9", "ovs_interfaceid": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converting VIF {"id": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "address": "fa:16:3e:82:0b:22", "network": {"id": "d37a7c2e-a864-4b6e-ab38-688d84bb6d5e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-519427619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57faf7cb6c704c05aba06857a6cdd29f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f7670e-c9", "ovs_interfaceid": "f2f7670e-c9a1-437f-8143-4f7cfc60a035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:0b:22,bridge_name='br-int',has_traffic_filtering=True,id=f2f7670e-c9a1-437f-8143-4f7cfc60a035,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f7670e-c9') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG os_vif [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:0b:22,bridge_name='br-int',has_traffic_filtering=True,id=f2f7670e-c9a1-437f-8143-4f7cfc60a035,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f7670e-c9') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2f7670e-c9, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:56:15 user nova-compute[73258]: INFO os_vif [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:0b:22,bridge_name='br-int',has_traffic_filtering=True,id=f2f7670e-c9a1-437f-8143-4f7cfc60a035,network=Network(d37a7c2e-a864-4b6e-ab38-688d84bb6d5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f7670e-c9')
Aug 27 06:56:15 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Deleting instance files /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc_del
Aug 27 06:56:15 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Deletion of /opt/stack/data/nova/instances/75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc_del complete
Aug 27 06:56:15 user nova-compute[73258]: INFO nova.compute.manager [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 27 06:56:15 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-33fdae27-7ecb-41b7-bfca-5db6d41baf55 req-7d0a62f9-7b79-4b27-8375-fe80a1abdebc service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Received event network-vif-unplugged-f2f7670e-c9a1-437f-8143-4f7cfc60a035 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-33fdae27-7ecb-41b7-bfca-5db6d41baf55 req-7d0a62f9-7b79-4b27-8375-fe80a1abdebc service nova] Acquiring lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-33fdae27-7ecb-41b7-bfca-5db6d41baf55 req-7d0a62f9-7b79-4b27-8375-fe80a1abdebc service nova] Lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-33fdae27-7ecb-41b7-bfca-5db6d41baf55 req-7d0a62f9-7b79-4b27-8375-fe80a1abdebc service nova] Lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-33fdae27-7ecb-41b7-bfca-5db6d41baf55 req-7d0a62f9-7b79-4b27-8375-fe80a1abdebc service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] No waiting events found dispatching network-vif-unplugged-f2f7670e-c9a1-437f-8143-4f7cfc60a035 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-33fdae27-7ecb-41b7-bfca-5db6d41baf55 req-7d0a62f9-7b79-4b27-8375-fe80a1abdebc service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Received event network-vif-unplugged-f2f7670e-c9a1-437f-8143-4f7cfc60a035 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-33fdae27-7ecb-41b7-bfca-5db6d41baf55 req-7d0a62f9-7b79-4b27-8375-fe80a1abdebc service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Received event network-vif-plugged-f2f7670e-c9a1-437f-8143-4f7cfc60a035 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-33fdae27-7ecb-41b7-bfca-5db6d41baf55 req-7d0a62f9-7b79-4b27-8375-fe80a1abdebc service nova] Acquiring lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-33fdae27-7ecb-41b7-bfca-5db6d41baf55 req-7d0a62f9-7b79-4b27-8375-fe80a1abdebc service nova] Lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-33fdae27-7ecb-41b7-bfca-5db6d41baf55 req-7d0a62f9-7b79-4b27-8375-fe80a1abdebc service nova] Lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-33fdae27-7ecb-41b7-bfca-5db6d41baf55 req-7d0a62f9-7b79-4b27-8375-fe80a1abdebc service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] No waiting events found dispatching network-vif-plugged-f2f7670e-c9a1-437f-8143-4f7cfc60a035 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:56:15 user nova-compute[73258]: WARNING nova.compute.manager [req-33fdae27-7ecb-41b7-bfca-5db6d41baf55 req-7d0a62f9-7b79-4b27-8375-fe80a1abdebc service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Received unexpected event network-vif-plugged-f2f7670e-c9a1-437f-8143-4f7cfc60a035 for instance with vm_state active and task_state deleting.
Aug 27 06:56:16 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:56:16 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Took 1.45 seconds to deallocate network for instance.
Aug 27 06:56:16 user nova-compute[73258]: DEBUG nova.compute.manager [req-8668b31f-3323-48e6-9a85-46f3a33c0a9c req-0e2b6e78-67e0-4f76-ad9a-1009adf75f47 service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Received event network-vif-deleted-ec3a771c-4248-4c68-ab25-763dda6741ea {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:16 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:56:16 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Took 0.80 seconds to deallocate network for instance.
Aug 27 06:56:16 user nova-compute[73258]: DEBUG nova.compute.manager [req-f2d6f6e5-9758-4024-b7f5-10e29187cebc req-2655ed35-1498-4ffc-9c24-d36c9bcca3a5 service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Received event network-vif-plugged-ec3a771c-4248-4c68-ab25-763dda6741ea {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f2d6f6e5-9758-4024-b7f5-10e29187cebc req-2655ed35-1498-4ffc-9c24-d36c9bcca3a5 service nova] Acquiring lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f2d6f6e5-9758-4024-b7f5-10e29187cebc req-2655ed35-1498-4ffc-9c24-d36c9bcca3a5 service nova] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f2d6f6e5-9758-4024-b7f5-10e29187cebc req-2655ed35-1498-4ffc-9c24-d36c9bcca3a5 service nova] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:16 user nova-compute[73258]: DEBUG nova.compute.manager [req-f2d6f6e5-9758-4024-b7f5-10e29187cebc req-2655ed35-1498-4ffc-9c24-d36c9bcca3a5 service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] No waiting events found dispatching network-vif-plugged-ec3a771c-4248-4c68-ab25-763dda6741ea {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:56:16 user nova-compute[73258]: WARNING nova.compute.manager [req-f2d6f6e5-9758-4024-b7f5-10e29187cebc req-2655ed35-1498-4ffc-9c24-d36c9bcca3a5 service nova] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Received unexpected event network-vif-plugged-ec3a771c-4248-4c68-ab25-763dda6741ea for instance with vm_state deleted and task_state None.
Aug 27 06:56:16 user nova-compute[73258]: DEBUG nova.compute.manager [req-f2d6f6e5-9758-4024-b7f5-10e29187cebc req-2655ed35-1498-4ffc-9c24-d36c9bcca3a5 service nova] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Received event network-vif-deleted-f2f7670e-c9a1-437f-8143-4f7cfc60a035 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:16 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:56:16 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:56:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.563s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.327s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:16 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Deleted allocations for instance 01a9f7b2-805a-4ece-a29c-33ac0057cc9b
Aug 27 06:56:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-03436fba-3e7c-495c-9f38-d2afa36d05ea tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "01a9f7b2-805a-4ece-a29c-33ac0057cc9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.185s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:17 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:56:17 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:56:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:17 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Deleted allocations for instance 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc
Aug 27 06:56:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-88caa81d-b425-46d8-a4ca-77678ea22812 tempest-ServerActionsTestOtherA-1477462030 tempest-ServerActionsTestOtherA-1477462030-project-member] Lock "75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.715s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:18 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:56:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEzHudUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:56:18 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:56:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:56:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:56:18 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:56:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:56:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:56:18 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:56:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:18 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[003af389-9d44-4a0b-871f-e961af735e57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:56:18 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:56:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1131c0ad-2b23-40f8-bc0a-806934e3a26c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191] added
Aug 27 06:56:19 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "d2edd67c-c877-4c45-ae13-ee5f82853066" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[206376b8-1da5-441c-bb55-6b93ed327f61]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[337d00f7-57e7-4111-8bad-9f9407f13f84]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZEzHudUX {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZEzHudUX" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0de0da-8057-4f2c-96d1-b45edd57d2e0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZEzHudUX'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[107fbfb8-932e-4ea4-b3b1-bbe84acfa332]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2b4b5f-89ba-48cc-a569-8299e10a7fe1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:56:19 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:56:19 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:56:19 user nova-compute[73258]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 (non-flash)
Aug 27 06:56:19 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:56:19 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:56:19 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:56:19 user nova-compute[73258]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 (non-flash)
Aug 27 06:56:19 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:56:19 user nova-compute[73258]: INFO nova.compute.claims [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Claim successful on node user
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f5c5ba-b943-4642-81d8-1b0685a82e71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191, portal: 172.16.0.220,3260]
Aug 27 06:56:19 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191, portal: 172.16.0.220,3260] successful.
Aug 27 06:56:19 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e128eb1f-c278-4bce-8aed-7cf865be2d12]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6875a2-ff07-4b13-9a5a-3c386a7a273e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:56:19 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:56:19 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:56:19 user nova-compute[73258]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 (non-flash)
Aug 27 06:56:19 user nova-compute[73258]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 (non-flash)
Aug 27 06:56:19 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:56:19 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:56:19 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:56:19 user nova-compute[73258]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 (non-flash)
Aug 27 06:56:19 user nova-compute[73258]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 (non-flash)
Aug 27 06:56:19 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebc50dc-c31e-44b6-877e-5566694f6895]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEzHudUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG nova.network.neutron [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:56:19 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:56:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG nova.policy [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8de65612a05142ebb509012c126b89b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f6a09d79c43c282e56cfda50001d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:56:19 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Creating image(s)
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "/opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "/opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "a3c6377784db6f7ca6e26fcd2fda1f5154f43a21" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "a3c6377784db6f7ca6e26fcd2fda1f5154f43a21" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21.part --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:56:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23464363731303138', 'path': '/dev/sdc'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:56:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464363731303138', 'path': '/dev/sdc'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:56:20 user nova-compute[73258]: DEBUG nova.objects.instance [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'flavor' on Instance uuid 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:56:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:56:20 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:56:20 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 06:56:20 user nova-compute[73258]:   <target dev="vdc" bus="virtio"/>
Aug 27 06:56:20 user nova-compute[73258]:   <serial>83d28b37-7841-4a33-8b54-0133d1f7f191</serial>
Aug 27 06:56:20 user nova-compute[73258]: </disk>
Aug 27 06:56:20 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:56:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21.part --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:20 user nova-compute[73258]: DEBUG nova.virt.images [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] 219587c8-b0ee-47ab-aa54-8b2d42fe9b89 was qcow2, converting to raw {{(pid=73258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 06:56:20 user nova-compute[73258]: DEBUG nova.privsep.utils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 06:56:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21.part /opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21.converted {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:20 user nova-compute[73258]: DEBUG nova.network.neutron [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Successfully created port: 9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:56:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:56:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:56:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:56:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] No VIF found with MAC fa:16:3e:42:89:97, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:56:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21.part /opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21.converted" returned: 0 in 0.487s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21.converted --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "a3c6377784db6f7ca6e26fcd2fda1f5154f43a21" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.298s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-19119f52-38b9-44d8-ad76-bb095b73a444 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.917s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21 --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "a3c6377784db6f7ca6e26fcd2fda1f5154f43a21" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "a3c6377784db6f7ca6e26fcd2fda1f5154f43a21" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21 --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21,backing_fmt=raw /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG nova.network.neutron [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Successfully updated port: 9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG nova.compute.manager [req-c199f14b-2a9e-4b46-93e7-f78b574b9a74 req-e6014c11-4d32-44d3-98d9-c22eb50debe4 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received event network-changed-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG nova.compute.manager [req-c199f14b-2a9e-4b46-93e7-f78b574b9a74 req-e6014c11-4d32-44d3-98d9-c22eb50debe4 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Refreshing instance network info cache due to event network-changed-9e55f50f-3335-4d20-b9ca-5e497b226d95. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c199f14b-2a9e-4b46-93e7-f78b574b9a74 req-e6014c11-4d32-44d3-98d9-c22eb50debe4 service nova] Acquiring lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c199f14b-2a9e-4b46-93e7-f78b574b9a74 req-e6014c11-4d32-44d3-98d9-c22eb50debe4 service nova] Acquired lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG nova.network.neutron [req-c199f14b-2a9e-4b46-93e7-f78b574b9a74 req-e6014c11-4d32-44d3-98d9-c22eb50debe4 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Refreshing network info cache for port 9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG nova.network.neutron [req-c199f14b-2a9e-4b46-93e7-f78b574b9a74 req-e6014c11-4d32-44d3-98d9-c22eb50debe4 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21,backing_fmt=raw /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk 1073741824" returned: 0 in 0.208s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "a3c6377784db6f7ca6e26fcd2fda1f5154f43a21" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.401s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21 --force-share --output=json" returned: 0 in 0.198s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:56:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.network.neutron [req-c199f14b-2a9e-4b46-93e7-f78b574b9a74 req-e6014c11-4d32-44d3-98d9-c22eb50debe4 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c199f14b-2a9e-4b46-93e7-f78b574b9a74 req-e6014c11-4d32-44d3-98d9-c22eb50debe4 service nova] Releasing lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquired lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.network.neutron [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:22 user nova-compute[73258]: INFO nova.compute.manager [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Detaching volume e8f9b09a-5709-4dd0-a83a-a465d8eaaf95
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.network.neutron [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Cannot resize image /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Ensure instance console log exists: /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:22 user nova-compute[73258]: INFO nova.virt.block_device [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Attempting to driver detach volume e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 from mountpoint /dev/vdb
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Attempting to detach device vdb from instance 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:56:22 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:56:22 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:56:22 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:56:22 user nova-compute[73258]:   <serial>e8f9b09a-5709-4dd0-a83a-a465d8eaaf95</serial>
Aug 27 06:56:22 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:56:22 user nova-compute[73258]: </disk>
Aug 27 06:56:22 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:56:22 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Successfully detached device vdb from instance 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 from the persistent domain config.
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:56:22 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:56:22 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:56:22 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:56:22 user nova-compute[73258]:   <serial>e8f9b09a-5709-4dd0-a83a-a465d8eaaf95</serial>
Aug 27 06:56:22 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:56:22 user nova-compute[73258]: </disk>
Aug 27 06:56:22 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.network.neutron [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Updating instance_info_cache with network_info: [{"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Releasing lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Instance network_info: |[{"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Start _get_guest_xml network_info=[{"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:56:16Z,direct_url=<?>,disk_format='qcow2',id=219587c8-b0ee-47ab-aa54-8b2d42fe9b89,min_disk=0,min_ram=0,name='tempest-scenario-img--760790181',owner='b34f6a09d79c43c282e56cfda50001d7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:56:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '219587c8-b0ee-47ab-aa54-8b2d42fe9b89'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:56:22 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:56:22 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:56:16Z,direct_url=<?>,disk_format='qcow2',id=219587c8-b0ee-47ab-aa54-8b2d42fe9b89,min_disk=0,min_ram=0,name='tempest-scenario-img--760790181',owner='b34f6a09d79c43c282e56cfda50001d7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:56:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:56:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-230825290',display_name='tempest-TestMinimumBasicScenario-server-230825290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-230825290',id=41,image_ref='219587c8-b0ee-47ab-aa54-8b2d42fe9b89',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuoVS0M13jEH/jCiVKamjqoQl7T8gy6Y61js/cVhfSR87vdnvOrLJ2jnn3eqtAAM6GxfvMPwc5M3rsN5ROIABUb6JurY5u9Lbvzo4Cmo0ps1r74VIpsNxuNj3rC3V5Nvw==',key_name='tempest-TestMinimumBasicScenario-1377282219',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b34f6a09d79c43c282e56cfda50001d7',ramdisk_id='',reservation_id='r-zqr6he04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='219587c8-b0ee-47ab-aa54-8b2d42fe9b89',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1509066975',owner_user_name='tempest-TestMinimumBasicScenario-1509066975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:56:20Z,user_data=None,user_id='8de65612a05142ebb509012c126b89b0',uuid=d2edd67c-c877-4c45-ae13-ee5f82853066,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Converting VIF {"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f3:ab,bridge_name='br-int',has_traffic_filtering=True,id=9e55f50f-3335-4d20-b9ca-5e497b226d95,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e55f50f-33') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.objects.instance [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lazy-loading 'pci_devices' on Instance uuid d2edd67c-c877-4c45-ae13-ee5f82853066 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:56:22 user nova-compute[73258]:   <uuid>d2edd67c-c877-4c45-ae13-ee5f82853066</uuid>
Aug 27 06:56:22 user nova-compute[73258]:   <name>instance-00000029</name>
Aug 27 06:56:22 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:56:22 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:56:22 user nova-compute[73258]:   <metadata>
Aug 27 06:56:22 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:56:22 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:56:22 user nova-compute[73258]:       <nova:name>tempest-TestMinimumBasicScenario-server-230825290</nova:name>
Aug 27 06:56:22 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:56:22</nova:creationTime>
Aug 27 06:56:22 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:56:22 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:56:22 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:56:22 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:56:22 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:56:22 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:56:22 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:56:22 user nova-compute[73258]:       <nova:owner>
Aug 27 06:56:22 user nova-compute[73258]:         <nova:user uuid="8de65612a05142ebb509012c126b89b0">tempest-TestMinimumBasicScenario-1509066975-project-member</nova:user>
Aug 27 06:56:22 user nova-compute[73258]:         <nova:project uuid="b34f6a09d79c43c282e56cfda50001d7">tempest-TestMinimumBasicScenario-1509066975</nova:project>
Aug 27 06:56:22 user nova-compute[73258]:       </nova:owner>
Aug 27 06:56:22 user nova-compute[73258]:       <nova:root type="image" uuid="219587c8-b0ee-47ab-aa54-8b2d42fe9b89"/>
Aug 27 06:56:22 user nova-compute[73258]:       <nova:ports>
Aug 27 06:56:22 user nova-compute[73258]:         <nova:port uuid="9e55f50f-3335-4d20-b9ca-5e497b226d95">
Aug 27 06:56:22 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 06:56:22 user nova-compute[73258]:         </nova:port>
Aug 27 06:56:22 user nova-compute[73258]:       </nova:ports>
Aug 27 06:56:22 user nova-compute[73258]:     </nova:instance>
Aug 27 06:56:22 user nova-compute[73258]:   </metadata>
Aug 27 06:56:22 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:56:22 user nova-compute[73258]:     <system>
Aug 27 06:56:22 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:56:22 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:56:22 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:56:22 user nova-compute[73258]:       <entry name="serial">d2edd67c-c877-4c45-ae13-ee5f82853066</entry>
Aug 27 06:56:22 user nova-compute[73258]:       <entry name="uuid">d2edd67c-c877-4c45-ae13-ee5f82853066</entry>
Aug 27 06:56:22 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:56:22 user nova-compute[73258]:     </system>
Aug 27 06:56:22 user nova-compute[73258]:   </sysinfo>
Aug 27 06:56:22 user nova-compute[73258]:   <os>
Aug 27 06:56:22 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:56:22 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:56:22 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:56:22 user nova-compute[73258]:   </os>
Aug 27 06:56:22 user nova-compute[73258]:   <features>
Aug 27 06:56:22 user nova-compute[73258]:     <acpi/>
Aug 27 06:56:22 user nova-compute[73258]:     <apic/>
Aug 27 06:56:22 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:56:22 user nova-compute[73258]:   </features>
Aug 27 06:56:22 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:56:22 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:56:22 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:56:22 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:56:22 user nova-compute[73258]:   </clock>
Aug 27 06:56:22 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:56:22 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:56:22 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:56:22 user nova-compute[73258]:   </cpu>
Aug 27 06:56:22 user nova-compute[73258]:   <devices>
Aug 27 06:56:22 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:56:22 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:56:22 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk"/>
Aug 27 06:56:22 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:56:22 user nova-compute[73258]:     </disk>
Aug 27 06:56:22 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:56:22 user nova-compute[73258]:       <mac address="fa:16:3e:96:f3:ab"/>
Aug 27 06:56:22 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:56:22 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:56:22 user nova-compute[73258]:       <target dev="tap9e55f50f-33"/>
Aug 27 06:56:22 user nova-compute[73258]:     </interface>
Aug 27 06:56:22 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:56:22 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/console.log" append="off"/>
Aug 27 06:56:22 user nova-compute[73258]:     </serial>
Aug 27 06:56:22 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:56:22 user nova-compute[73258]:     <video>
Aug 27 06:56:22 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:56:22 user nova-compute[73258]:     </video>
Aug 27 06:56:22 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:56:22 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:56:22 user nova-compute[73258]:     </rng>
Aug 27 06:56:22 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:56:22 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:56:22 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:56:22 user nova-compute[73258]:     </memballoon>
Aug 27 06:56:22 user nova-compute[73258]:   </devices>
Aug 27 06:56:22 user nova-compute[73258]: </domain>
Aug 27 06:56:22 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:56:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-230825290',display_name='tempest-TestMinimumBasicScenario-server-230825290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-230825290',id=41,image_ref='219587c8-b0ee-47ab-aa54-8b2d42fe9b89',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuoVS0M13jEH/jCiVKamjqoQl7T8gy6Y61js/cVhfSR87vdnvOrLJ2jnn3eqtAAM6GxfvMPwc5M3rsN5ROIABUb6JurY5u9Lbvzo4Cmo0ps1r74VIpsNxuNj3rC3V5Nvw==',key_name='tempest-TestMinimumBasicScenario-1377282219',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b34f6a09d79c43c282e56cfda50001d7',ramdisk_id='',reservation_id='r-zqr6he04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='219587c8-b0ee-47ab-aa54-8b2d42fe9b89',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1509066975',owner_user_name='tempest-TestMinimumBasicScenario-1509066975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:56:20Z,user_data=None,user_id='8de65612a05142ebb509012c126b89b0',uuid=d2edd67c-c877-4c45-ae13-ee5f82853066,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Converting VIF {"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f3:ab,bridge_name='br-int',has_traffic_filtering=True,id=9e55f50f-3335-4d20-b9ca-5e497b226d95,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e55f50f-33') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG os_vif [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f3:ab,bridge_name='br-int',has_traffic_filtering=True,id=9e55f50f-3335-4d20-b9ca-5e497b226d95,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e55f50f-33') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e55f50f-33, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e55f50f-33, col_values=(('external_ids', {'iface-id': '9e55f50f-3335-4d20-b9ca-5e497b226d95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:f3:ab', 'vm-uuid': 'd2edd67c-c877-4c45-ae13-ee5f82853066'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:22 user nova-compute[73258]: INFO os_vif [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f3:ab,bridge_name='br-int',has_traffic_filtering=True,id=9e55f50f-3335-4d20-b9ca-5e497b226d95,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e55f50f-33')
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] No VIF found with MAC fa:16:3e:96:f3:ab, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693119382.7103994, 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:56:22 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Successfully detached device vdb from instance 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 from the live domain config.
Aug 27 06:56:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiuIoady', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:56:22 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:56:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7388e556-4519-409c-b138-437c42e070a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6d2ff72-c4a1-4882-a132-3e472ccc8a34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7baf29-e3b4-4667-b604-e6894dab5299]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:56:22 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:56:22 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:56:22 user nova-compute[73258]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 (non-flash)
Aug 27 06:56:22 user nova-compute[73258]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 (non-flash)
Aug 27 06:56:22 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:56:22 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:56:22 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:56:22 user nova-compute[73258]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 (non-flash)
Aug 27 06:56:22 user nova-compute[73258]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 (non-flash)
Aug 27 06:56:22 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4105356c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2f0e27-bcf7-40f3-b8f8-baacdbd78f15]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2409f282-15be-47c7-8a61-d137ca759ab0]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc43d873-0650-44d7-b053-36ee1beb8988]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b42859-80d7-43cd-90a9-b91f29fc4040]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ffb235-42ff-4b63-bcbd-0be3f6171fd9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:56:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[150420da-0e20-4b6e-9b39-f67f2af563da]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95, portal: 172.16.0.220,3260]
Aug 27 06:56:23 user nova-compute[73258]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95, portal: 172.16.0.220,3260] successful.
Aug 27 06:56:23 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:56:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f9b09a-5709-4dd0-a83a-a465d8eaaf95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe0695a-c487-415a-82a0-0b890aaddaad]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:56:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:56:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] <== disconnect_volume: return (321ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:56:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:56:23 user nova-compute[73258]: DEBUG nova.objects.instance [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'flavor' on Instance uuid 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:56:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-539752f6-ad51-4257-96a1-c5060e0f867a tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.802s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-2e81ea7d-ec08-4738-b645-7a7d7a75a55e req-0ed3ddd7-ad8a-4059-967f-3cd85ec82225 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received event network-vif-plugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2e81ea7d-ec08-4738-b645-7a7d7a75a55e req-0ed3ddd7-ad8a-4059-967f-3cd85ec82225 service nova] Acquiring lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2e81ea7d-ec08-4738-b645-7a7d7a75a55e req-0ed3ddd7-ad8a-4059-967f-3cd85ec82225 service nova] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2e81ea7d-ec08-4738-b645-7a7d7a75a55e req-0ed3ddd7-ad8a-4059-967f-3cd85ec82225 service nova] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-2e81ea7d-ec08-4738-b645-7a7d7a75a55e req-0ed3ddd7-ad8a-4059-967f-3cd85ec82225 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] No waiting events found dispatching network-vif-plugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:56:24 user nova-compute[73258]: WARNING nova.compute.manager [req-2e81ea7d-ec08-4738-b645-7a7d7a75a55e req-0ed3ddd7-ad8a-4059-967f-3cd85ec82225 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received unexpected event network-vif-plugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 for instance with vm_state building and task_state spawning.
Aug 27 06:56:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:24 user nova-compute[73258]: INFO nova.compute.manager [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Detaching volume 83d28b37-7841-4a33-8b54-0133d1f7f191
Aug 27 06:56:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:24 user nova-compute[73258]: INFO nova.virt.block_device [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Attempting to driver detach volume 83d28b37-7841-4a33-8b54-0133d1f7f191 from mountpoint /dev/vdc
Aug 27 06:56:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Attempting to detach device vdc from instance 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:56:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:56:24 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:56:24 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 06:56:24 user nova-compute[73258]:   <target dev="vdc" bus="virtio"/>
Aug 27 06:56:24 user nova-compute[73258]:   <serial>83d28b37-7841-4a33-8b54-0133d1f7f191</serial>
Aug 27 06:56:24 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 06:56:24 user nova-compute[73258]: </disk>
Aug 27 06:56:24 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:56:24 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Successfully detached device vdc from instance 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 from the persistent domain config.
Aug 27 06:56:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:56:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:56:24 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:56:24 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 06:56:24 user nova-compute[73258]:   <target dev="vdc" bus="virtio"/>
Aug 27 06:56:24 user nova-compute[73258]:   <serial>83d28b37-7841-4a33-8b54-0133d1f7f191</serial>
Aug 27 06:56:24 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 06:56:24 user nova-compute[73258]: </disk>
Aug 27 06:56:24 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:56:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693119385.2443094, 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:56:25 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Successfully detached device vdc from instance 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 from the live domain config.
Aug 27 06:56:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEzHudUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:56:25 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:56:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf58828-4214-4eb8-b6a9-6ac13088ff3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6d2ff72-c4a1-4882-a132-3e472ccc8a34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb82f31-f476-4b59-936a-347746637bba]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d2ff72-c4a1-4882-a132-3e472ccc8a34 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:56:25 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:56:25 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:56:25 user nova-compute[73258]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 (non-flash)
Aug 27 06:56:25 user nova-compute[73258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d2ff72-c4a1-4882-a132-3e472ccc8a34 (non-flash)
Aug 27 06:56:25 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:56:25 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:56:25 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:56:25 user nova-compute[73258]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 (non-flash)
Aug 27 06:56:25 user nova-compute[73258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d2ff72-c4a1-4882-a132-3e472ccc8a34 (non-flash)
Aug 27 06:56:25 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa43060da20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191'): ({'sdc'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Removing single pathed devices sdc {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0153fa-710f-4880-b199-9e4b4de5f1c8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[38523353-e4ae-4e93-bd96-291dc6f4cb21]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Flushing IO for device /dev/sdc {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5247a5d-3e6a-43ba-9311-8954a758d845]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1bb921-4eda-4b19-acb3-ce450e13c2e1]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84754d4-6904-498d-b634-e4a2a376b097]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d97f398-049e-4002-ae7d-951f02c10ba7]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191, portal: 172.16.0.220,3260]
Aug 27 06:56:25 user nova-compute[73258]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191, portal: 172.16.0.220,3260] successful.
Aug 27 06:56:25 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83d28b37-7841-4a33-8b54-0133d1f7f191 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab32742-467b-4aaf-98f3-072ed16fa8bd]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] <== disconnect_volume: return (317ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:56:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:56:26 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119386.2349324, d2edd67c-c877-4c45-ae13-ee5f82853066 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:56:26 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] VM Resumed (Lifecycle Event)
Aug 27 06:56:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:56:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:56:26 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Instance spawned successfully.
Aug 27 06:56:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:56:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:56:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:56:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:56:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:56:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:56:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:56:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:56:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:56:26 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:56:26 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119386.2391353, d2edd67c-c877-4c45-ae13-ee5f82853066 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:56:26 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] VM Started (Lifecycle Event)
Aug 27 06:56:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:56:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:56:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-4dbd131d-413a-426b-b472-c0840f961ecc req-3ce37461-dec6-47bf-a04e-384b8d8cf893 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received event network-vif-plugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4dbd131d-413a-426b-b472-c0840f961ecc req-3ce37461-dec6-47bf-a04e-384b8d8cf893 service nova] Acquiring lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4dbd131d-413a-426b-b472-c0840f961ecc req-3ce37461-dec6-47bf-a04e-384b8d8cf893 service nova] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4dbd131d-413a-426b-b472-c0840f961ecc req-3ce37461-dec6-47bf-a04e-384b8d8cf893 service nova] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-4dbd131d-413a-426b-b472-c0840f961ecc req-3ce37461-dec6-47bf-a04e-384b8d8cf893 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] No waiting events found dispatching network-vif-plugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:56:26 user nova-compute[73258]: WARNING nova.compute.manager [req-4dbd131d-413a-426b-b472-c0840f961ecc req-3ce37461-dec6-47bf-a04e-384b8d8cf893 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received unexpected event network-vif-plugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 for instance with vm_state building and task_state spawning.
Aug 27 06:56:26 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:56:26 user nova-compute[73258]: INFO nova.compute.manager [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Took 6.53 seconds to spawn the instance on the hypervisor.
Aug 27 06:56:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:56:26 user nova-compute[73258]: DEBUG nova.objects.instance [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'flavor' on Instance uuid 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:56:26 user nova-compute[73258]: INFO nova.compute.manager [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Took 7.32 seconds to build instance.
Aug 27 06:56:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4459b105-91b3-45b1-8ded-9e79bbb8d8f6 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.427s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9d33bcb0-642d-41eb-b5ce-aefae77b70f6 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.844s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:27 user nova-compute[73258]: INFO nova.compute.manager [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Terminating instance
Aug 27 06:56:27 user nova-compute[73258]: DEBUG nova.compute.manager [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:56:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:28 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Instance destroyed successfully.
Aug 27 06:56:28 user nova-compute[73258]: DEBUG nova.objects.instance [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lazy-loading 'resources' on Instance uuid 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:53:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-854491628',display_name='tempest-AttachVolumeTestJSON-server-854491628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-854491628',id=39,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDLZycggjDg5s64PuctBTitQ9WYXvHoZECt1ZDntDuN+UeBkkvHFSoBx5c8+HS7LZdVJ6XuRs93OzCSow0i2KYhjVOrmlrYFf2TG2Xt4lq43lqsCGKX0bOkPqHcFT5hUA==',key_name='tempest-keypair-187464713',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:53:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='191ca81ae335419aa935b1b7576b12ff',ramdisk_id='',reservation_id='r-3xahh2d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1777325696',owner_user_name='tempest-AttachVolumeTestJSON-1777325696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e3b8e4e749b4d039b4d5ebdc6469151',uuid=0bd74dd7-a64c-4233-b8e9-6574eb2a75d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "address": "fa:16:3e:42:89:97", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eec761c-f8", "ovs_interfaceid": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converting VIF {"id": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "address": "fa:16:3e:42:89:97", "network": {"id": "e42f8119-f3fa-44ea-bd66-f9d3d4ab8089", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1162234632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191ca81ae335419aa935b1b7576b12ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eec761c-f8", "ovs_interfaceid": "6eec761c-f898-4839-ad70-aa9d7ac1a525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:89:97,bridge_name='br-int',has_traffic_filtering=True,id=6eec761c-f898-4839-ad70-aa9d7ac1a525,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eec761c-f8') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG os_vif [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:89:97,bridge_name='br-int',has_traffic_filtering=True,id=6eec761c-f898-4839-ad70-aa9d7ac1a525,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eec761c-f8') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6eec761c-f8, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:56:28 user nova-compute[73258]: INFO os_vif [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:89:97,bridge_name='br-int',has_traffic_filtering=True,id=6eec761c-f898-4839-ad70-aa9d7ac1a525,network=Network(e42f8119-f3fa-44ea-bd66-f9d3d4ab8089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eec761c-f8')
Aug 27 06:56:28 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Deleting instance files /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6_del
Aug 27 06:56:28 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Deletion of /opt/stack/data/nova/instances/0bd74dd7-a64c-4233-b8e9-6574eb2a75d6_del complete
Aug 27 06:56:28 user nova-compute[73258]: INFO nova.compute.manager [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 27 06:56:28 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-fadb6eae-0ca1-4825-9040-7aece9a78cd3 req-84eff9ef-8651-4c70-ab4c-3fcfe07b2927 service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Received event network-vif-unplugged-6eec761c-f898-4839-ad70-aa9d7ac1a525 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fadb6eae-0ca1-4825-9040-7aece9a78cd3 req-84eff9ef-8651-4c70-ab4c-3fcfe07b2927 service nova] Acquiring lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fadb6eae-0ca1-4825-9040-7aece9a78cd3 req-84eff9ef-8651-4c70-ab4c-3fcfe07b2927 service nova] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fadb6eae-0ca1-4825-9040-7aece9a78cd3 req-84eff9ef-8651-4c70-ab4c-3fcfe07b2927 service nova] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-fadb6eae-0ca1-4825-9040-7aece9a78cd3 req-84eff9ef-8651-4c70-ab4c-3fcfe07b2927 service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] No waiting events found dispatching network-vif-unplugged-6eec761c-f898-4839-ad70-aa9d7ac1a525 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-fadb6eae-0ca1-4825-9040-7aece9a78cd3 req-84eff9ef-8651-4c70-ab4c-3fcfe07b2927 service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Received event network-vif-unplugged-6eec761c-f898-4839-ad70-aa9d7ac1a525 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-fadb6eae-0ca1-4825-9040-7aece9a78cd3 req-84eff9ef-8651-4c70-ab4c-3fcfe07b2927 service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Received event network-vif-plugged-6eec761c-f898-4839-ad70-aa9d7ac1a525 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fadb6eae-0ca1-4825-9040-7aece9a78cd3 req-84eff9ef-8651-4c70-ab4c-3fcfe07b2927 service nova] Acquiring lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fadb6eae-0ca1-4825-9040-7aece9a78cd3 req-84eff9ef-8651-4c70-ab4c-3fcfe07b2927 service nova] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fadb6eae-0ca1-4825-9040-7aece9a78cd3 req-84eff9ef-8651-4c70-ab4c-3fcfe07b2927 service nova] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-fadb6eae-0ca1-4825-9040-7aece9a78cd3 req-84eff9ef-8651-4c70-ab4c-3fcfe07b2927 service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] No waiting events found dispatching network-vif-plugged-6eec761c-f898-4839-ad70-aa9d7ac1a525 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:56:28 user nova-compute[73258]: WARNING nova.compute.manager [req-fadb6eae-0ca1-4825-9040-7aece9a78cd3 req-84eff9ef-8651-4c70-ab4c-3fcfe07b2927 service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Received unexpected event network-vif-plugged-6eec761c-f898-4839-ad70-aa9d7ac1a525 for instance with vm_state active and task_state deleting.
Aug 27 06:56:29 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:56:29 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Took 0.86 seconds to deallocate network for instance.
Aug 27 06:56:29 user nova-compute[73258]: DEBUG nova.compute.manager [req-4eef0175-f3f8-4931-b3c3-a1c89b2e6e80 req-7d58609a-6b98-4939-9775-fcf0948680be service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Received event network-vif-deleted-6eec761c-f898-4839-ad70-aa9d7ac1a525 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:29 user nova-compute[73258]: INFO nova.compute.manager [req-4eef0175-f3f8-4931-b3c3-a1c89b2e6e80 req-7d58609a-6b98-4939-9775-fcf0948680be service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Neutron deleted interface 6eec761c-f898-4839-ad70-aa9d7ac1a525; detaching it from the instance and deleting it from the info cache
Aug 27 06:56:29 user nova-compute[73258]: DEBUG nova.network.neutron [req-4eef0175-f3f8-4931-b3c3-a1c89b2e6e80 req-7d58609a-6b98-4939-9775-fcf0948680be service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:56:29 user nova-compute[73258]: DEBUG nova.compute.manager [req-4eef0175-f3f8-4931-b3c3-a1c89b2e6e80 req-7d58609a-6b98-4939-9775-fcf0948680be service nova] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Detach interface failed, port_id=6eec761c-f898-4839-ad70-aa9d7ac1a525, reason: Instance 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:56:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:29 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:56:29 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:56:29 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119374.6326554, 01a9f7b2-805a-4ece-a29c-33ac0057cc9b => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:56:29 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] VM Stopped (Lifecycle Event)
Aug 27 06:56:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a74b3e97-13c2-4c73-8ce9-93a0946d6409 None None] [instance: 01a9f7b2-805a-4ece-a29c-33ac0057cc9b] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:56:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:29 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Deleted allocations for instance 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6
Aug 27 06:56:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2f502d3b-21d8-4edc-81dc-3ef7df239e87 tempest-AttachVolumeTestJSON-1777325696 tempest-AttachVolumeTestJSON-1777325696-project-member] Lock "0bd74dd7-a64c-4233-b8e9-6574eb2a75d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.412s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:30 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119375.5473144, 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:56:30 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] VM Stopped (Lifecycle Event)
Aug 27 06:56:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-b227e7b1-0237-49fa-bbe6-60dd511bce7b None None] [instance: 75eb4f5b-ecc6-4a01-a74b-fc1ab86b68bc] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:56:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:56:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 06:56:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:56:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:56:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:41 user nova-compute[73258]: INFO nova.compute.manager [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Terminating instance
Aug 27 06:56:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG nova.compute.manager [req-a25f0368-f116-435a-bd45-d7b3900c2c93 req-7c81e741-56d2-4bdd-a44f-b94a24ad6cd7 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received event network-vif-unplugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a25f0368-f116-435a-bd45-d7b3900c2c93 req-7c81e741-56d2-4bdd-a44f-b94a24ad6cd7 service nova] Acquiring lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a25f0368-f116-435a-bd45-d7b3900c2c93 req-7c81e741-56d2-4bdd-a44f-b94a24ad6cd7 service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a25f0368-f116-435a-bd45-d7b3900c2c93 req-7c81e741-56d2-4bdd-a44f-b94a24ad6cd7 service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG nova.compute.manager [req-a25f0368-f116-435a-bd45-d7b3900c2c93 req-7c81e741-56d2-4bdd-a44f-b94a24ad6cd7 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] No waiting events found dispatching network-vif-unplugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG nova.compute.manager [req-a25f0368-f116-435a-bd45-d7b3900c2c93 req-7c81e741-56d2-4bdd-a44f-b94a24ad6cd7 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received event network-vif-unplugged-f177246f-1def-438b-8ac0-08f4e9cfed50 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:41 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Instance destroyed successfully.
Aug 27 06:56:41 user nova-compute[73258]: DEBUG nova.objects.instance [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'resources' on Instance uuid 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:40:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-934566362',display_name='tempest-ServerRescueNegativeTestJSON-server-934566362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-934566362',id=15,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:42:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6efa67b959a473da5a06f9e0aa8795f',ramdisk_id='',reservation_id='r-iad7yyth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1025141277',owner_user_name='tempest-ServerRescueNegativeTestJSON-1025141277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:42:13Z,user_data=None,user_id='685859ec81944e3398853037c24673a4',uuid=9acc81d9-12bc-46d6-8af9-2fc3106de2b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "f177246f-1def-438b-8ac0-08f4e9cfed50", "address": "fa:16:3e:76:c0:d7", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf177246f-1d", "ovs_interfaceid": "f177246f-1def-438b-8ac0-08f4e9cfed50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converting VIF {"id": "f177246f-1def-438b-8ac0-08f4e9cfed50", "address": "fa:16:3e:76:c0:d7", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf177246f-1d", "ovs_interfaceid": "f177246f-1def-438b-8ac0-08f4e9cfed50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=f177246f-1def-438b-8ac0-08f4e9cfed50,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf177246f-1d') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG os_vif [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=f177246f-1def-438b-8ac0-08f4e9cfed50,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf177246f-1d') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf177246f-1d, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:56:41 user nova-compute[73258]: INFO os_vif [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:c0:d7,bridge_name='br-int',has_traffic_filtering=True,id=f177246f-1def-438b-8ac0-08f4e9cfed50,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf177246f-1d')
Aug 27 06:56:41 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Deleting instance files /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2_del
Aug 27 06:56:41 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Deletion of /opt/stack/data/nova/instances/9acc81d9-12bc-46d6-8af9-2fc3106de2b2_del complete
Aug 27 06:56:41 user nova-compute[73258]: INFO nova.compute.manager [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 27 06:56:41 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:56:41 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:56:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:42 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:56:42 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Took 0.51 seconds to deallocate network for instance.
Aug 27 06:56:42 user nova-compute[73258]: DEBUG nova.compute.manager [req-4a73fdb5-88a5-4f2f-b9f0-86ca79d24e19 req-74994b2b-5471-4165-a594-8c0f57bdf706 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received event network-vif-deleted-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:42 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:56:42 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:56:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.556s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:43 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Deleted allocations for instance 9acc81d9-12bc-46d6-8af9-2fc3106de2b2
Aug 27 06:56:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b23eb471-539d-4400-ba8f-98bdf04d11ae tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.172s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:43 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119388.2303343, 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:56:43 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] VM Stopped (Lifecycle Event)
Aug 27 06:56:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-4d419ea8-85d8-48b7-8b77-70278f8fd799 None None] [instance: 0bd74dd7-a64c-4233-b8e9-6574eb2a75d6] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:56:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received event network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] Acquiring lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] No waiting events found dispatching network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:56:43 user nova-compute[73258]: WARNING nova.compute.manager [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received unexpected event network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 for instance with vm_state deleted and task_state None.
Aug 27 06:56:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received event network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] Acquiring lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] No waiting events found dispatching network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:56:43 user nova-compute[73258]: WARNING nova.compute.manager [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received unexpected event network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 for instance with vm_state deleted and task_state None.
Aug 27 06:56:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received event network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] Acquiring lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] No waiting events found dispatching network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:56:43 user nova-compute[73258]: WARNING nova.compute.manager [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received unexpected event network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 for instance with vm_state deleted and task_state None.
Aug 27 06:56:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received event network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] Acquiring lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] Lock "9acc81d9-12bc-46d6-8af9-2fc3106de2b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:43 user nova-compute[73258]: DEBUG nova.compute.manager [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] No waiting events found dispatching network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:56:43 user nova-compute[73258]: WARNING nova.compute.manager [req-0881ab39-a0ba-42fb-8629-3ddec0a7cbd9 req-330b3369-064d-4411-aac8-194783b2d251 service nova] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Received unexpected event network-vif-plugged-f177246f-1def-438b-8ac0-08f4e9cfed50 for instance with vm_state deleted and task_state None.
Aug 27 06:56:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:49 user nova-compute[73258]: INFO nova.compute.manager [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Terminating instance
Aug 27 06:56:49 user nova-compute[73258]: DEBUG nova.compute.manager [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG nova.compute.manager [req-3d672f92-9597-4868-b81d-a24479bed51a req-b08b86ef-a64c-4661-83fc-3428ffe3f995 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received event network-vif-unplugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3d672f92-9597-4868-b81d-a24479bed51a req-b08b86ef-a64c-4661-83fc-3428ffe3f995 service nova] Acquiring lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3d672f92-9597-4868-b81d-a24479bed51a req-b08b86ef-a64c-4661-83fc-3428ffe3f995 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3d672f92-9597-4868-b81d-a24479bed51a req-b08b86ef-a64c-4661-83fc-3428ffe3f995 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG nova.compute.manager [req-3d672f92-9597-4868-b81d-a24479bed51a req-b08b86ef-a64c-4661-83fc-3428ffe3f995 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] No waiting events found dispatching network-vif-unplugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG nova.compute.manager [req-3d672f92-9597-4868-b81d-a24479bed51a req-b08b86ef-a64c-4661-83fc-3428ffe3f995 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received event network-vif-unplugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:50 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Instance destroyed successfully.
Aug 27 06:56:50 user nova-compute[73258]: DEBUG nova.objects.instance [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lazy-loading 'resources' on Instance uuid bc3cebb3-0e29-4899-94aa-d13a2a9ca86a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1707767622',display_name='tempest-ServerActionsTestOtherB-server-1707767622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1707767622',id=28,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCup9tVy/ES6sbgueL/45Bba8K9LkjKsB0AzSdwXqHLd/SJJd00ZmJLNSvj/I/yfKqYtF7c1wkGM0pTAca7U7ASXDTxzPj0yMtlZAbKBP15oOn8TvN1fkhhoEIFexZqUw==',key_name='tempest-keypair-903561007',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:54:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf1d43b7929c4f60a9948f0d9ed35fce',ramdisk_id='',reservation_id='r-rpya4ij3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-895910456',owner_user_name='tempest-ServerActionsTestOtherB-895910456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:54:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ec7b0ff818840ab9d77576254aaf89e',uuid=bc3cebb3-0e29-4899-94aa-d13a2a9ca86a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Converting VIF {"id": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "address": "fa:16:3e:6d:e9:55", "network": {"id": "b2f6f878-5554-4648-9917-3c1370192c9e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1053221461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf1d43b7929c4f60a9948f0d9ed35fce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8024bd0-32", "ovs_interfaceid": "c8024bd0-329f-4c9e-8974-4881fc97ada9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG os_vif [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8024bd0-32, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:56:50 user nova-compute[73258]: INFO os_vif [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e9:55,bridge_name='br-int',has_traffic_filtering=True,id=c8024bd0-329f-4c9e-8974-4881fc97ada9,network=Network(b2f6f878-5554-4648-9917-3c1370192c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8024bd0-32')
Aug 27 06:56:50 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'olbJMszc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:56:50 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:56:50 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30acddd-8a2f-402a-8fa0-055019d74099]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6d2ff72-c4a1-4882-a132-3e472ccc8a34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06f385b-06dc-4dbe-9a4e-610c46314217]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d2ff72-c4a1-4882-a132-3e472ccc8a34 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:56:50 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:56:50 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:56:50 user nova-compute[73258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d2ff72-c4a1-4882-a132-3e472ccc8a34 (non-flash)
Aug 27 06:56:50 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:56:50 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:56:50 user nova-compute[73258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd (non-flash)
Aug 27 06:56:50 user nova-compute[73258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6d2ff72-c4a1-4882-a132-3e472ccc8a34 (non-flash)
Aug 27 06:56:50 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4105cab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd'): ({'sdg'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Removing single pathed devices sdg {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d908d9-5714-442c-b355-24907a744a72]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[26eb573f-3b6c-408f-8925-6542354ed54c]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Flushing IO for device /dev/sdg {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1926d5-dbc1-4399-b8fc-a2da88eff7a0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:56:50 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[13de6acd-09c9-445e-90bd-5076f3700dec]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] SCSI volumes sdg have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3075a6bd-ebea-4147-96d8-e20ebf7d7e8a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1745618-029c-4f43-a775-7e99dc3e1862]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260]
Aug 27 06:56:51 user nova-compute[73258]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd, portal: 172.16.0.220,3260] successful.
Aug 27 06:56:51 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1eebf8d-b20a-4112-bcdb-7a0cc1e77cfd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99a0229-3fd7-4fe9-b98f-039704b90864]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] <== disconnect_volume: return (281ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:56:51 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Deleting instance files /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a_del
Aug 27 06:56:51 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Deletion of /opt/stack/data/nova/instances/bc3cebb3-0e29-4899-94aa-d13a2a9ca86a_del complete
Aug 27 06:56:51 user nova-compute[73258]: INFO nova.compute.manager [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 27 06:56:51 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:56:51 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:56:52 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:56:52 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Took 0.89 seconds to deallocate network for instance.
Aug 27 06:56:52 user nova-compute[73258]: DEBUG nova.compute.manager [req-d12e2230-e1fb-4022-a15d-1c96c47ef63d req-7523384d-ca5c-4e28-91de-e3ad3fd19271 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received event network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d12e2230-e1fb-4022-a15d-1c96c47ef63d req-7523384d-ca5c-4e28-91de-e3ad3fd19271 service nova] Acquiring lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d12e2230-e1fb-4022-a15d-1c96c47ef63d req-7523384d-ca5c-4e28-91de-e3ad3fd19271 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d12e2230-e1fb-4022-a15d-1c96c47ef63d req-7523384d-ca5c-4e28-91de-e3ad3fd19271 service nova] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:52 user nova-compute[73258]: DEBUG nova.compute.manager [req-d12e2230-e1fb-4022-a15d-1c96c47ef63d req-7523384d-ca5c-4e28-91de-e3ad3fd19271 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] No waiting events found dispatching network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:56:52 user nova-compute[73258]: WARNING nova.compute.manager [req-d12e2230-e1fb-4022-a15d-1c96c47ef63d req-7523384d-ca5c-4e28-91de-e3ad3fd19271 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received unexpected event network-vif-plugged-c8024bd0-329f-4c9e-8974-4881fc97ada9 for instance with vm_state active and task_state deleting.
Aug 27 06:56:52 user nova-compute[73258]: DEBUG nova.compute.manager [req-d12e2230-e1fb-4022-a15d-1c96c47ef63d req-7523384d-ca5c-4e28-91de-e3ad3fd19271 service nova] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Received event network-vif-deleted-c8024bd0-329f-4c9e-8974-4881fc97ada9 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:56:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:56:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:56:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-a836678e-240d-4ead-b0b5-64d146910a23" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:56:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-a836678e-240d-4ead-b0b5-64d146910a23" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:56:56 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:56:56 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119401.8260903, 9acc81d9-12bc-46d6-8af9-2fc3106de2b2 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:56:56 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] VM Stopped (Lifecycle Event)
Aug 27 06:56:56 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Updating instance_info_cache with network_info: [{"id": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "address": "fa:16:3e:00:0b:2b", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eae0f1e-d6", "ovs_interfaceid": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:56:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-a836678e-240d-4ead-b0b5-64d146910a23" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:56:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:56:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-54f212a3-8286-4263-82d6-f141f34d369c None None] [instance: 9acc81d9-12bc-46d6-8af9-2fc3106de2b2] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:56:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:56:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:56:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:56:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:56:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:56:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:56:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:56:57 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:56:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:56:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:56:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:56:57 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:56:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:58 user nova-compute[73258]: DEBUG nova.compute.manager [req-122fc2d1-c399-4ca0-957f-ed46ba7726c9 req-01cd2217-6472-472e-bbb2-9c353f165988 service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Received event network-changed-be41900c-5aad-4659-9e21-fc2c0c0b8bd1 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:56:58 user nova-compute[73258]: DEBUG nova.compute.manager [req-122fc2d1-c399-4ca0-957f-ed46ba7726c9 req-01cd2217-6472-472e-bbb2-9c353f165988 service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Refreshing instance network info cache due to event network-changed-be41900c-5aad-4659-9e21-fc2c0c0b8bd1. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:56:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-122fc2d1-c399-4ca0-957f-ed46ba7726c9 req-01cd2217-6472-472e-bbb2-9c353f165988 service nova] Acquiring lock "refresh_cache-54697fcb-9ffe-4660-b7d2-7b89dfd72439" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:56:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-122fc2d1-c399-4ca0-957f-ed46ba7726c9 req-01cd2217-6472-472e-bbb2-9c353f165988 service nova] Acquired lock "refresh_cache-54697fcb-9ffe-4660-b7d2-7b89dfd72439" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:56:58 user nova-compute[73258]: DEBUG nova.network.neutron [req-122fc2d1-c399-4ca0-957f-ed46ba7726c9 req-01cd2217-6472-472e-bbb2-9c353f165988 service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Refreshing network info cache for port be41900c-5aad-4659-9e21-fc2c0c0b8bd1 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:56:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:56:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a296fb1e-1999-475c-9a15-eeeedfa11247/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a296fb1e-1999-475c-9a15-eeeedfa11247/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a296fb1e-1999-475c-9a15-eeeedfa11247/disk.rescue --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a296fb1e-1999-475c-9a15-eeeedfa11247/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:59 user nova-compute[73258]: DEBUG nova.network.neutron [req-122fc2d1-c399-4ca0-957f-ed46ba7726c9 req-01cd2217-6472-472e-bbb2-9c353f165988 service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Updated VIF entry in instance network info cache for port be41900c-5aad-4659-9e21-fc2c0c0b8bd1. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:56:59 user nova-compute[73258]: DEBUG nova.network.neutron [req-122fc2d1-c399-4ca0-957f-ed46ba7726c9 req-01cd2217-6472-472e-bbb2-9c353f165988 service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Updating instance_info_cache with network_info: [{"id": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "address": "fa:16:3e:0a:85:cd", "network": {"id": "8868be84-8d19-484f-9732-0a212f789a1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1368955490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5caed6c4efcf4ebab7c5dc47d0d7736c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe41900c-5a", "ovs_interfaceid": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:56:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-122fc2d1-c399-4ca0-957f-ed46ba7726c9 req-01cd2217-6472-472e-bbb2-9c353f165988 service nova] Releasing lock "refresh_cache-54697fcb-9ffe-4660-b7d2-7b89dfd72439" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:56:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:56:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:56:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:56:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:00 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:57:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:01 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:57:01 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:57:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=7475MB free_disk=23.616687774658203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:57:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1672aa9f-be6f-4357-877f-a48f62119df4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:57:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a836678e-240d-4ead-b0b5-64d146910a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:57:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 7ee743f1-9611-4165-838e-54fccb332f1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:57:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance d409b021-ab98-4f9f-a80d-99fe05de7b69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:57:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:57:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bc3cebb3-0e29-4899-94aa-d13a2a9ca86a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:57:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a296fb1e-1999-475c-9a15-eeeedfa11247 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:57:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:57:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance d2edd67c-c877-4c45-ae13-ee5f82853066 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:57:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:57:01 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:57:02 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:57:02 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:57:02 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:57:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.493s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:02 user nova-compute[73258]: INFO nova.compute.manager [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Took 10.69 seconds to detach 1 volumes for instance.
Aug 27 06:57:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:03 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:57:03 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:57:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:03 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Deleted allocations for instance bc3cebb3-0e29-4899-94aa-d13a2a9ca86a
Aug 27 06:57:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8ce694f8-f0ac-427e-8084-4777667a08a7 tempest-ServerActionsTestOtherB-895910456 tempest-ServerActionsTestOtherB-895910456-project-member] Lock "bc3cebb3-0e29-4899-94aa-d13a2a9ca86a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.355s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG nova.objects.instance [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lazy-loading 'flavor' on Instance uuid 54697fcb-9ffe-4660-b7d2-7b89dfd72439 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:04 user nova-compute[73258]: INFO nova.compute.manager [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Attaching volume 96148ebb-1a49-4f8f-b866-3be0590c6b30 to /dev/vdb
Aug 27 06:57:04 user nova-compute[73258]: DEBUG os_brick.utils [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe5b0ba-226e-46da-b6d6-923bbacafabe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc45c27-eb72-4254-87a2-18d3ffd06992]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2d2d9a-a2fd-47e7-9256-e50839967aec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[307d5ac1-638f-47a9-98b8-9430bdc8899e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:57:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:57:05 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:57:05 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5274a58e-3b07-4a9f-9168-98d9bee9d729]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:57:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:57:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:57:05 user nova-compute[73258]: DEBUG os_brick.utils [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:57:05 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Updating existing volume attachment record: 8e2da491-29d4-4c58-b826-6a962c1a6284 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:57:05 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119410.7985575, bc3cebb3-0e29-4899-94aa-d13a2a9ca86a => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:57:05 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] VM Stopped (Lifecycle Event)
Aug 27 06:57:05 user nova-compute[73258]: DEBUG nova.compute.manager [None req-0a6992af-59e7-4580-bf2b-9464d8115f51 None None] [instance: bc3cebb3-0e29-4899-94aa-d13a2a9ca86a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:57:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:11 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:57:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bQlLmvNT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:57:17 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:57:17 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:57:17 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcae94ca-09b2-4127-8aed-e90c86cff7f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:57:17 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[463ea2c2-f45e-447f-b450-3dd3cfab7c51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30] added
Aug 27 06:57:17 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d0232c-41b3-40e6-87a1-43873cc861fc]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e00b31-4080-44a5-b838-7bf042fd86df]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bQlLmvNT {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bQlLmvNT" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[37def5d3-1bf9-45b1-bbc5-295caf7c8da8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bQlLmvNT'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8449e03-16b5-4cd9-b4d9-332c02b95828]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ed46d8-568a-47b4-9c64-bd37d81ab2b7]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:57:17 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:57:17 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:57:17 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:57:17 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[96295cd6-d106-4794-a611-d2a10a976474]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30, portal: 172.16.0.220,3260]
Aug 27 06:57:17 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30, portal: 172.16.0.220,3260] successful.
Aug 27 06:57:17 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1d88b4-40d9-4e23-90a5-aa57ec3b09bb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0949755b-6f10-4c17-9187-70defddfd638]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:57:17 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:57:17 user nova-compute[73258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 (non-flash)
Aug 27 06:57:17 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:57:17 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:57:17 user nova-compute[73258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 (non-flash)
Aug 27 06:57:17 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dee431-79cc-43fe-9342-c83aac0bd2f7]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:17 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:57:18 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:57:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bQlLmvNT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:57:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:57:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '23033623661646261', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:57:18 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033623661646261', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:57:18 user nova-compute[73258]: DEBUG nova.objects.instance [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lazy-loading 'flavor' on Instance uuid 54697fcb-9ffe-4660-b7d2-7b89dfd72439 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:57:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:57:19 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:57:19 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:57:19 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:57:19 user nova-compute[73258]:   <serial>96148ebb-1a49-4f8f-b866-3be0590c6b30</serial>
Aug 27 06:57:19 user nova-compute[73258]: </disk>
Aug 27 06:57:19 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:57:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:57:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:57:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] No VIF found with MAC fa:16:3e:0a:85:cd, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:57:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8d23fed1-9d75-4654-a8af-ed6acb13bf45 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.795s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "0c16951e-8620-493f-8af4-fbdc64e1c131" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:22 user nova-compute[73258]: INFO nova.compute.manager [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Unshelving
Aug 27 06:57:22 user nova-compute[73258]: INFO nova.virt.block_device [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Booting with volume 7ad57bda-1e6b-42da-b681-1a8d6a4baa16 at /dev/vda
Aug 27 06:57:22 user nova-compute[73258]: DEBUG os_brick.utils [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33e41af-c575-40f0-a2bc-25c35122fe8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[683e6d68-c068-435e-a8f8-8d377bfa77c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fa56c1-f346-4f5f-8283-402d968d7fa7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8c0fa2-6aa9-41e7-91ba-917adb62b830]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:57:22 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:57:22 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ed0ee4-6c01-407f-a300-58d86b73fa2c]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG os_brick.utils [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:57:22 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Updating existing volume attachment record: 8f755d8e-d3b7-456e-9c52-3dbd4de67ab7 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:57:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:24 user nova-compute[73258]: INFO nova.compute.manager [None req-2e41ac87-8fa4-44e8-8ff0-afc9496f79da tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Unrescuing
Aug 27 06:57:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2e41ac87-8fa4-44e8-8ff0-afc9496f79da tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "refresh_cache-a296fb1e-1999-475c-9a15-eeeedfa11247" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:57:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2e41ac87-8fa4-44e8-8ff0-afc9496f79da tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquired lock "refresh_cache-a296fb1e-1999-475c-9a15-eeeedfa11247" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:57:24 user nova-compute[73258]: DEBUG nova.network.neutron [None req-2e41ac87-8fa4-44e8-8ff0-afc9496f79da tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:57:25 user nova-compute[73258]: DEBUG nova.network.neutron [None req-2e41ac87-8fa4-44e8-8ff0-afc9496f79da tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Updating instance_info_cache with network_info: [{"id": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "address": "fa:16:3e:dd:b3:4a", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8b8c03-b3", "ovs_interfaceid": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:57:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-2e41ac87-8fa4-44e8-8ff0-afc9496f79da tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Releasing lock "refresh_cache-a296fb1e-1999-475c-9a15-eeeedfa11247" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:57:25 user nova-compute[73258]: DEBUG nova.objects.instance [None req-2e41ac87-8fa4-44e8-8ff0-afc9496f79da tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'flavor' on Instance uuid a296fb1e-1999-475c-9a15-eeeedfa11247 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:57:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:25 user nova-compute[73258]: DEBUG nova.compute.manager [req-eeac9482-d644-4095-912c-a1d353529225 req-cc6bc32b-e8ee-46fc-baed-cf4ce536edb4 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received event network-vif-unplugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:57:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-eeac9482-d644-4095-912c-a1d353529225 req-cc6bc32b-e8ee-46fc-baed-cf4ce536edb4 service nova] Acquiring lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-eeac9482-d644-4095-912c-a1d353529225 req-cc6bc32b-e8ee-46fc-baed-cf4ce536edb4 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-eeac9482-d644-4095-912c-a1d353529225 req-cc6bc32b-e8ee-46fc-baed-cf4ce536edb4 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:25 user nova-compute[73258]: DEBUG nova.compute.manager [req-eeac9482-d644-4095-912c-a1d353529225 req-cc6bc32b-e8ee-46fc-baed-cf4ce536edb4 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] No waiting events found dispatching network-vif-unplugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:57:25 user nova-compute[73258]: WARNING nova.compute.manager [req-eeac9482-d644-4095-912c-a1d353529225 req-cc6bc32b-e8ee-46fc-baed-cf4ce536edb4 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received unexpected event network-vif-unplugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:57:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:26 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Instance destroyed successfully.
Aug 27 06:57:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-0cf6b1e7-3ad3-4438-b22f-0a60aa30d321 req-2d3f390d-18d2-405f-9772-d3a6b6b5ee64 service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Received event network-changed-a1f85e16-bf92-403d-bd6d-2300dfc481d7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-0cf6b1e7-3ad3-4438-b22f-0a60aa30d321 req-2d3f390d-18d2-405f-9772-d3a6b6b5ee64 service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Refreshing instance network info cache due to event network-changed-a1f85e16-bf92-403d-bd6d-2300dfc481d7. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0cf6b1e7-3ad3-4438-b22f-0a60aa30d321 req-2d3f390d-18d2-405f-9772-d3a6b6b5ee64 service nova] Acquiring lock "refresh_cache-d409b021-ab98-4f9f-a80d-99fe05de7b69" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0cf6b1e7-3ad3-4438-b22f-0a60aa30d321 req-2d3f390d-18d2-405f-9772-d3a6b6b5ee64 service nova] Acquired lock "refresh_cache-d409b021-ab98-4f9f-a80d-99fe05de7b69" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG nova.network.neutron [req-0cf6b1e7-3ad3-4438-b22f-0a60aa30d321 req-2d3f390d-18d2-405f-9772-d3a6b6b5ee64 service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Refreshing network info cache for port a1f85e16-bf92-403d-bd6d-2300dfc481d7 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "d409b021-ab98-4f9f-a80d-99fe05de7b69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "d409b021-ab98-4f9f-a80d-99fe05de7b69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:26 user nova-compute[73258]: INFO nova.compute.manager [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Terminating instance
Aug 27 06:57:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-aee11665-8e62-4dd0-b0d8-74b0abee7eec req-afe1443c-9c71-450e-a98d-0db5fa5a3933 service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Received event network-vif-unplugged-a1f85e16-bf92-403d-bd6d-2300dfc481d7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-aee11665-8e62-4dd0-b0d8-74b0abee7eec req-afe1443c-9c71-450e-a98d-0db5fa5a3933 service nova] Acquiring lock "d409b021-ab98-4f9f-a80d-99fe05de7b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-aee11665-8e62-4dd0-b0d8-74b0abee7eec req-afe1443c-9c71-450e-a98d-0db5fa5a3933 service nova] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-aee11665-8e62-4dd0-b0d8-74b0abee7eec req-afe1443c-9c71-450e-a98d-0db5fa5a3933 service nova] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-aee11665-8e62-4dd0-b0d8-74b0abee7eec req-afe1443c-9c71-450e-a98d-0db5fa5a3933 service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] No waiting events found dispatching network-vif-unplugged-a1f85e16-bf92-403d-bd6d-2300dfc481d7 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-aee11665-8e62-4dd0-b0d8-74b0abee7eec req-afe1443c-9c71-450e-a98d-0db5fa5a3933 service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Received event network-vif-unplugged-a1f85e16-bf92-403d-bd6d-2300dfc481d7 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG nova.network.neutron [req-0cf6b1e7-3ad3-4438-b22f-0a60aa30d321 req-2d3f390d-18d2-405f-9772-d3a6b6b5ee64 service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Updated VIF entry in instance network info cache for port a1f85e16-bf92-403d-bd6d-2300dfc481d7. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG nova.network.neutron [req-0cf6b1e7-3ad3-4438-b22f-0a60aa30d321 req-2d3f390d-18d2-405f-9772-d3a6b6b5ee64 service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Updating instance_info_cache with network_info: [{"id": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "address": "fa:16:3e:52:49:8c", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f85e16-bf", "ovs_interfaceid": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:57:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0cf6b1e7-3ad3-4438-b22f-0a60aa30d321 req-2d3f390d-18d2-405f-9772-d3a6b6b5ee64 service nova] Releasing lock "refresh_cache-d409b021-ab98-4f9f-a80d-99fe05de7b69" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:57:27 user nova-compute[73258]: DEBUG nova.compute.manager [req-265bf388-4345-409a-b865-b4a2db5c14a0 req-456b542d-1a96-4455-9354-62388f1e91a7 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received event network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:57:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-265bf388-4345-409a-b865-b4a2db5c14a0 req-456b542d-1a96-4455-9354-62388f1e91a7 service nova] Acquiring lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-265bf388-4345-409a-b865-b4a2db5c14a0 req-456b542d-1a96-4455-9354-62388f1e91a7 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-265bf388-4345-409a-b865-b4a2db5c14a0 req-456b542d-1a96-4455-9354-62388f1e91a7 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:27 user nova-compute[73258]: DEBUG nova.compute.manager [req-265bf388-4345-409a-b865-b4a2db5c14a0 req-456b542d-1a96-4455-9354-62388f1e91a7 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] No waiting events found dispatching network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:57:27 user nova-compute[73258]: WARNING nova.compute.manager [req-265bf388-4345-409a-b865-b4a2db5c14a0 req-456b542d-1a96-4455-9354-62388f1e91a7 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received unexpected event network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:57:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:28 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Instance destroyed successfully.
Aug 27 06:57:28 user nova-compute[73258]: DEBUG nova.objects.instance [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lazy-loading 'resources' on Instance uuid d409b021-ab98-4f9f-a80d-99fe05de7b69 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1387683302',display_name='tempest-TestStampPattern-server-1387683302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1387683302',id=33,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwYZxibBAc2nvlcafNqnemngRCXIz90U4I2XLhwZXxc9YEXEO2YKFZ69eY+zmysXtc6kSJDnPSsSYt70Y3+IiQVuHG0DIaBJdVBu3sgT92WAEQ0yFaQ4/zUiXf3G0XH5w==',key_name='tempest-TestStampPattern-1276587428',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:49:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72f7bfc1fb284defb6f92a77be8821e5',ramdisk_id='',reservation_id='r-jzflwlei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-873602452',owner_user_name='tempest-TestStampPattern-873602452-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:53:08Z,user_data=None,user_id='7c44464f6e84417cb8823d01c7aa669f',uuid=d409b021-ab98-4f9f-a80d-99fe05de7b69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "address": "fa:16:3e:52:49:8c", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f85e16-bf", "ovs_interfaceid": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Converting VIF {"id": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "address": "fa:16:3e:52:49:8c", "network": {"id": "d52cca87-60dc-45ab-b7fe-f5a26a33e0ce", "bridge": "br-int", "label": "tempest-TestStampPattern-1682306772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72f7bfc1fb284defb6f92a77be8821e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f85e16-bf", "ovs_interfaceid": "a1f85e16-bf92-403d-bd6d-2300dfc481d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:49:8c,bridge_name='br-int',has_traffic_filtering=True,id=a1f85e16-bf92-403d-bd6d-2300dfc481d7,network=Network(d52cca87-60dc-45ab-b7fe-f5a26a33e0ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f85e16-bf') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG os_vif [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:49:8c,bridge_name='br-int',has_traffic_filtering=True,id=a1f85e16-bf92-403d-bd6d-2300dfc481d7,network=Network(d52cca87-60dc-45ab-b7fe-f5a26a33e0ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f85e16-bf') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1f85e16-bf, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:28 user nova-compute[73258]: INFO os_vif [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:49:8c,bridge_name='br-int',has_traffic_filtering=True,id=a1f85e16-bf92-403d-bd6d-2300dfc481d7,network=Network(d52cca87-60dc-45ab-b7fe-f5a26a33e0ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f85e16-bf')
Aug 27 06:57:28 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Deleting instance files /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69_del
Aug 27 06:57:28 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Deletion of /opt/stack/data/nova/instances/d409b021-ab98-4f9f-a80d-99fe05de7b69_del complete
Aug 27 06:57:28 user nova-compute[73258]: INFO nova.compute.manager [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Took 1.88 seconds to destroy the instance on the hypervisor.
Aug 27 06:57:28 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-b2b733ea-b96f-41db-ba09-5a5a6bf80e75 req-d6709e44-f27d-4f6d-8b05-81d842dcdc20 service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Received event network-vif-plugged-a1f85e16-bf92-403d-bd6d-2300dfc481d7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b2b733ea-b96f-41db-ba09-5a5a6bf80e75 req-d6709e44-f27d-4f6d-8b05-81d842dcdc20 service nova] Acquiring lock "d409b021-ab98-4f9f-a80d-99fe05de7b69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b2b733ea-b96f-41db-ba09-5a5a6bf80e75 req-d6709e44-f27d-4f6d-8b05-81d842dcdc20 service nova] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b2b733ea-b96f-41db-ba09-5a5a6bf80e75 req-d6709e44-f27d-4f6d-8b05-81d842dcdc20 service nova] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-b2b733ea-b96f-41db-ba09-5a5a6bf80e75 req-d6709e44-f27d-4f6d-8b05-81d842dcdc20 service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] No waiting events found dispatching network-vif-plugged-a1f85e16-bf92-403d-bd6d-2300dfc481d7 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:57:28 user nova-compute[73258]: WARNING nova.compute.manager [req-b2b733ea-b96f-41db-ba09-5a5a6bf80e75 req-d6709e44-f27d-4f6d-8b05-81d842dcdc20 service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Received unexpected event network-vif-plugged-a1f85e16-bf92-403d-bd6d-2300dfc481d7 for instance with vm_state active and task_state deleting.
Aug 27 06:57:29 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:57:29 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Took 1.13 seconds to deallocate network for instance.
Aug 27 06:57:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:29 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:57:29 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:57:29 user nova-compute[73258]: DEBUG nova.compute.manager [req-367dfcba-6c79-48f8-b8dd-a272018e79e6 req-67c9f2fc-2717-492d-a352-1d34034197c1 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received event network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:57:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-367dfcba-6c79-48f8-b8dd-a272018e79e6 req-67c9f2fc-2717-492d-a352-1d34034197c1 service nova] Acquiring lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-367dfcba-6c79-48f8-b8dd-a272018e79e6 req-67c9f2fc-2717-492d-a352-1d34034197c1 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-367dfcba-6c79-48f8-b8dd-a272018e79e6 req-67c9f2fc-2717-492d-a352-1d34034197c1 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:29 user nova-compute[73258]: DEBUG nova.compute.manager [req-367dfcba-6c79-48f8-b8dd-a272018e79e6 req-67c9f2fc-2717-492d-a352-1d34034197c1 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] No waiting events found dispatching network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:57:29 user nova-compute[73258]: WARNING nova.compute.manager [req-367dfcba-6c79-48f8-b8dd-a272018e79e6 req-67c9f2fc-2717-492d-a352-1d34034197c1 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received unexpected event network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:57:29 user nova-compute[73258]: DEBUG nova.compute.manager [req-367dfcba-6c79-48f8-b8dd-a272018e79e6 req-67c9f2fc-2717-492d-a352-1d34034197c1 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received event network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:57:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-367dfcba-6c79-48f8-b8dd-a272018e79e6 req-67c9f2fc-2717-492d-a352-1d34034197c1 service nova] Acquiring lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-367dfcba-6c79-48f8-b8dd-a272018e79e6 req-67c9f2fc-2717-492d-a352-1d34034197c1 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-367dfcba-6c79-48f8-b8dd-a272018e79e6 req-67c9f2fc-2717-492d-a352-1d34034197c1 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:29 user nova-compute[73258]: DEBUG nova.compute.manager [req-367dfcba-6c79-48f8-b8dd-a272018e79e6 req-67c9f2fc-2717-492d-a352-1d34034197c1 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] No waiting events found dispatching network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:57:29 user nova-compute[73258]: WARNING nova.compute.manager [req-367dfcba-6c79-48f8-b8dd-a272018e79e6 req-67c9f2fc-2717-492d-a352-1d34034197c1 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received unexpected event network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 for instance with vm_state rescued and task_state unrescuing.
Aug 27 06:57:29 user nova-compute[73258]: DEBUG nova.compute.manager [req-367dfcba-6c79-48f8-b8dd-a272018e79e6 req-67c9f2fc-2717-492d-a352-1d34034197c1 service nova] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Received event network-vif-deleted-a1f85e16-bf92-403d-bd6d-2300dfc481d7 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:57:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:30 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Deleted allocations for instance d409b021-ab98-4f9f-a80d-99fe05de7b69
Aug 27 06:57:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c9bc43df-d965-42fe-9098-440ce2c5f9ae tempest-TestStampPattern-873602452 tempest-TestStampPattern-873602452-project-member] Lock "d409b021-ab98-4f9f-a80d-99fe05de7b69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.741s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Removed pending event for a296fb1e-1999-475c-9a15-eeeedfa11247 due to event {{(pid=73258) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 06:57:30 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119450.539623, a296fb1e-1999-475c-9a15-eeeedfa11247 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:57:30 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] VM Resumed (Lifecycle Event)
Aug 27 06:57:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-2e41ac87-8fa4-44e8-8ff0-afc9496f79da tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:57:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:57:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:57:30 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 06:57:30 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119450.541196, a296fb1e-1999-475c-9a15-eeeedfa11247 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:57:30 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] VM Started (Lifecycle Event)
Aug 27 06:57:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:57:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:57:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "1672aa9f-be6f-4357-877f-a48f62119df4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:31 user nova-compute[73258]: INFO nova.compute.manager [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Terminating instance
Aug 27 06:57:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:57:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-2715acf8-75a5-48e0-a3e7-1509002b0d9d req-42355023-a292-487e-92ee-e02b87163f6c service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received event network-vif-unplugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:57:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2715acf8-75a5-48e0-a3e7-1509002b0d9d req-42355023-a292-487e-92ee-e02b87163f6c service nova] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2715acf8-75a5-48e0-a3e7-1509002b0d9d req-42355023-a292-487e-92ee-e02b87163f6c service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2715acf8-75a5-48e0-a3e7-1509002b0d9d req-42355023-a292-487e-92ee-e02b87163f6c service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-2715acf8-75a5-48e0-a3e7-1509002b0d9d req-42355023-a292-487e-92ee-e02b87163f6c service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] No waiting events found dispatching network-vif-unplugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:57:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-2715acf8-75a5-48e0-a3e7-1509002b0d9d req-42355023-a292-487e-92ee-e02b87163f6c service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received event network-vif-unplugged-217b1702-a403-4f3a-bdae-7793382e5f38 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:57:32 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Instance destroyed successfully.
Aug 27 06:57:32 user nova-compute[73258]: DEBUG nova.objects.instance [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lazy-loading 'resources' on Instance uuid 1672aa9f-be6f-4357-877f-a48f62119df4 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:57:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:40:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-986376124',display_name='tempest-ServerRescueNegativeTestJSON-server-986376124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-986376124',id=14,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:45:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6efa67b959a473da5a06f9e0aa8795f',ramdisk_id='',reservation_id='r-gemtid0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1025141277',owner_user_name='tempest-ServerRescueNegativeTestJSON-1025141277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:46:59Z,user_data=None,user_id='685859ec81944e3398853037c24673a4',uuid=1672aa9f-be6f-4357-877f-a48f62119df4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "217b1702-a403-4f3a-bdae-7793382e5f38", "address": "fa:16:3e:5d:4e:76", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217b1702-a4", "ovs_interfaceid": "217b1702-a403-4f3a-bdae-7793382e5f38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:57:32 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converting VIF {"id": "217b1702-a403-4f3a-bdae-7793382e5f38", "address": "fa:16:3e:5d:4e:76", "network": {"id": "960644fc-a18d-4d73-94b3-578ca5e5af62", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1873169811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6efa67b959a473da5a06f9e0aa8795f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217b1702-a4", "ovs_interfaceid": "217b1702-a403-4f3a-bdae-7793382e5f38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:57:32 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:4e:76,bridge_name='br-int',has_traffic_filtering=True,id=217b1702-a403-4f3a-bdae-7793382e5f38,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217b1702-a4') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:57:32 user nova-compute[73258]: DEBUG os_vif [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:4e:76,bridge_name='br-int',has_traffic_filtering=True,id=217b1702-a403-4f3a-bdae-7793382e5f38,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217b1702-a4') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:57:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap217b1702-a4, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:57:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:57:32 user nova-compute[73258]: INFO os_vif [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:4e:76,bridge_name='br-int',has_traffic_filtering=True,id=217b1702-a403-4f3a-bdae-7793382e5f38,network=Network(960644fc-a18d-4d73-94b3-578ca5e5af62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217b1702-a4')
Aug 27 06:57:32 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Deleting instance files /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4_del
Aug 27 06:57:32 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Deletion of /opt/stack/data/nova/instances/1672aa9f-be6f-4357-877f-a48f62119df4_del complete
Aug 27 06:57:32 user nova-compute[73258]: INFO nova.compute.manager [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 27 06:57:32 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:57:32 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:57:32 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:57:33 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:57:33 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Took 0.87 seconds to deallocate network for instance.
Aug 27 06:57:33 user nova-compute[73258]: DEBUG nova.compute.manager [req-6770a1c4-fc72-42d1-b581-93d8e33fd14f req-58fc9062-4bb0-44b5-84dc-0f48a46c30ff service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received event network-vif-deleted-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:57:33 user nova-compute[73258]: INFO nova.compute.manager [req-6770a1c4-fc72-42d1-b581-93d8e33fd14f req-58fc9062-4bb0-44b5-84dc-0f48a46c30ff service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Neutron deleted interface 217b1702-a403-4f3a-bdae-7793382e5f38; detaching it from the instance and deleting it from the info cache
Aug 27 06:57:33 user nova-compute[73258]: DEBUG nova.network.neutron [req-6770a1c4-fc72-42d1-b581-93d8e33fd14f req-58fc9062-4bb0-44b5-84dc-0f48a46c30ff service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:57:33 user nova-compute[73258]: DEBUG nova.compute.manager [req-6770a1c4-fc72-42d1-b581-93d8e33fd14f req-58fc9062-4bb0-44b5-84dc-0f48a46c30ff service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Detach interface failed, port_id=217b1702-a403-4f3a-bdae-7793382e5f38, reason: Instance 1672aa9f-be6f-4357-877f-a48f62119df4 could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:57:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:33 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:57:33 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:57:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:33 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Deleted allocations for instance 1672aa9f-be6f-4357-877f-a48f62119df4
Aug 27 06:57:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cc2c76ed-d2f1-4c0c-a7af-2eefba77ffd5 tempest-ServerRescueNegativeTestJSON-1025141277 tempest-ServerRescueNegativeTestJSON-1025141277-project-member] Lock "1672aa9f-be6f-4357-877f-a48f62119df4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.453s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-3867a428-bfeb-4520-9def-c7c3610736ca req-c926993d-bdcf-4de6-ba0d-5b8237d72402 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:57:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3867a428-bfeb-4520-9def-c7c3610736ca req-c926993d-bdcf-4de6-ba0d-5b8237d72402 service nova] Acquiring lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3867a428-bfeb-4520-9def-c7c3610736ca req-c926993d-bdcf-4de6-ba0d-5b8237d72402 service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3867a428-bfeb-4520-9def-c7c3610736ca req-c926993d-bdcf-4de6-ba0d-5b8237d72402 service nova] Lock "1672aa9f-be6f-4357-877f-a48f62119df4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:34 user nova-compute[73258]: DEBUG nova.compute.manager [req-3867a428-bfeb-4520-9def-c7c3610736ca req-c926993d-bdcf-4de6-ba0d-5b8237d72402 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] No waiting events found dispatching network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:57:34 user nova-compute[73258]: WARNING nova.compute.manager [req-3867a428-bfeb-4520-9def-c7c3610736ca req-c926993d-bdcf-4de6-ba0d-5b8237d72402 service nova] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Received unexpected event network-vif-plugged-217b1702-a403-4f3a-bdae-7793382e5f38 for instance with vm_state deleted and task_state None.
Aug 27 06:57:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:57:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 06:57:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:57:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:57:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:43 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119448.2002213, d409b021-ab98-4f9f-a80d-99fe05de7b69 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:57:43 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] VM Stopped (Lifecycle Event)
Aug 27 06:57:43 user nova-compute[73258]: DEBUG nova.compute.manager [None req-39a07937-0b94-43f6-8dec-5fe0dca5254e None None] [instance: d409b021-ab98-4f9f-a80d-99fe05de7b69] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:57:47 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119452.5128107, 1672aa9f-be6f-4357-877f-a48f62119df4 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:57:47 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] VM Stopped (Lifecycle Event)
Aug 27 06:57:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-5122be17-0e66-4ab2-8069-8faa7bfed738 None None] [instance: 1672aa9f-be6f-4357-877f-a48f62119df4] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:57:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:50 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:57:50 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 06:57:51 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:57:51 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:57:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-7ee743f1-9611-4165-838e-54fccb332f1a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:57:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-7ee743f1-9611-4165-838e-54fccb332f1a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:57:52 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:57:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:52 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Updating instance_info_cache with network_info: [{"id": "27d47d21-922e-43da-8dee-8d62f45edd64", "address": "fa:16:3e:5c:73:20", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d47d21-92", "ovs_interfaceid": "27d47d21-922e-43da-8dee-8d62f45edd64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:57:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-7ee743f1-9611-4165-838e-54fccb332f1a" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:57:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:57:52 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:57:52 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:57:52 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:57:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:57:53 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:57:53 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:57:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:54 user nova-compute[73258]: DEBUG nova.objects.instance [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lazy-loading 'pci_requests' on Instance uuid 0c16951e-8620-493f-8af4-fbdc64e1c131 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:57:54 user nova-compute[73258]: DEBUG nova.objects.instance [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lazy-loading 'numa_topology' on Instance uuid 0c16951e-8620-493f-8af4-fbdc64e1c131 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:57:54 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:57:54 user nova-compute[73258]: INFO nova.compute.claims [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Claim successful on node user
Aug 27 06:57:55 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Refreshing inventories for resource provider 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 06:57:55 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Updating ProviderTree inventory for provider 13f05024-5078-4590-94a5-110d29d864c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 06:57:55 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Updating inventory in ProviderTree for provider 13f05024-5078-4590-94a5-110d29d864c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 06:57:55 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Refreshing aggregate associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, aggregates: None {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 06:57:55 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Refreshing trait associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 06:57:55 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:57:55 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:57:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:55 user nova-compute[73258]: INFO nova.network.neutron [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Updating port 1e7db346-1c0e-4a29-a6e9-053cd736b399 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 27 06:57:55 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:57:55 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:57:55 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquired lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.network.neutron [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.compute.manager [req-d1698abf-6dd2-400f-b08b-0cddf531c34c req-813f2720-d547-4d69-acf8-9ce82bc36142 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received event network-changed-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.compute.manager [req-d1698abf-6dd2-400f-b08b-0cddf531c34c req-813f2720-d547-4d69-acf8-9ce82bc36142 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Refreshing instance network info cache due to event network-changed-1e7db346-1c0e-4a29-a6e9-053cd736b399. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d1698abf-6dd2-400f-b08b-0cddf531c34c req-813f2720-d547-4d69-acf8-9ce82bc36142 service nova] Acquiring lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.network.neutron [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Updating instance_info_cache with network_info: [{"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Releasing lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:57:56 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Creating image(s)
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Did not create local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Ensure instance console log exists: /opt/stack/data/nova/instances/0c16951e-8620-493f-8af4-fbdc64e1c131/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Start _get_guest_xml network_info=[{"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbFOBqYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0c16951e-8620-493f-8af4-fbdc64e1c131', 'attached_at': '', 'detached_at': '', 'volume_id': '7ad57bda-1e6b-42da-b681-1a8d6a4baa16', 'serial': '7ad57bda-1e6b-42da-b681-1a8d6a4baa16'}, 'attachment_id': '8f755d8e-d3b7-456e-9c52-3dbd4de67ab7', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d1698abf-6dd2-400f-b08b-0cddf531c34c req-813f2720-d547-4d69-acf8-9ce82bc36142 service nova] Acquired lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.network.neutron [req-d1698abf-6dd2-400f-b08b-0cddf531c34c req-813f2720-d547-4d69-acf8-9ce82bc36142 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Refreshing network info cache for port 1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:57:56 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:57:56 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:57:56 user nova-compute[73258]: DEBUG nova.objects.instance [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0c16951e-8620-493f-8af4-fbdc64e1c131 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG nova.objects.base [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Object Instance<0c16951e-8620-493f-8af4-fbdc64e1c131> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbFOBqYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:57:57 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:57:57 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:57:57 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9184fa-fabd-4834-bd5b-3e0cf6d4c8a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:57:57 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a9607c-d1c0-4d50-8e4c-48de3f56abbf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16] added
Aug 27 06:57:57 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34dbe2f-e0a2-4767-91a0-80b9cdd3815b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d398d2-f9f1-4beb-9a51-7c2f3d266a06]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KbFOBqYG {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KbFOBqYG" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37291ab-3404-4e79-8b1c-e8afdbef3ebd]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KbFOBqYG'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ac7013-0427-4a5a-92a8-66105c48f065]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[11318c96-b5c2-4211-8446-4a50501c94aa]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:57:57 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:57:57 user nova-compute[73258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 (non-flash)
Aug 27 06:57:57 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:57:57 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:57:57 user nova-compute[73258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 (non-flash)
Aug 27 06:57:57 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b51cfd-6995-4ef1-844b-76513115d4fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16, portal: 172.16.0.220,3260]
Aug 27 06:57:57 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16, portal: 172.16.0.220,3260] successful.
Aug 27 06:57:57 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.080s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[35677f69-1c6f-4ad1-b736-357a7212a72f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbae8ed7-3b9a-4bb0-bcb0-cf93c96a0b54]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:57:57 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:57:57 user nova-compute[73258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 (non-flash)
Aug 27 06:57:57 user nova-compute[73258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:57:57 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:57:57 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:57:57 user nova-compute[73258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 (non-flash)
Aug 27 06:57:57 user nova-compute[73258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:57:57 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b10e23-3d20-4ace-b4c4-228e01cd03b0]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbFOBqYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG nova.network.neutron [req-d1698abf-6dd2-400f-b08b-0cddf531c34c req-813f2720-d547-4d69-acf8-9ce82bc36142 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Updated VIF entry in instance network info cache for port 1e7db346-1c0e-4a29-a6e9-053cd736b399. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG nova.network.neutron [req-d1698abf-6dd2-400f-b08b-0cddf531c34c req-813f2720-d547-4d69-acf8-9ce82bc36142 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Updating instance_info_cache with network_info: [{"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:57:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d1698abf-6dd2-400f-b08b-0cddf531c34c req-813f2720-d547-4d69-acf8-9ce82bc36142 service nova] Releasing lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '23461356434343463', 'path': '/dev/sdc'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461356434343463', 'path': '/dev/sdc'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T06:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1310771159',display_name='tempest-TestShelveInstance-server-1310771159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1310771159',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1450465266',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c14d7b80576d482a9b88ac09acdd2a55',ramdisk_id='',reservation_id='r-hyw6wngo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1338223853',owner_user_name='tempest-TestShelveInstance-1338223853-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:57:22Z,user_data=None,user_id='a31d853a46bd447e9bc757694d6cbf5a',uuid=0c16951e-8620-493f-8af4-fbdc64e1c131,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Converting VIF {"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=1e7db346-1c0e-4a29-a6e9-053cd736b399,network=Network(43c6935e-b9dd-46c2-a9b1-619444517b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7db346-1c') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG nova.objects.instance [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c16951e-8620-493f-8af4-fbdc64e1c131 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG nova.objects.base [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Object Instance<0c16951e-8620-493f-8af4-fbdc64e1c131> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:57:58 user nova-compute[73258]:   <uuid>0c16951e-8620-493f-8af4-fbdc64e1c131</uuid>
Aug 27 06:57:58 user nova-compute[73258]:   <name>instance-00000025</name>
Aug 27 06:57:58 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:57:58 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:57:58 user nova-compute[73258]:   <metadata>
Aug 27 06:57:58 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:57:58 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:57:58 user nova-compute[73258]:       <nova:name>tempest-TestShelveInstance-server-1310771159</nova:name>
Aug 27 06:57:58 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:57:56</nova:creationTime>
Aug 27 06:57:58 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:57:58 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:57:58 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:57:58 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:57:58 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:57:58 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:57:58 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:57:58 user nova-compute[73258]:       <nova:owner>
Aug 27 06:57:58 user nova-compute[73258]:         <nova:user uuid="a31d853a46bd447e9bc757694d6cbf5a">tempest-TestShelveInstance-1338223853-project-member</nova:user>
Aug 27 06:57:58 user nova-compute[73258]:         <nova:project uuid="c14d7b80576d482a9b88ac09acdd2a55">tempest-TestShelveInstance-1338223853</nova:project>
Aug 27 06:57:58 user nova-compute[73258]:       </nova:owner>
Aug 27 06:57:58 user nova-compute[73258]:       <nova:ports>
Aug 27 06:57:58 user nova-compute[73258]:         <nova:port uuid="1e7db346-1c0e-4a29-a6e9-053cd736b399">
Aug 27 06:57:58 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 06:57:58 user nova-compute[73258]:         </nova:port>
Aug 27 06:57:58 user nova-compute[73258]:       </nova:ports>
Aug 27 06:57:58 user nova-compute[73258]:     </nova:instance>
Aug 27 06:57:58 user nova-compute[73258]:   </metadata>
Aug 27 06:57:58 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:57:58 user nova-compute[73258]:     <system>
Aug 27 06:57:58 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:57:58 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:57:58 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:57:58 user nova-compute[73258]:       <entry name="serial">0c16951e-8620-493f-8af4-fbdc64e1c131</entry>
Aug 27 06:57:58 user nova-compute[73258]:       <entry name="uuid">0c16951e-8620-493f-8af4-fbdc64e1c131</entry>
Aug 27 06:57:58 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:57:58 user nova-compute[73258]:     </system>
Aug 27 06:57:58 user nova-compute[73258]:   </sysinfo>
Aug 27 06:57:58 user nova-compute[73258]:   <os>
Aug 27 06:57:58 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:57:58 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:57:58 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:57:58 user nova-compute[73258]:   </os>
Aug 27 06:57:58 user nova-compute[73258]:   <features>
Aug 27 06:57:58 user nova-compute[73258]:     <acpi/>
Aug 27 06:57:58 user nova-compute[73258]:     <apic/>
Aug 27 06:57:58 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:57:58 user nova-compute[73258]:   </features>
Aug 27 06:57:58 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:57:58 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:57:58 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:57:58 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:57:58 user nova-compute[73258]:   </clock>
Aug 27 06:57:58 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:57:58 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:57:58 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:57:58 user nova-compute[73258]:   </cpu>
Aug 27 06:57:58 user nova-compute[73258]:   <devices>
Aug 27 06:57:58 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:57:58 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:57:58 user nova-compute[73258]:       <source dev="/dev/sdc"/>
Aug 27 06:57:58 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:57:58 user nova-compute[73258]:       <serial>7ad57bda-1e6b-42da-b681-1a8d6a4baa16</serial>
Aug 27 06:57:58 user nova-compute[73258]:     </disk>
Aug 27 06:57:58 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:57:58 user nova-compute[73258]:       <mac address="fa:16:3e:cc:56:5a"/>
Aug 27 06:57:58 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:57:58 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:57:58 user nova-compute[73258]:       <target dev="tap1e7db346-1c"/>
Aug 27 06:57:58 user nova-compute[73258]:     </interface>
Aug 27 06:57:58 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:57:58 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/0c16951e-8620-493f-8af4-fbdc64e1c131/console.log" append="off"/>
Aug 27 06:57:58 user nova-compute[73258]:     </serial>
Aug 27 06:57:58 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:57:58 user nova-compute[73258]:     <video>
Aug 27 06:57:58 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:57:58 user nova-compute[73258]:     </video>
Aug 27 06:57:58 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:57:58 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:57:58 user nova-compute[73258]:     </rng>
Aug 27 06:57:58 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:57:58 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:57:58 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:57:58 user nova-compute[73258]:     </memballoon>
Aug 27 06:57:58 user nova-compute[73258]:   </devices>
Aug 27 06:57:58 user nova-compute[73258]: </domain>
Aug 27 06:57:58 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T06:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1310771159',display_name='tempest-TestShelveInstance-server-1310771159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1310771159',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1450465266',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c14d7b80576d482a9b88ac09acdd2a55',ramdisk_id='',reservation_id='r-hyw6wngo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1338223853',owner_user_name='tempest-TestShelveInstance-1338223853-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:57:22Z,user_data=None,user_id='a31d853a46bd447e9bc757694d6cbf5a',uuid=0c16951e-8620-493f-8af4-fbdc64e1c131,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Converting VIF {"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=1e7db346-1c0e-4a29-a6e9-053cd736b399,network=Network(43c6935e-b9dd-46c2-a9b1-619444517b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7db346-1c') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG os_vif [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=1e7db346-1c0e-4a29-a6e9-053cd736b399,network=Network(43c6935e-b9dd-46c2-a9b1-619444517b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7db346-1c') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e7db346-1c, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e7db346-1c, col_values=(('external_ids', {'iface-id': '1e7db346-1c0e-4a29-a6e9-053cd736b399', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:56:5a', 'vm-uuid': '0c16951e-8620-493f-8af4-fbdc64e1c131'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:58 user nova-compute[73258]: INFO os_vif [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=1e7db346-1c0e-4a29-a6e9-053cd736b399,network=Network(43c6935e-b9dd-46c2-a9b1-619444517b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7db346-1c')
Aug 27 06:57:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:57:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] No VIF found with MAC fa:16:3e:cc:56:5a, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:57:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:59 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:57:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:57:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:57:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:57:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:57:59 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:58:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:00 user nova-compute[73258]: DEBUG nova.compute.manager [req-2e9b50b9-6188-4b81-8a2a-c172b6dc0329 req-44604d77-747d-47c8-b8a5-286018c772ee service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received event network-vif-plugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:58:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2e9b50b9-6188-4b81-8a2a-c172b6dc0329 req-44604d77-747d-47c8-b8a5-286018c772ee service nova] Acquiring lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:58:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2e9b50b9-6188-4b81-8a2a-c172b6dc0329 req-44604d77-747d-47c8-b8a5-286018c772ee service nova] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:58:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2e9b50b9-6188-4b81-8a2a-c172b6dc0329 req-44604d77-747d-47c8-b8a5-286018c772ee service nova] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:58:00 user nova-compute[73258]: DEBUG nova.compute.manager [req-2e9b50b9-6188-4b81-8a2a-c172b6dc0329 req-44604d77-747d-47c8-b8a5-286018c772ee service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] No waiting events found dispatching network-vif-plugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:58:00 user nova-compute[73258]: WARNING nova.compute.manager [req-2e9b50b9-6188-4b81-8a2a-c172b6dc0329 req-44604d77-747d-47c8-b8a5-286018c772ee service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received unexpected event network-vif-plugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 06:58:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:00 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:58:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:58:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:58:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119482.7800481, 0c16951e-8620-493f-8af4-fbdc64e1c131 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:58:03 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] VM Resumed (Lifecycle Event)
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.manager [req-c8b60e77-6b8b-4d67-9b57-8383b91f643e req-2a650c23-5abe-487b-a735-d14fd377ecd0 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received event network-vif-plugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8b60e77-6b8b-4d67-9b57-8383b91f643e req-2a650c23-5abe-487b-a735-d14fd377ecd0 service nova] Acquiring lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8b60e77-6b8b-4d67-9b57-8383b91f643e req-2a650c23-5abe-487b-a735-d14fd377ecd0 service nova] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c8b60e77-6b8b-4d67-9b57-8383b91f643e req-2a650c23-5abe-487b-a735-d14fd377ecd0 service nova] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.manager [req-c8b60e77-6b8b-4d67-9b57-8383b91f643e req-2a650c23-5abe-487b-a735-d14fd377ecd0 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] No waiting events found dispatching network-vif-plugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:58:03 user nova-compute[73258]: WARNING nova.compute.manager [req-c8b60e77-6b8b-4d67-9b57-8383b91f643e req-2a650c23-5abe-487b-a735-d14fd377ecd0 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received unexpected event network-vif-plugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:58:03 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:58:03 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=7739MB free_disk=23.757137298583984GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:58:03 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Instance spawned successfully.
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:58:03 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119482.780467, 0c16951e-8620-493f-8af4-fbdc64e1c131 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:58:03 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] VM Started (Lifecycle Event)
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a836678e-240d-4ead-b0b5-64d146910a23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 7ee743f1-9611-4165-838e-54fccb332f1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a296fb1e-1999-475c-9a15-eeeedfa11247 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance d2edd67c-c877-4c45-ae13-ee5f82853066 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (13f05024-5078-4590-94a5-110d29d864c8): {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. Skipping heal of allocations during the task state transition. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:58:03 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:58:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f99836e4-06f9-4fee-9eb5-4c0c2efe1057 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 41.245s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:58:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:58:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:05 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:58:05 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 06:58:05 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] There are 0 instances to clean {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 06:58:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "d2edd67c-c877-4c45-ae13-ee5f82853066" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG nova.objects.instance [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lazy-loading 'flavor' on Instance uuid d2edd67c-c877-4c45-ae13-ee5f82853066 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "d2edd67c-c877-4c45-ae13-ee5f82853066" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:58:23 user nova-compute[73258]: INFO nova.compute.manager [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Attaching volume 949c879e-8298-4d6f-a4bf-4dcd526f8013 to /dev/vdb
Aug 27 06:58:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG os_brick.utils [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b056114c-98df-46c9-9fab-175febb17686]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5100f6b3-874d-4b93-a457-935913b0a3ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcde2800-1e7f-4d94-83b1-ffac1506d2d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fb8e32-5176-4206-bc08-b51bc7ec6471]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:58:23 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:58:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[595255ec-1917-4ce6-908d-486245b72a29]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG os_brick.utils [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:58:23 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Updating existing volume attachment record: ecdc2c80-8303-4ebf-af75-480be0bc3073 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:58:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Acquiring lock "b17c6dd1-2525-411d-8b81-eb87c81c8527" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:58:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Lock "b17c6dd1-2525-411d-8b81-eb87c81c8527" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:58:25 user nova-compute[73258]: DEBUG nova.compute.manager [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 06:58:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:58:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:58:26 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 06:58:26 user nova-compute[73258]: INFO nova.compute.claims [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Claim successful on node user
Aug 27 06:58:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:26 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:58:26 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:58:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:58:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 06:58:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 06:58:26 user nova-compute[73258]: DEBUG nova.network.neutron [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 06:58:26 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 06:58:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 06:58:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 06:58:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 06:58:26 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Creating image(s)
Aug 27 06:58:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Acquiring lock "/opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:58:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Lock "/opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:58:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Lock "/opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:58:26 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:26 user nova-compute[73258]: DEBUG nova.policy [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d65f266cc6d4beeb060324ab632e317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b987eec62211484791651d45bdad37be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.249s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.212s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/disk 1073741824" returned: 0 in 0.072s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.201s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG nova.network.neutron [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Successfully created port: 18d33991-02ad-4170-b4f7-e58280997f72 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Cannot resize image /opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Ensure instance console log exists: /opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:58:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:58:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:28 user nova-compute[73258]: DEBUG nova.network.neutron [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Successfully updated port: 18d33991-02ad-4170-b4f7-e58280997f72 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 06:58:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Acquiring lock "refresh_cache-b17c6dd1-2525-411d-8b81-eb87c81c8527" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:58:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Acquired lock "refresh_cache-b17c6dd1-2525-411d-8b81-eb87c81c8527" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:58:28 user nova-compute[73258]: DEBUG nova.network.neutron [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:58:28 user nova-compute[73258]: DEBUG nova.network.neutron [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.compute.manager [req-3b317a4f-dadb-43a8-8796-1d30660100ee req-9ae78348-f308-4fa1-bece-4fb2d131d5b2 service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Received event network-changed-18d33991-02ad-4170-b4f7-e58280997f72 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.compute.manager [req-3b317a4f-dadb-43a8-8796-1d30660100ee req-9ae78348-f308-4fa1-bece-4fb2d131d5b2 service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Refreshing instance network info cache due to event network-changed-18d33991-02ad-4170-b4f7-e58280997f72. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3b317a4f-dadb-43a8-8796-1d30660100ee req-9ae78348-f308-4fa1-bece-4fb2d131d5b2 service nova] Acquiring lock "refresh_cache-b17c6dd1-2525-411d-8b81-eb87c81c8527" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.network.neutron [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Updating instance_info_cache with network_info: [{"id": "18d33991-02ad-4170-b4f7-e58280997f72", "address": "fa:16:3e:b1:e2:cd", "network": {"id": "0f039a84-551e-4075-8bb5-2c07ad845c46", "bridge": "br-int", "label": "tempest-VolumesActionsTest-572218927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b987eec62211484791651d45bdad37be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d33991-02", "ovs_interfaceid": "18d33991-02ad-4170-b4f7-e58280997f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Releasing lock "refresh_cache-b17c6dd1-2525-411d-8b81-eb87c81c8527" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Instance network_info: |[{"id": "18d33991-02ad-4170-b4f7-e58280997f72", "address": "fa:16:3e:b1:e2:cd", "network": {"id": "0f039a84-551e-4075-8bb5-2c07ad845c46", "bridge": "br-int", "label": "tempest-VolumesActionsTest-572218927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b987eec62211484791651d45bdad37be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d33991-02", "ovs_interfaceid": "18d33991-02ad-4170-b4f7-e58280997f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3b317a4f-dadb-43a8-8796-1d30660100ee req-9ae78348-f308-4fa1-bece-4fb2d131d5b2 service nova] Acquired lock "refresh_cache-b17c6dd1-2525-411d-8b81-eb87c81c8527" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.network.neutron [req-3b317a4f-dadb-43a8-8796-1d30660100ee req-9ae78348-f308-4fa1-bece-4fb2d131d5b2 service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Refreshing network info cache for port 18d33991-02ad-4170-b4f7-e58280997f72 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Start _get_guest_xml network_info=[{"id": "18d33991-02ad-4170-b4f7-e58280997f72", "address": "fa:16:3e:b1:e2:cd", "network": {"id": "0f039a84-551e-4075-8bb5-2c07ad845c46", "bridge": "br-int", "label": "tempest-VolumesActionsTest-572218927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b987eec62211484791651d45bdad37be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d33991-02", "ovs_interfaceid": "18d33991-02ad-4170-b4f7-e58280997f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:58:29 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:58:29 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1675980342',display_name='tempest-VolumesActionsTest-instance-1675980342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1675980342',id=42,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b987eec62211484791651d45bdad37be',ramdisk_id='',reservation_id='r-cnod2hp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-10137930',owner_user_name='tempest-VolumesActionsTest-10137930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:58:27Z,user_data=None,user_id='1d65f266cc6d4beeb060324ab632e317',uuid=b17c6dd1-2525-411d-8b81-eb87c81c8527,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18d33991-02ad-4170-b4f7-e58280997f72", "address": "fa:16:3e:b1:e2:cd", "network": {"id": "0f039a84-551e-4075-8bb5-2c07ad845c46", "bridge": "br-int", "label": "tempest-VolumesActionsTest-572218927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b987eec62211484791651d45bdad37be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d33991-02", "ovs_interfaceid": "18d33991-02ad-4170-b4f7-e58280997f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Converting VIF {"id": "18d33991-02ad-4170-b4f7-e58280997f72", "address": "fa:16:3e:b1:e2:cd", "network": {"id": "0f039a84-551e-4075-8bb5-2c07ad845c46", "bridge": "br-int", "label": "tempest-VolumesActionsTest-572218927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b987eec62211484791651d45bdad37be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d33991-02", "ovs_interfaceid": "18d33991-02ad-4170-b4f7-e58280997f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e2:cd,bridge_name='br-int',has_traffic_filtering=True,id=18d33991-02ad-4170-b4f7-e58280997f72,network=Network(0f039a84-551e-4075-8bb5-2c07ad845c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d33991-02') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.objects.instance [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Lazy-loading 'pci_devices' on Instance uuid b17c6dd1-2525-411d-8b81-eb87c81c8527 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:58:29 user nova-compute[73258]:   <uuid>b17c6dd1-2525-411d-8b81-eb87c81c8527</uuid>
Aug 27 06:58:29 user nova-compute[73258]:   <name>instance-0000002a</name>
Aug 27 06:58:29 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:58:29 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:58:29 user nova-compute[73258]:   <metadata>
Aug 27 06:58:29 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:58:29 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:58:29 user nova-compute[73258]:       <nova:name>tempest-VolumesActionsTest-instance-1675980342</nova:name>
Aug 27 06:58:29 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:58:29</nova:creationTime>
Aug 27 06:58:29 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:58:29 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:58:29 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:58:29 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:58:29 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:58:29 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:58:29 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:58:29 user nova-compute[73258]:       <nova:owner>
Aug 27 06:58:29 user nova-compute[73258]:         <nova:user uuid="1d65f266cc6d4beeb060324ab632e317">tempest-VolumesActionsTest-10137930-project-member</nova:user>
Aug 27 06:58:29 user nova-compute[73258]:         <nova:project uuid="b987eec62211484791651d45bdad37be">tempest-VolumesActionsTest-10137930</nova:project>
Aug 27 06:58:29 user nova-compute[73258]:       </nova:owner>
Aug 27 06:58:29 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 06:58:29 user nova-compute[73258]:       <nova:ports>
Aug 27 06:58:29 user nova-compute[73258]:         <nova:port uuid="18d33991-02ad-4170-b4f7-e58280997f72">
Aug 27 06:58:29 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 06:58:29 user nova-compute[73258]:         </nova:port>
Aug 27 06:58:29 user nova-compute[73258]:       </nova:ports>
Aug 27 06:58:29 user nova-compute[73258]:     </nova:instance>
Aug 27 06:58:29 user nova-compute[73258]:   </metadata>
Aug 27 06:58:29 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:58:29 user nova-compute[73258]:     <system>
Aug 27 06:58:29 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:58:29 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:58:29 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:58:29 user nova-compute[73258]:       <entry name="serial">b17c6dd1-2525-411d-8b81-eb87c81c8527</entry>
Aug 27 06:58:29 user nova-compute[73258]:       <entry name="uuid">b17c6dd1-2525-411d-8b81-eb87c81c8527</entry>
Aug 27 06:58:29 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:58:29 user nova-compute[73258]:     </system>
Aug 27 06:58:29 user nova-compute[73258]:   </sysinfo>
Aug 27 06:58:29 user nova-compute[73258]:   <os>
Aug 27 06:58:29 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:58:29 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:58:29 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:58:29 user nova-compute[73258]:   </os>
Aug 27 06:58:29 user nova-compute[73258]:   <features>
Aug 27 06:58:29 user nova-compute[73258]:     <acpi/>
Aug 27 06:58:29 user nova-compute[73258]:     <apic/>
Aug 27 06:58:29 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:58:29 user nova-compute[73258]:   </features>
Aug 27 06:58:29 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:58:29 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:58:29 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:58:29 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:58:29 user nova-compute[73258]:   </clock>
Aug 27 06:58:29 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:58:29 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:58:29 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:58:29 user nova-compute[73258]:   </cpu>
Aug 27 06:58:29 user nova-compute[73258]:   <devices>
Aug 27 06:58:29 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:58:29 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:58:29 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/disk"/>
Aug 27 06:58:29 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:58:29 user nova-compute[73258]:     </disk>
Aug 27 06:58:29 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:58:29 user nova-compute[73258]:       <mac address="fa:16:3e:b1:e2:cd"/>
Aug 27 06:58:29 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:58:29 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:58:29 user nova-compute[73258]:       <target dev="tap18d33991-02"/>
Aug 27 06:58:29 user nova-compute[73258]:     </interface>
Aug 27 06:58:29 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:58:29 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/console.log" append="off"/>
Aug 27 06:58:29 user nova-compute[73258]:     </serial>
Aug 27 06:58:29 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:58:29 user nova-compute[73258]:     <video>
Aug 27 06:58:29 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:58:29 user nova-compute[73258]:     </video>
Aug 27 06:58:29 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:58:29 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:58:29 user nova-compute[73258]:     </rng>
Aug 27 06:58:29 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:58:29 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:58:29 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:58:29 user nova-compute[73258]:     </memballoon>
Aug 27 06:58:29 user nova-compute[73258]:   </devices>
Aug 27 06:58:29 user nova-compute[73258]: </domain>
Aug 27 06:58:29 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1675980342',display_name='tempest-VolumesActionsTest-instance-1675980342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1675980342',id=42,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b987eec62211484791651d45bdad37be',ramdisk_id='',reservation_id='r-cnod2hp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-10137930',owner_user_name='tempest-VolumesActionsTest-10137930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:58:27Z,user_data=None,user_id='1d65f266cc6d4beeb060324ab632e317',uuid=b17c6dd1-2525-411d-8b81-eb87c81c8527,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18d33991-02ad-4170-b4f7-e58280997f72", "address": "fa:16:3e:b1:e2:cd", "network": {"id": "0f039a84-551e-4075-8bb5-2c07ad845c46", "bridge": "br-int", "label": "tempest-VolumesActionsTest-572218927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b987eec62211484791651d45bdad37be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d33991-02", "ovs_interfaceid": "18d33991-02ad-4170-b4f7-e58280997f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Converting VIF {"id": "18d33991-02ad-4170-b4f7-e58280997f72", "address": "fa:16:3e:b1:e2:cd", "network": {"id": "0f039a84-551e-4075-8bb5-2c07ad845c46", "bridge": "br-int", "label": "tempest-VolumesActionsTest-572218927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b987eec62211484791651d45bdad37be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d33991-02", "ovs_interfaceid": "18d33991-02ad-4170-b4f7-e58280997f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e2:cd,bridge_name='br-int',has_traffic_filtering=True,id=18d33991-02ad-4170-b4f7-e58280997f72,network=Network(0f039a84-551e-4075-8bb5-2c07ad845c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d33991-02') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG os_vif [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e2:cd,bridge_name='br-int',has_traffic_filtering=True,id=18d33991-02ad-4170-b4f7-e58280997f72,network=Network(0f039a84-551e-4075-8bb5-2c07ad845c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d33991-02') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18d33991-02, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18d33991-02, col_values=(('external_ids', {'iface-id': '18d33991-02ad-4170-b4f7-e58280997f72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:e2:cd', 'vm-uuid': 'b17c6dd1-2525-411d-8b81-eb87c81c8527'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:29 user nova-compute[73258]: INFO os_vif [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e2:cd,bridge_name='br-int',has_traffic_filtering=True,id=18d33991-02ad-4170-b4f7-e58280997f72,network=Network(0f039a84-551e-4075-8bb5-2c07ad845c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d33991-02')
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] No VIF found with MAC fa:16:3e:b1:e2:cd, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.network.neutron [req-3b317a4f-dadb-43a8-8796-1d30660100ee req-9ae78348-f308-4fa1-bece-4fb2d131d5b2 service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Updated VIF entry in instance network info cache for port 18d33991-02ad-4170-b4f7-e58280997f72. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG nova.network.neutron [req-3b317a4f-dadb-43a8-8796-1d30660100ee req-9ae78348-f308-4fa1-bece-4fb2d131d5b2 service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Updating instance_info_cache with network_info: [{"id": "18d33991-02ad-4170-b4f7-e58280997f72", "address": "fa:16:3e:b1:e2:cd", "network": {"id": "0f039a84-551e-4075-8bb5-2c07ad845c46", "bridge": "br-int", "label": "tempest-VolumesActionsTest-572218927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b987eec62211484791651d45bdad37be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d33991-02", "ovs_interfaceid": "18d33991-02ad-4170-b4f7-e58280997f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:58:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3b317a4f-dadb-43a8-8796-1d30660100ee req-9ae78348-f308-4fa1-bece-4fb2d131d5b2 service nova] Releasing lock "refresh_cache-b17c6dd1-2525-411d-8b81-eb87c81c8527" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:58:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:31 user nova-compute[73258]: DEBUG nova.compute.manager [req-13ee87e6-fed1-4aab-823b-5327d2166a10 req-ea60888a-2185-4088-8d32-62cf9a9ffecf service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Received event network-vif-plugged-18d33991-02ad-4170-b4f7-e58280997f72 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:58:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-13ee87e6-fed1-4aab-823b-5327d2166a10 req-ea60888a-2185-4088-8d32-62cf9a9ffecf service nova] Acquiring lock "b17c6dd1-2525-411d-8b81-eb87c81c8527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:58:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-13ee87e6-fed1-4aab-823b-5327d2166a10 req-ea60888a-2185-4088-8d32-62cf9a9ffecf service nova] Lock "b17c6dd1-2525-411d-8b81-eb87c81c8527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:58:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-13ee87e6-fed1-4aab-823b-5327d2166a10 req-ea60888a-2185-4088-8d32-62cf9a9ffecf service nova] Lock "b17c6dd1-2525-411d-8b81-eb87c81c8527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:58:31 user nova-compute[73258]: DEBUG nova.compute.manager [req-13ee87e6-fed1-4aab-823b-5327d2166a10 req-ea60888a-2185-4088-8d32-62cf9a9ffecf service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] No waiting events found dispatching network-vif-plugged-18d33991-02ad-4170-b4f7-e58280997f72 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:58:31 user nova-compute[73258]: WARNING nova.compute.manager [req-13ee87e6-fed1-4aab-823b-5327d2166a10 req-ea60888a-2185-4088-8d32-62cf9a9ffecf service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Received unexpected event network-vif-plugged-18d33991-02ad-4170-b4f7-e58280997f72 for instance with vm_state building and task_state spawning.
Aug 27 06:58:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119513.77661, b17c6dd1-2525-411d-8b81-eb87c81c8527 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:58:33 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] VM Resumed (Lifecycle Event)
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 06:58:33 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Instance spawned successfully.
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:58:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:58:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:58:33 user nova-compute[73258]: INFO nova.compute.manager [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Detaching volume 96148ebb-1a49-4f8f-b866-3be0590c6b30
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.compute.manager [req-407ccd2c-c134-418b-b712-844159925a23 req-0c26eeb5-c19f-49b5-9e26-e7e285d13258 service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Received event network-vif-plugged-18d33991-02ad-4170-b4f7-e58280997f72 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:58:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-407ccd2c-c134-418b-b712-844159925a23 req-0c26eeb5-c19f-49b5-9e26-e7e285d13258 service nova] Acquiring lock "b17c6dd1-2525-411d-8b81-eb87c81c8527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:58:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-407ccd2c-c134-418b-b712-844159925a23 req-0c26eeb5-c19f-49b5-9e26-e7e285d13258 service nova] Lock "b17c6dd1-2525-411d-8b81-eb87c81c8527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:58:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-407ccd2c-c134-418b-b712-844159925a23 req-0c26eeb5-c19f-49b5-9e26-e7e285d13258 service nova] Lock "b17c6dd1-2525-411d-8b81-eb87c81c8527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.compute.manager [req-407ccd2c-c134-418b-b712-844159925a23 req-0c26eeb5-c19f-49b5-9e26-e7e285d13258 service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] No waiting events found dispatching network-vif-plugged-18d33991-02ad-4170-b4f7-e58280997f72 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:58:33 user nova-compute[73258]: WARNING nova.compute.manager [req-407ccd2c-c134-418b-b712-844159925a23 req-0c26eeb5-c19f-49b5-9e26-e7e285d13258 service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Received unexpected event network-vif-plugged-18d33991-02ad-4170-b4f7-e58280997f72 for instance with vm_state building and task_state spawning.
Aug 27 06:58:33 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119513.7808545, b17c6dd1-2525-411d-8b81-eb87c81c8527 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:58:33 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] VM Started (Lifecycle Event)
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:58:33 user nova-compute[73258]: INFO nova.virt.block_device [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Attempting to driver detach volume 96148ebb-1a49-4f8f-b866-3be0590c6b30 from mountpoint /dev/vdb
Aug 27 06:58:33 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Attempting to detach device vdb from instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:58:33 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:58:33 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:58:33 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:58:33 user nova-compute[73258]:   <serial>96148ebb-1a49-4f8f-b866-3be0590c6b30</serial>
Aug 27 06:58:33 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:58:33 user nova-compute[73258]: </disk>
Aug 27 06:58:33 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:58:33 user nova-compute[73258]: INFO nova.compute.manager [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Took 7.20 seconds to spawn the instance on the hypervisor.
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:58:33 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Successfully detached device vdb from instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 from the persistent domain config.
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:58:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:58:33 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:58:33 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:58:33 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:58:33 user nova-compute[73258]:   <serial>96148ebb-1a49-4f8f-b866-3be0590c6b30</serial>
Aug 27 06:58:33 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:58:33 user nova-compute[73258]: </disk>
Aug 27 06:58:33 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:58:34 user nova-compute[73258]: INFO nova.compute.manager [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Took 8.10 seconds to build instance.
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-15bb5147-9bd3-46db-8011-7a69fa51b3a8 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Lock "b17c6dd1-2525-411d-8b81-eb87c81c8527" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.288s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693119514.5039926, 54697fcb-9ffe-4660-b7d2-7b89dfd72439 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:58:34 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Successfully detached device vdb from instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 from the live domain config.
Aug 27 06:58:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bQlLmvNT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:58:34 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:58:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa33fea-28b8-498c-bd5c-68954af34859]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[147dd58b-cc6f-4dd1-a107-3cfca524ea65]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:58:34 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:58:34 user nova-compute[73258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 (non-flash)
Aug 27 06:58:34 user nova-compute[73258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:58:34 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:58:34 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:58:34 user nova-compute[73258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 (non-flash)
Aug 27 06:58:34 user nova-compute[73258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:58:34 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa410523370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[57775909-e000-44bd-9186-0020f955259d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd471a0-c798-4e82-8e5f-b646ec3bd653]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6de2bd-e041-48b5-ad5d-1e6dfd6553fe]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea06155-a57e-488b-b5e9-17dd0810a1e0]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9430c108-52bf-410a-be73-6632c9b74291]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05a9d53-a1bc-4c15-9c11-523eee1aab96]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30, portal: 172.16.0.220,3260]
Aug 27 06:58:34 user nova-compute[73258]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30, portal: 172.16.0.220,3260] successful.
Aug 27 06:58:34 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96148ebb-1a49-4f8f-b866-3be0590c6b30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df9c53d-9104-4dd2-b6ed-ee5d5f11f8bb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] <== disconnect_volume: return (362ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:58:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjYXaKJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:58:38 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:58:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:58:38 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:58:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:58:38 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:58:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260" returned: 21 in 0.040s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[25994999-dbe8-443c-809b-93baa74d527a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:58:38 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.156s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e971e0-574a-458b-a28c-478db74b63ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013] added
Aug 27 06:58:38 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.041s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d506ac-3e17-4c2f-bcac-c38bfb4a80bd]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c2e5ac-937f-43f5-afef-14bda86895fb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:58:38 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hjYXaKJx {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hjYXaKJx" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c52794-9052-4565-925e-bbd37c0e6b33]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hjYXaKJx'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbbc02d-bfb3-46d1-bc80-04d8506bf72f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c536129-48ec-48c4-9eef-2b2ced2e9ca5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:58:39 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:58:39 user nova-compute[73258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:58:39 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:58:39 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:58:39 user nova-compute[73258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:58:39 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c750448e-830b-4c5d-af0f-55a7b9fee071]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013, portal: 172.16.0.220,3260]
Aug 27 06:58:39 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013, portal: 172.16.0.220,3260] successful.
Aug 27 06:58:39 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc973ea-aa30-4c55-ba14-1d878a01b0a1]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dc49f4-d09c-4611-a3ec-0a736dd0b787]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:58:39 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:58:39 user nova-compute[73258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:58:39 user nova-compute[73258]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 06:58:39 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:58:39 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:58:39 user nova-compute[73258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:58:39 user nova-compute[73258]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 06:58:39 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.540s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe5c764-05cf-40ec-9ff2-13f7f7840a0f]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:40 user nova-compute[73258]: DEBUG nova.objects.instance [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lazy-loading 'flavor' on Instance uuid 54697fcb-9ffe-4660-b7d2-7b89dfd72439 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:58:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-aa35191d-a8dc-4071-8851-f006b33b14db tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.328s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:58:40 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:58:40 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjYXaKJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:58:40 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.575s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:58:40 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] <== connect_volume: return (1576ms) {'type': 'block', 'scsi_wwn': '23336626465626164', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:58:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336626465626164', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:58:40 user nova-compute[73258]: DEBUG nova.objects.instance [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lazy-loading 'flavor' on Instance uuid d2edd67c-c877-4c45-ae13-ee5f82853066 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:58:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:58:40 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:58:40 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 06:58:40 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:58:40 user nova-compute[73258]:   <serial>949c879e-8298-4d6f-a4bf-4dcd526f8013</serial>
Aug 27 06:58:40 user nova-compute[73258]: </disk>
Aug 27 06:58:40 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:58:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:58:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:58:40 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] No VIF found with MAC fa:16:3e:96:f3:ab, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:58:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3c7636c5-ecf1-4c6e-92b2-4eb9bdd43275 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.387s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:58:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:52 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:58:52 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:58:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:58:53 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:58:53 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:58:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:58:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:58:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:58:54 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:58:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:54 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Updating instance_info_cache with network_info: [{"id": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "address": "fa:16:3e:6f:e0:41", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7652cd00-a6", "ovs_interfaceid": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:58:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:58:54 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:58:54 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:58:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:54 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:58:55 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:58:55 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:58:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:58:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:00 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:59:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:59:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:59:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:59:02 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:59:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:03 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:59:03 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:59:03 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:59:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=7625MB free_disk=23.696308135986328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:59:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a836678e-240d-4ead-b0b5-64d146910a23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:59:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 7ee743f1-9611-4165-838e-54fccb332f1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:59:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:59:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a296fb1e-1999-475c-9a15-eeeedfa11247 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:59:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:59:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance d2edd67c-c877-4c45-ae13-ee5f82853066 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:59:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 0c16951e-8620-493f-8af4-fbdc64e1c131 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:59:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance b17c6dd1-2525-411d-8b81-eb87c81c8527 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:59:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:59:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:59:04 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:59:04 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:59:04 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:59:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-b8fa91be-4c26-44bc-bab0-707c29926c7e req-660c8e6b-1792-49d5-a495-b005aa3c0548 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received event network-changed-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:59:13 user nova-compute[73258]: DEBUG nova.compute.manager [req-b8fa91be-4c26-44bc-bab0-707c29926c7e req-660c8e6b-1792-49d5-a495-b005aa3c0548 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Refreshing instance network info cache due to event network-changed-1e7db346-1c0e-4a29-a6e9-053cd736b399. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:59:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b8fa91be-4c26-44bc-bab0-707c29926c7e req-660c8e6b-1792-49d5-a495-b005aa3c0548 service nova] Acquiring lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:59:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b8fa91be-4c26-44bc-bab0-707c29926c7e req-660c8e6b-1792-49d5-a495-b005aa3c0548 service nova] Acquired lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:59:13 user nova-compute[73258]: DEBUG nova.network.neutron [req-b8fa91be-4c26-44bc-bab0-707c29926c7e req-660c8e6b-1792-49d5-a495-b005aa3c0548 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Refreshing network info cache for port 1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:59:13 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:59:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "0c16951e-8620-493f-8af4-fbdc64e1c131" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:13 user nova-compute[73258]: INFO nova.compute.manager [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Terminating instance
Aug 27 06:59:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:59:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:13 user nova-compute[73258]: DEBUG nova.network.neutron [req-b8fa91be-4c26-44bc-bab0-707c29926c7e req-660c8e6b-1792-49d5-a495-b005aa3c0548 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Updated VIF entry in instance network info cache for port 1e7db346-1c0e-4a29-a6e9-053cd736b399. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:59:13 user nova-compute[73258]: DEBUG nova.network.neutron [req-b8fa91be-4c26-44bc-bab0-707c29926c7e req-660c8e6b-1792-49d5-a495-b005aa3c0548 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Updating instance_info_cache with network_info: [{"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:59:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b8fa91be-4c26-44bc-bab0-707c29926c7e req-660c8e6b-1792-49d5-a495-b005aa3c0548 service nova] Releasing lock "refresh_cache-0c16951e-8620-493f-8af4-fbdc64e1c131" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:59:14 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Instance destroyed successfully.
Aug 27 06:59:14 user nova-compute[73258]: DEBUG nova.objects.instance [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lazy-loading 'resources' on Instance uuid 0c16951e-8620-493f-8af4-fbdc64e1c131 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T06:53:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1310771159',display_name='tempest-TestShelveInstance-server-1310771159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1310771159',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuaT2R5PPsAjc4NYciVpWptrbTp6s6w2hKpiAve1cx+pMVmkK9XU7VZvJEmmRfJw5taHvUwTh9xmdg2Dr/ClFtvIClQmBmDLE/7t8SdzixfG5H7Wm1+fm9Ad5ILDjSUXg==',key_name='tempest-TestShelveInstance-1450465266',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:58:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c14d7b80576d482a9b88ac09acdd2a55',ramdisk_id='',reservation_id='r-hyw6wngo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1338223853',owner_user_name='tempest-TestShelveInstance-1338223853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:58:03Z,user_data=None,user_id='a31d853a46bd447e9bc757694d6cbf5a',uuid=0c16951e-8620-493f-8af4-fbdc64e1c131,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Converting VIF {"id": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "address": "fa:16:3e:cc:56:5a", "network": {"id": "43c6935e-b9dd-46c2-a9b1-619444517b4f", "bridge": "br-int", "label": "tempest-TestShelveInstance-1265130154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14d7b80576d482a9b88ac09acdd2a55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7db346-1c", "ovs_interfaceid": "1e7db346-1c0e-4a29-a6e9-053cd736b399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=1e7db346-1c0e-4a29-a6e9-053cd736b399,network=Network(43c6935e-b9dd-46c2-a9b1-619444517b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7db346-1c') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG os_vif [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=1e7db346-1c0e-4a29-a6e9-053cd736b399,network=Network(43c6935e-b9dd-46c2-a9b1-619444517b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7db346-1c') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e7db346-1c, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:59:14 user nova-compute[73258]: INFO os_vif [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=1e7db346-1c0e-4a29-a6e9-053cd736b399,network=Network(43c6935e-b9dd-46c2-a9b1-619444517b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7db346-1c')
Aug 27 06:59:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KbFOBqYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:59:14 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:59:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbce869-f832-4654-ab5f-424af7831dbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd8ca4b-d584-4e04-9bd3-427143e33a60]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:59:14 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:59:14 user nova-compute[73258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:59:14 user nova-compute[73258]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 06:59:14 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:59:14 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:59:14 user nova-compute[73258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 (non-flash)
Aug 27 06:59:14 user nova-compute[73258]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 06:59:14 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4105ca830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16'): ({'sdc'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Removing single pathed devices sdc {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8910fef8-5fbb-4b39-b373-ea38fe5df212]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f010009f-3649-4b40-8907-2f01f1896d73]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Flushing IO for device /dev/sdc {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39cffbe-8337-466a-8120-2b36110fea47]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f9ab5b-0a28-45b6-892f-bfe42d826269]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4766b1aa-07d9-4cec-97ac-13a180d8f1c0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[652b9983-3b21-408b-8fa2-d3a1ece76abd]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16, portal: 172.16.0.220,3260]
Aug 27 06:59:14 user nova-compute[73258]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16, portal: 172.16.0.220,3260] successful.
Aug 27 06:59:14 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ad57bda-1e6b-42da-b681-1a8d6a4baa16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a0028e-d778-4e00-8313-6e142477eb68]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] <== disconnect_volume: return (344ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:59:14 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Deleting instance files /opt/stack/data/nova/instances/0c16951e-8620-493f-8af4-fbdc64e1c131_del
Aug 27 06:59:14 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Deletion of /opt/stack/data/nova/instances/0c16951e-8620-493f-8af4-fbdc64e1c131_del complete
Aug 27 06:59:14 user nova-compute[73258]: INFO nova.compute.manager [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Took 1.41 seconds to destroy the instance on the hypervisor.
Aug 27 06:59:14 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:59:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-eb49d163-d0c5-4673-adb6-6aa066ee4f8c req-68e26982-4002-4219-90b8-b3c41c6d2c17 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received event network-vif-unplugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:59:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-eb49d163-d0c5-4673-adb6-6aa066ee4f8c req-68e26982-4002-4219-90b8-b3c41c6d2c17 service nova] Acquiring lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-eb49d163-d0c5-4673-adb6-6aa066ee4f8c req-68e26982-4002-4219-90b8-b3c41c6d2c17 service nova] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-eb49d163-d0c5-4673-adb6-6aa066ee4f8c req-68e26982-4002-4219-90b8-b3c41c6d2c17 service nova] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-eb49d163-d0c5-4673-adb6-6aa066ee4f8c req-68e26982-4002-4219-90b8-b3c41c6d2c17 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] No waiting events found dispatching network-vif-unplugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:59:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-eb49d163-d0c5-4673-adb6-6aa066ee4f8c req-68e26982-4002-4219-90b8-b3c41c6d2c17 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received event network-vif-unplugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:59:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-eb49d163-d0c5-4673-adb6-6aa066ee4f8c req-68e26982-4002-4219-90b8-b3c41c6d2c17 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received event network-vif-plugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:59:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-eb49d163-d0c5-4673-adb6-6aa066ee4f8c req-68e26982-4002-4219-90b8-b3c41c6d2c17 service nova] Acquiring lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-eb49d163-d0c5-4673-adb6-6aa066ee4f8c req-68e26982-4002-4219-90b8-b3c41c6d2c17 service nova] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-eb49d163-d0c5-4673-adb6-6aa066ee4f8c req-68e26982-4002-4219-90b8-b3c41c6d2c17 service nova] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-eb49d163-d0c5-4673-adb6-6aa066ee4f8c req-68e26982-4002-4219-90b8-b3c41c6d2c17 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] No waiting events found dispatching network-vif-plugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:59:15 user nova-compute[73258]: WARNING nova.compute.manager [req-eb49d163-d0c5-4673-adb6-6aa066ee4f8c req-68e26982-4002-4219-90b8-b3c41c6d2c17 service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received unexpected event network-vif-plugged-1e7db346-1c0e-4a29-a6e9-053cd736b399 for instance with vm_state active and task_state deleting.
Aug 27 06:59:15 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:59:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-9efe3a1c-3d21-45da-af9a-70a5eb63a188 req-31f4c05f-169e-404c-bf85-c4ebc7b16d0c service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Received event network-vif-deleted-1e7db346-1c0e-4a29-a6e9-053cd736b399 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:59:15 user nova-compute[73258]: INFO nova.compute.manager [req-9efe3a1c-3d21-45da-af9a-70a5eb63a188 req-31f4c05f-169e-404c-bf85-c4ebc7b16d0c service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Neutron deleted interface 1e7db346-1c0e-4a29-a6e9-053cd736b399; detaching it from the instance and deleting it from the info cache
Aug 27 06:59:15 user nova-compute[73258]: DEBUG nova.network.neutron [req-9efe3a1c-3d21-45da-af9a-70a5eb63a188 req-31f4c05f-169e-404c-bf85-c4ebc7b16d0c service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:59:15 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Took 0.76 seconds to deallocate network for instance.
Aug 27 06:59:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-9efe3a1c-3d21-45da-af9a-70a5eb63a188 req-31f4c05f-169e-404c-bf85-c4ebc7b16d0c service nova] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Detach interface failed, port_id=1e7db346-1c0e-4a29-a6e9-053cd736b399, reason: Instance 0c16951e-8620-493f-8af4-fbdc64e1c131 could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 06:59:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "a296fb1e-1999-475c-9a15-eeeedfa11247" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:15 user nova-compute[73258]: INFO nova.compute.manager [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Terminating instance
Aug 27 06:59:15 user nova-compute[73258]: DEBUG nova.compute.manager [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:59:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:16 user nova-compute[73258]: INFO nova.compute.manager [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Took 1.03 seconds to detach 1 volumes for instance.
Aug 27 06:59:16 user nova-compute[73258]: DEBUG nova.compute.manager [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Deleting volume: 7ad57bda-1e6b-42da-b681-1a8d6a4baa16 {{(pid=73258) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:16 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Instance destroyed successfully.
Aug 27 06:59:16 user nova-compute[73258]: DEBUG nova.objects.instance [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'resources' on Instance uuid a296fb1e-1999-475c-9a15-eeeedfa11247 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1066864047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1066864047',id=38,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:55:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81cf34590d8d4b8b89b9626c6e150df6',ramdisk_id='',reservation_id='r-psnz6f1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:57:31Z,user_data=None,user_id='36c0faed29a446aa9fa6ff8692581aba',uuid=a296fb1e-1999-475c-9a15-eeeedfa11247,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "address": "fa:16:3e:dd:b3:4a", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8b8c03-b3", "ovs_interfaceid": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converting VIF {"id": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "address": "fa:16:3e:dd:b3:4a", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8b8c03-b3", "ovs_interfaceid": "ae8b8c03-b302-4043-ac07-b3561b7bf6f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:b3:4a,bridge_name='br-int',has_traffic_filtering=True,id=ae8b8c03-b302-4043-ac07-b3561b7bf6f3,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8b8c03-b3') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG os_vif [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:b3:4a,bridge_name='br-int',has_traffic_filtering=True,id=ae8b8c03-b302-4043-ac07-b3561b7bf6f3,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8b8c03-b3') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae8b8c03-b3, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:59:16 user nova-compute[73258]: INFO os_vif [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:b3:4a,bridge_name='br-int',has_traffic_filtering=True,id=ae8b8c03-b302-4043-ac07-b3561b7bf6f3,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8b8c03-b3')
Aug 27 06:59:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvqxKAsl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:59:16 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:59:16 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[266696d0-0c1d-42b1-9334-dbd566c8a843]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91e7d37-0504-4615-a392-6eefb9232379]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:59:16 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:59:16 user nova-compute[73258]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 06:59:16 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:59:16 user nova-compute[73258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 (non-flash)
Aug 27 06:59:16 user nova-compute[73258]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 06:59:16 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa44d3d5240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8'): ({'sdf'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Removing single pathed devices sdf {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee63f6a-d6cb-4fd6-8263-0941db7ba5ce]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7807f092-fa86-4425-bcdb-4e558bce6cc6]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Flushing IO for device /dev/sdf {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadf4f3c-6a01-48df-8073-9f272763e713]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c293a40-d402-43b0-8500-ca59b6453fc4]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:59:16 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] SCSI volumes sdf have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26165643738333831', '/dev/disk/by-id/scsi-1SCST_BIOd83b786f-aed783814552d671', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d83b786f') {{(pid=84389) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b57fab-cd86-410e-80b3-4bf7bfa59f27]: (4, None) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6455d9-d5bf-4366-8d65-f6644268e3f8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46485f7-c6b5-4695-9dcd-11f29f81dd35]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8, portal: 172.16.0.220,3260]
Aug 27 06:59:17 user nova-compute[73258]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8, portal: 172.16.0.220,3260] successful.
Aug 27 06:59:17 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:17 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Deleted allocations for instance 0c16951e-8620-493f-8af4-fbdc64e1c131
Aug 27 06:59:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72986f09-60ad-4b9d-b257-813afd12e5d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[241f2072-36d1-4ab6-9818-542afe11cb1f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] <== disconnect_volume: return (399ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:59:17 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Deleting instance files /opt/stack/data/nova/instances/a296fb1e-1999-475c-9a15-eeeedfa11247_del
Aug 27 06:59:17 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Deletion of /opt/stack/data/nova/instances/a296fb1e-1999-475c-9a15-eeeedfa11247_del complete
Aug 27 06:59:17 user nova-compute[73258]: INFO nova.compute.manager [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Took 1.38 seconds to destroy the instance on the hypervisor.
Aug 27 06:59:17 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcffa01e-78f3-4269-9ea4-878fd2b47969 tempest-TestShelveInstance-1338223853 tempest-TestShelveInstance-1338223853-project-member] Lock "0c16951e-8620-493f-8af4-fbdc64e1c131" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.940s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-ba84f08a-bcd2-48e0-81d9-357d747090ea req-9b18028d-125b-4e3a-b25b-7804835ec0d3 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received event network-vif-unplugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ba84f08a-bcd2-48e0-81d9-357d747090ea req-9b18028d-125b-4e3a-b25b-7804835ec0d3 service nova] Acquiring lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ba84f08a-bcd2-48e0-81d9-357d747090ea req-9b18028d-125b-4e3a-b25b-7804835ec0d3 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ba84f08a-bcd2-48e0-81d9-357d747090ea req-9b18028d-125b-4e3a-b25b-7804835ec0d3 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-ba84f08a-bcd2-48e0-81d9-357d747090ea req-9b18028d-125b-4e3a-b25b-7804835ec0d3 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] No waiting events found dispatching network-vif-unplugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-ba84f08a-bcd2-48e0-81d9-357d747090ea req-9b18028d-125b-4e3a-b25b-7804835ec0d3 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received event network-vif-unplugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-ba84f08a-bcd2-48e0-81d9-357d747090ea req-9b18028d-125b-4e3a-b25b-7804835ec0d3 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received event network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ba84f08a-bcd2-48e0-81d9-357d747090ea req-9b18028d-125b-4e3a-b25b-7804835ec0d3 service nova] Acquiring lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ba84f08a-bcd2-48e0-81d9-357d747090ea req-9b18028d-125b-4e3a-b25b-7804835ec0d3 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ba84f08a-bcd2-48e0-81d9-357d747090ea req-9b18028d-125b-4e3a-b25b-7804835ec0d3 service nova] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-ba84f08a-bcd2-48e0-81d9-357d747090ea req-9b18028d-125b-4e3a-b25b-7804835ec0d3 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] No waiting events found dispatching network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:59:17 user nova-compute[73258]: WARNING nova.compute.manager [req-ba84f08a-bcd2-48e0-81d9-357d747090ea req-9b18028d-125b-4e3a-b25b-7804835ec0d3 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received unexpected event network-vif-plugged-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 for instance with vm_state active and task_state deleting.
Aug 27 06:59:17 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:59:17 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Took 0.51 seconds to deallocate network for instance.
Aug 27 06:59:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-9f5151fd-658b-4da0-b411-7c48ba578d8f req-0706d7af-0410-4c48-b63d-466e3746c80b service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received event network-changed-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:59:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-9f5151fd-658b-4da0-b411-7c48ba578d8f req-0706d7af-0410-4c48-b63d-466e3746c80b service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Refreshing instance network info cache due to event network-changed-9e55f50f-3335-4d20-b9ca-5e497b226d95. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:59:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9f5151fd-658b-4da0-b411-7c48ba578d8f req-0706d7af-0410-4c48-b63d-466e3746c80b service nova] Acquiring lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:59:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9f5151fd-658b-4da0-b411-7c48ba578d8f req-0706d7af-0410-4c48-b63d-466e3746c80b service nova] Acquired lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:59:18 user nova-compute[73258]: DEBUG nova.network.neutron [req-9f5151fd-658b-4da0-b411-7c48ba578d8f req-0706d7af-0410-4c48-b63d-466e3746c80b service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Refreshing network info cache for port 9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:59:18 user nova-compute[73258]: INFO nova.compute.manager [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Took 0.88 seconds to detach 1 volumes for instance.
Aug 27 06:59:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:18 user nova-compute[73258]: DEBUG nova.network.neutron [req-9f5151fd-658b-4da0-b411-7c48ba578d8f req-0706d7af-0410-4c48-b63d-466e3746c80b service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Updated VIF entry in instance network info cache for port 9e55f50f-3335-4d20-b9ca-5e497b226d95. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:59:18 user nova-compute[73258]: DEBUG nova.network.neutron [req-9f5151fd-658b-4da0-b411-7c48ba578d8f req-0706d7af-0410-4c48-b63d-466e3746c80b service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Updating instance_info_cache with network_info: [{"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:59:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9f5151fd-658b-4da0-b411-7c48ba578d8f req-0706d7af-0410-4c48-b63d-466e3746c80b service nova] Releasing lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:59:18 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:59:18 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:59:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:19 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Deleted allocations for instance a296fb1e-1999-475c-9a15-eeeedfa11247
Aug 27 06:59:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-87a122f6-87d9-4620-ae81-d755591df596 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "a296fb1e-1999-475c-9a15-eeeedfa11247" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.254s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-6eb553a9-fd1c-405e-92bb-9c5c5d14cf36 req-909d6006-29a9-413a-811a-2c31f86bf140 service nova] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Received event network-vif-deleted-ae8b8c03-b302-4043-ac07-b3561b7bf6f3 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:59:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-cf524155-0ef9-4aca-8f8b-69dbc07aa37a req-fea37ddc-22ad-4527-a382-675151463b0a service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received event network-changed-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:59:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-cf524155-0ef9-4aca-8f8b-69dbc07aa37a req-fea37ddc-22ad-4527-a382-675151463b0a service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Refreshing instance network info cache due to event network-changed-9e55f50f-3335-4d20-b9ca-5e497b226d95. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 06:59:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cf524155-0ef9-4aca-8f8b-69dbc07aa37a req-fea37ddc-22ad-4527-a382-675151463b0a service nova] Acquiring lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:59:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cf524155-0ef9-4aca-8f8b-69dbc07aa37a req-fea37ddc-22ad-4527-a382-675151463b0a service nova] Acquired lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:59:20 user nova-compute[73258]: DEBUG nova.network.neutron [req-cf524155-0ef9-4aca-8f8b-69dbc07aa37a req-fea37ddc-22ad-4527-a382-675151463b0a service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Refreshing network info cache for port 9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 06:59:21 user nova-compute[73258]: DEBUG nova.network.neutron [req-cf524155-0ef9-4aca-8f8b-69dbc07aa37a req-fea37ddc-22ad-4527-a382-675151463b0a service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Updated VIF entry in instance network info cache for port 9e55f50f-3335-4d20-b9ca-5e497b226d95. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 06:59:21 user nova-compute[73258]: DEBUG nova.network.neutron [req-cf524155-0ef9-4aca-8f8b-69dbc07aa37a req-fea37ddc-22ad-4527-a382-675151463b0a service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Updating instance_info_cache with network_info: [{"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:59:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-cf524155-0ef9-4aca-8f8b-69dbc07aa37a req-fea37ddc-22ad-4527-a382-675151463b0a service nova] Releasing lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:59:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG nova.objects.instance [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lazy-loading 'flavor' on Instance uuid 54697fcb-9ffe-4660-b7d2-7b89dfd72439 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "d2edd67c-c877-4c45-ae13-ee5f82853066" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:29 user nova-compute[73258]: INFO nova.compute.manager [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Rebooting instance
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquired lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG nova.network.neutron [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119554.269127, 0c16951e-8620-493f-8af4-fbdc64e1c131 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:59:29 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] VM Stopped (Lifecycle Event)
Aug 27 06:59:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-092a1ed3-0cec-4afd-8499-010fcfed36dc None None] [instance: 0c16951e-8620-493f-8af4-fbdc64e1c131] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:29 user nova-compute[73258]: INFO nova.compute.manager [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Attaching volume 45df2c25-eefe-418c-b2b3-1df12aa8ed8e to /dev/vdb
Aug 27 06:59:29 user nova-compute[73258]: DEBUG os_brick.utils [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3090dfc-95d4-4222-b824-7f6ab5b5d7f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c8344e-cfc0-4c3b-8903-ab6d3575c8d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8db78ed-8bcc-45f0-b59e-295ad4717340]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6957ad-2d11-42b0-a56c-d6d5292e2d45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 06:59:29 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f414bc-ef4b-46c1-9c33-b0e7900cfd18]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG os_brick.utils [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Updating existing volume attachment record: 713bdc83-0148-43c6-b930-9630eb1ded5a {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG nova.network.neutron [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Updating instance_info_cache with network_info: [{"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Releasing lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:59:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-c5264d2a-2ee1-4894-a94d-52dae1f17bc5 req-4ad8e843-bf32-4531-abaa-7d7c8898ff5b service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received event network-vif-unplugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c5264d2a-2ee1-4894-a94d-52dae1f17bc5 req-4ad8e843-bf32-4531-abaa-7d7c8898ff5b service nova] Acquiring lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c5264d2a-2ee1-4894-a94d-52dae1f17bc5 req-4ad8e843-bf32-4531-abaa-7d7c8898ff5b service nova] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c5264d2a-2ee1-4894-a94d-52dae1f17bc5 req-4ad8e843-bf32-4531-abaa-7d7c8898ff5b service nova] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-c5264d2a-2ee1-4894-a94d-52dae1f17bc5 req-4ad8e843-bf32-4531-abaa-7d7c8898ff5b service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] No waiting events found dispatching network-vif-unplugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:59:30 user nova-compute[73258]: WARNING nova.compute.manager [req-c5264d2a-2ee1-4894-a94d-52dae1f17bc5 req-4ad8e843-bf32-4531-abaa-7d7c8898ff5b service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received unexpected event network-vif-unplugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 for instance with vm_state active and task_state reboot_started_hard.
Aug 27 06:59:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:30 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Instance destroyed successfully.
Aug 27 06:59:30 user nova-compute[73258]: DEBUG nova.objects.instance [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lazy-loading 'resources' on Instance uuid d2edd67c-c877-4c45-ae13-ee5f82853066 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:56:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-230825290',display_name='tempest-TestMinimumBasicScenario-server-230825290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-230825290',id=41,image_ref='219587c8-b0ee-47ab-aa54-8b2d42fe9b89',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuoVS0M13jEH/jCiVKamjqoQl7T8gy6Y61js/cVhfSR87vdnvOrLJ2jnn3eqtAAM6GxfvMPwc5M3rsN5ROIABUb6JurY5u9Lbvzo4Cmo0ps1r74VIpsNxuNj3rC3V5Nvw==',key_name='tempest-TestMinimumBasicScenario-1377282219',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:56:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b34f6a09d79c43c282e56cfda50001d7',ramdisk_id='',reservation_id='r-zqr6he04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='219587c8-b0ee-47ab-aa54-8b2d42fe9b89',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1509066975',owner_user_name='tempest-TestMinimumBasicScenario-1509066975-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:59:30Z,user_data=None,user_id='8de65612a05142ebb509012c126b89b0',uuid=d2edd67c-c877-4c45-ae13-ee5f82853066,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Converting VIF {"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:f3:ab,bridge_name='br-int',has_traffic_filtering=True,id=9e55f50f-3335-4d20-b9ca-5e497b226d95,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e55f50f-33') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG os_vif [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:f3:ab,bridge_name='br-int',has_traffic_filtering=True,id=9e55f50f-3335-4d20-b9ca-5e497b226d95,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e55f50f-33') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e55f50f-33, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:59:30 user nova-compute[73258]: INFO os_vif [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:f3:ab,bridge_name='br-int',has_traffic_filtering=True,id=9e55f50f-3335-4d20-b9ca-5e497b226d95,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e55f50f-33')
Aug 27 06:59:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjYXaKJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:59:30 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:59:30 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[782c0802-0194-41ef-88df-ea3c0074d048]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c06518-176f-4b0e-b723-6e80f826dfc6]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:59:30 user nova-compute[73258]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 06:59:30 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:59:30 user nova-compute[73258]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 06:59:30 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4104d48b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:30 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[32248565-00f9-4230-a47e-bfc917cc6487]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eecf096-08d2-4524-bc7c-9ea88686d937]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a85db7-4486-44b3-908e-f0008928d044]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a985aa70-493a-4f10-9084-97e34a982b12]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3aaf1d0-13cb-4871-92db-61b8fc21968c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef30bf4-9611-4cca-9726-43fb9f44543b]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013, portal: 172.16.0.220,3260]
Aug 27 06:59:31 user nova-compute[73258]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013, portal: 172.16.0.220,3260] successful.
Aug 27 06:59:31 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ee8d74-7bab-49a1-8841-65e56798e8b4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] <== disconnect_volume: return (312ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Start _get_guest_xml network_info=[{"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=219587c8-b0ee-47ab-aa54-8b2d42fe9b89,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '219587c8-b0ee-47ab-aa54-8b2d42fe9b89'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjYXaKJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd2edd67c-c877-4c45-ae13-ee5f82853066', 'attached_at': '', 'detached_at': '', 'volume_id': '949c879e-8298-4d6f-a4bf-4dcd526f8013', 'serial': '949c879e-8298-4d6f-a4bf-4dcd526f8013'}, 'attachment_id': 'ecdc2c80-8303-4ebf-af75-480be0bc3073', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 06:59:31 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:59:31 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=219587c8-b0ee-47ab-aa54-8b2d42fe9b89,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.objects.instance [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lazy-loading 'vcpu_model' on Instance uuid d2edd67c-c877-4c45-ae13-ee5f82853066 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.objects.base [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Object Instance<d2edd67c-c877-4c45-ae13-ee5f82853066> lazy-loaded attributes: resources,vcpu_model {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjYXaKJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:59:31 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:59:31 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:59:31 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d212396-6324-44e1-8cc5-a137029a479a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:59:31 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd08c6d-9636-4feb-a124-72a9de4d0d1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013] added
Aug 27 06:59:31 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.066s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaf6d61-486f-40ec-9795-c1461719ce9f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1694437-8ca5-4579-af26-271d96aa9d57]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hjYXaKJx {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hjYXaKJx" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2419b0a3-976c-4619-9189-3eba2fba2917]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hjYXaKJx'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9d3698-cfe5-4e66-8d6b-19726df18002]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[635d5e4d-496e-4857-9a77-c20d44426f2c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:59:31 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:59:31 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c314900b-fc89-4188-85e8-e1a8f3cbbb3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013, portal: 172.16.0.220,3260]
Aug 27 06:59:31 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013, portal: 172.16.0.220,3260] successful.
Aug 27 06:59:31 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8229875f-cc54-4bfb-9666-ff0c67f6ec5e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a213540f-2f74-4ab2-b246-ae0d86ed612b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:59:31 user nova-compute[73258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 06:59:31 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:59:31 user nova-compute[73258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 06:59:31 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3732272e-01fb-437c-9a4f-99f62d8e613b]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119556.6907277, a296fb1e-1999-475c-9a15-eeeedfa11247 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:59:31 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] VM Stopped (Lifecycle Event)
Aug 27 06:59:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-631adfd2-dc89-4c24-b7c8-b646c883928f None None] [instance: a296fb1e-1999-475c-9a15-eeeedfa11247] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:59:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-f0da819f-c012-4a25-890f-40db56d45fbe req-f12c497c-91d6-4200-b61b-9d0a32dd8c3d service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received event network-vif-plugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:59:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f0da819f-c012-4a25-890f-40db56d45fbe req-f12c497c-91d6-4200-b61b-9d0a32dd8c3d service nova] Acquiring lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f0da819f-c012-4a25-890f-40db56d45fbe req-f12c497c-91d6-4200-b61b-9d0a32dd8c3d service nova] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f0da819f-c012-4a25-890f-40db56d45fbe req-f12c497c-91d6-4200-b61b-9d0a32dd8c3d service nova] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-f0da819f-c012-4a25-890f-40db56d45fbe req-f12c497c-91d6-4200-b61b-9d0a32dd8c3d service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] No waiting events found dispatching network-vif-plugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:59:32 user nova-compute[73258]: WARNING nova.compute.manager [req-f0da819f-c012-4a25-890f-40db56d45fbe req-f12c497c-91d6-4200-b61b-9d0a32dd8c3d service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received unexpected event network-vif-plugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 for instance with vm_state active and task_state reboot_started_hard.
Aug 27 06:59:32 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:59:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjYXaKJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:59:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:59:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23336626465626164', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:59:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336626465626164', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:59:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:56:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-230825290',display_name='tempest-TestMinimumBasicScenario-server-230825290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-230825290',id=41,image_ref='219587c8-b0ee-47ab-aa54-8b2d42fe9b89',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuoVS0M13jEH/jCiVKamjqoQl7T8gy6Y61js/cVhfSR87vdnvOrLJ2jnn3eqtAAM6GxfvMPwc5M3rsN5ROIABUb6JurY5u9Lbvzo4Cmo0ps1r74VIpsNxuNj3rC3V5Nvw==',key_name='tempest-TestMinimumBasicScenario-1377282219',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:56:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b34f6a09d79c43c282e56cfda50001d7',ramdisk_id='',reservation_id='r-zqr6he04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='219587c8-b0ee-47ab-aa54-8b2d42fe9b89',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1509066975',owner_user_name='tempest-TestMinimumBasicScenario-1509066975-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:59:30Z,user_data=None,user_id='8de65612a05142ebb509012c126b89b0',uuid=d2edd67c-c877-4c45-ae13-ee5f82853066,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 06:59:32 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Converting VIF {"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:59:32 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:f3:ab,bridge_name='br-int',has_traffic_filtering=True,id=9e55f50f-3335-4d20-b9ca-5e497b226d95,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e55f50f-33') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:59:32 user nova-compute[73258]: DEBUG nova.objects.instance [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lazy-loading 'pci_devices' on Instance uuid d2edd67c-c877-4c45-ae13-ee5f82853066 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:59:32 user nova-compute[73258]: DEBUG nova.objects.base [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Object Instance<d2edd67c-c877-4c45-ae13-ee5f82853066> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:59:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] End _get_guest_xml xml=<domain type="kvm">
Aug 27 06:59:32 user nova-compute[73258]:   <uuid>d2edd67c-c877-4c45-ae13-ee5f82853066</uuid>
Aug 27 06:59:32 user nova-compute[73258]:   <name>instance-00000029</name>
Aug 27 06:59:32 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 06:59:32 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 06:59:32 user nova-compute[73258]:   <metadata>
Aug 27 06:59:32 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 06:59:32 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 06:59:32 user nova-compute[73258]:       <nova:name>tempest-TestMinimumBasicScenario-server-230825290</nova:name>
Aug 27 06:59:32 user nova-compute[73258]:       <nova:creationTime>2023-08-27 06:59:31</nova:creationTime>
Aug 27 06:59:32 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 06:59:32 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 06:59:32 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 06:59:32 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 06:59:32 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 06:59:32 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 06:59:32 user nova-compute[73258]:       </nova:flavor>
Aug 27 06:59:32 user nova-compute[73258]:       <nova:owner>
Aug 27 06:59:32 user nova-compute[73258]:         <nova:user uuid="8de65612a05142ebb509012c126b89b0">tempest-TestMinimumBasicScenario-1509066975-project-member</nova:user>
Aug 27 06:59:32 user nova-compute[73258]:         <nova:project uuid="b34f6a09d79c43c282e56cfda50001d7">tempest-TestMinimumBasicScenario-1509066975</nova:project>
Aug 27 06:59:32 user nova-compute[73258]:       </nova:owner>
Aug 27 06:59:32 user nova-compute[73258]:       <nova:root type="image" uuid="219587c8-b0ee-47ab-aa54-8b2d42fe9b89"/>
Aug 27 06:59:32 user nova-compute[73258]:       <nova:ports>
Aug 27 06:59:32 user nova-compute[73258]:         <nova:port uuid="9e55f50f-3335-4d20-b9ca-5e497b226d95">
Aug 27 06:59:32 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 06:59:32 user nova-compute[73258]:         </nova:port>
Aug 27 06:59:32 user nova-compute[73258]:       </nova:ports>
Aug 27 06:59:32 user nova-compute[73258]:     </nova:instance>
Aug 27 06:59:32 user nova-compute[73258]:   </metadata>
Aug 27 06:59:32 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 06:59:32 user nova-compute[73258]:     <system>
Aug 27 06:59:32 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 06:59:32 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 06:59:32 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 06:59:32 user nova-compute[73258]:       <entry name="serial">d2edd67c-c877-4c45-ae13-ee5f82853066</entry>
Aug 27 06:59:32 user nova-compute[73258]:       <entry name="uuid">d2edd67c-c877-4c45-ae13-ee5f82853066</entry>
Aug 27 06:59:32 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 06:59:32 user nova-compute[73258]:     </system>
Aug 27 06:59:32 user nova-compute[73258]:   </sysinfo>
Aug 27 06:59:32 user nova-compute[73258]:   <os>
Aug 27 06:59:32 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 06:59:32 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 06:59:32 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 06:59:32 user nova-compute[73258]:   </os>
Aug 27 06:59:32 user nova-compute[73258]:   <features>
Aug 27 06:59:32 user nova-compute[73258]:     <acpi/>
Aug 27 06:59:32 user nova-compute[73258]:     <apic/>
Aug 27 06:59:32 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 06:59:32 user nova-compute[73258]:   </features>
Aug 27 06:59:32 user nova-compute[73258]:   <clock offset="utc">
Aug 27 06:59:32 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 06:59:32 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 06:59:32 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 06:59:32 user nova-compute[73258]:   </clock>
Aug 27 06:59:32 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 06:59:32 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 06:59:32 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 06:59:32 user nova-compute[73258]:   </cpu>
Aug 27 06:59:32 user nova-compute[73258]:   <devices>
Aug 27 06:59:32 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 06:59:32 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 06:59:32 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk"/>
Aug 27 06:59:32 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 06:59:32 user nova-compute[73258]:     </disk>
Aug 27 06:59:32 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 06:59:32 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:59:32 user nova-compute[73258]:       <source dev="/dev/sdb"/>
Aug 27 06:59:32 user nova-compute[73258]:       <target dev="vdb" bus="virtio"/>
Aug 27 06:59:32 user nova-compute[73258]:       <serial>949c879e-8298-4d6f-a4bf-4dcd526f8013</serial>
Aug 27 06:59:32 user nova-compute[73258]:     </disk>
Aug 27 06:59:32 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 06:59:32 user nova-compute[73258]:       <mac address="fa:16:3e:96:f3:ab"/>
Aug 27 06:59:32 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:59:32 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 06:59:32 user nova-compute[73258]:       <target dev="tap9e55f50f-33"/>
Aug 27 06:59:32 user nova-compute[73258]:     </interface>
Aug 27 06:59:32 user nova-compute[73258]:     <serial type="pty">
Aug 27 06:59:32 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/console.log" append="off"/>
Aug 27 06:59:32 user nova-compute[73258]:     </serial>
Aug 27 06:59:32 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 06:59:32 user nova-compute[73258]:     <video>
Aug 27 06:59:32 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 06:59:32 user nova-compute[73258]:     </video>
Aug 27 06:59:32 user nova-compute[73258]:     <rng model="virtio">
Aug 27 06:59:32 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 06:59:32 user nova-compute[73258]:     </rng>
Aug 27 06:59:32 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 06:59:32 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 06:59:32 user nova-compute[73258]:       <stats period="10"/>
Aug 27 06:59:32 user nova-compute[73258]:     </memballoon>
Aug 27 06:59:32 user nova-compute[73258]:   </devices>
Aug 27 06:59:32 user nova-compute[73258]: </domain>
Aug 27 06:59:32 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 06:59:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG nova.objects.instance [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lazy-loading 'trusted_certs' on Instance uuid d2edd67c-c877-4c45-ae13-ee5f82853066 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG nova.objects.base [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Object Instance<d2edd67c-c877-4c45-ae13-ee5f82853066> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21 --force-share --output=json" returned: 0 in 0.189s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Cannot resize image /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG nova.objects.instance [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lazy-loading 'migration_context' on Instance uuid d2edd67c-c877-4c45-ae13-ee5f82853066 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG nova.objects.base [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Object Instance<d2edd67c-c877-4c45-ae13-ee5f82853066> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:56:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-230825290',display_name='tempest-TestMinimumBasicScenario-server-230825290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-230825290',id=41,image_ref='219587c8-b0ee-47ab-aa54-8b2d42fe9b89',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuoVS0M13jEH/jCiVKamjqoQl7T8gy6Y61js/cVhfSR87vdnvOrLJ2jnn3eqtAAM6GxfvMPwc5M3rsN5ROIABUb6JurY5u9Lbvzo4Cmo0ps1r74VIpsNxuNj3rC3V5Nvw==',key_name='tempest-TestMinimumBasicScenario-1377282219',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:56:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='b34f6a09d79c43c282e56cfda50001d7',ramdisk_id='',reservation_id='r-zqr6he04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='219587c8-b0ee-47ab-aa54-8b2d42fe9b89',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1509066975',owner_user_name='tempest-TestMinimumBasicScenario-1509066975-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T06:59:30Z,user_data=None,user_id='8de65612a05142ebb509012c126b89b0',uuid=d2edd67c-c877-4c45-ae13-ee5f82853066,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Converting VIF {"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:f3:ab,bridge_name='br-int',has_traffic_filtering=True,id=9e55f50f-3335-4d20-b9ca-5e497b226d95,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e55f50f-33') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG os_vif [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:f3:ab,bridge_name='br-int',has_traffic_filtering=True,id=9e55f50f-3335-4d20-b9ca-5e497b226d95,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e55f50f-33') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e55f50f-33, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e55f50f-33, col_values=(('external_ids', {'iface-id': '9e55f50f-3335-4d20-b9ca-5e497b226d95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:f3:ab', 'vm-uuid': 'd2edd67c-c877-4c45-ae13-ee5f82853066'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:59:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:33 user nova-compute[73258]: INFO os_vif [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:f3:ab,bridge_name='br-int',has_traffic_filtering=True,id=9e55f50f-3335-4d20-b9ca-5e497b226d95,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e55f50f-33')
Aug 27 06:59:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-980da20b-e1a1-44c6-8e28-f89b6a074e26 req-3ed32630-2a87-4685-999a-8c11a34cc33c service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received event network-vif-plugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:59:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-980da20b-e1a1-44c6-8e28-f89b6a074e26 req-3ed32630-2a87-4685-999a-8c11a34cc33c service nova] Acquiring lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-980da20b-e1a1-44c6-8e28-f89b6a074e26 req-3ed32630-2a87-4685-999a-8c11a34cc33c service nova] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-980da20b-e1a1-44c6-8e28-f89b6a074e26 req-3ed32630-2a87-4685-999a-8c11a34cc33c service nova] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-980da20b-e1a1-44c6-8e28-f89b6a074e26 req-3ed32630-2a87-4685-999a-8c11a34cc33c service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] No waiting events found dispatching network-vif-plugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:59:35 user nova-compute[73258]: WARNING nova.compute.manager [req-980da20b-e1a1-44c6-8e28-f89b6a074e26 req-3ed32630-2a87-4685-999a-8c11a34cc33c service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received unexpected event network-vif-plugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 for instance with vm_state active and task_state reboot_started_hard.
Aug 27 06:59:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Removed pending event for d2edd67c-c877-4c45-ae13-ee5f82853066 due to event {{(pid=73258) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 06:59:37 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119577.2918298, d2edd67c-c877-4c45-ae13-ee5f82853066 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:59:37 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] VM Resumed (Lifecycle Event)
Aug 27 06:59:37 user nova-compute[73258]: DEBUG nova.compute.manager [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 06:59:37 user nova-compute[73258]: DEBUG nova.compute.manager [req-28639ad1-24ba-4939-bffd-a638eef83fed req-9622c1c9-9aec-4ebb-a12c-526894e3da2c service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received event network-vif-plugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:59:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-28639ad1-24ba-4939-bffd-a638eef83fed req-9622c1c9-9aec-4ebb-a12c-526894e3da2c service nova] Acquiring lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-28639ad1-24ba-4939-bffd-a638eef83fed req-9622c1c9-9aec-4ebb-a12c-526894e3da2c service nova] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-28639ad1-24ba-4939-bffd-a638eef83fed req-9622c1c9-9aec-4ebb-a12c-526894e3da2c service nova] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:37 user nova-compute[73258]: DEBUG nova.compute.manager [req-28639ad1-24ba-4939-bffd-a638eef83fed req-9622c1c9-9aec-4ebb-a12c-526894e3da2c service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] No waiting events found dispatching network-vif-plugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:59:37 user nova-compute[73258]: WARNING nova.compute.manager [req-28639ad1-24ba-4939-bffd-a638eef83fed req-9622c1c9-9aec-4ebb-a12c-526894e3da2c service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received unexpected event network-vif-plugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 for instance with vm_state active and task_state reboot_started_hard.
Aug 27 06:59:37 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Instance rebooted successfully.
Aug 27 06:59:37 user nova-compute[73258]: DEBUG nova.compute.manager [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:59:37 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:59:37 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:59:37 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 27 06:59:37 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119577.2960372, d2edd67c-c877-4c45-ae13-ee5f82853066 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:59:37 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] VM Started (Lifecycle Event)
Aug 27 06:59:37 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:59:37 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 06:59:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-359b8276-bf10-496e-951d-d127cdb3adb1 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.267s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JopCMSfs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:59:42 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:59:42 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:59:42 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb53171a-a1fb-42ae-bbdd-c8582ebb22a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 06:59:42 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[10599302-aadf-466d-9667-5ad7b319e9a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e] added
Aug 27 06:59:42 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf591b63-a48e-405e-841d-277b8dbaf8ab]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8c13e8-fbd3-4830-9eed-74ee54ebc515]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JopCMSfs {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JopCMSfs" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b196800-6423-4c06-b5f7-2a649ed6596f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JopCMSfs'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[be289ff1-c1fe-4b4c-b63c-96fb2ed016d3]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ea246e-bdfd-410d-9cd7-8b4f47229419]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:59:42 user nova-compute[73258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 06:59:42 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:59:42 user nova-compute[73258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 06:59:42 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75ddd0e-884e-4694-9d2d-da12a2c032a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e, portal: 172.16.0.220,3260]
Aug 27 06:59:42 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e, portal: 172.16.0.220,3260] successful.
Aug 27 06:59:42 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7121b86b-e098-4988-8ba4-c42a2f4b890f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3f8380-7c87-4dff-9ab0-d0a04b1849d0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:59:42 user nova-compute[73258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 06:59:42 user nova-compute[73258]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e (non-flash)
Aug 27 06:59:42 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:59:42 user nova-compute[73258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 06:59:42 user nova-compute[73258]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e (non-flash)
Aug 27 06:59:42 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69c03d3-de70-419b-8cf5-d78f16e3de52]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 06:59:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JopCMSfs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 06:59:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:59:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26661336631616633', 'path': '/dev/sdc'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:59:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661336631616633', 'path': '/dev/sdc'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 06:59:43 user nova-compute[73258]: DEBUG nova.objects.instance [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lazy-loading 'flavor' on Instance uuid 54697fcb-9ffe-4660-b7d2-7b89dfd72439 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:59:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 06:59:43 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:59:43 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 06:59:43 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:59:43 user nova-compute[73258]:   <serial>45df2c25-eefe-418c-b2b3-1df12aa8ed8e</serial>
Aug 27 06:59:43 user nova-compute[73258]: </disk>
Aug 27 06:59:43 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 06:59:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:59:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 06:59:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] No VIF found with MAC fa:16:3e:0a:85:cd, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 06:59:44 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ed888e78-4214-450f-b612-4465614a1c76 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.677s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:59:46 user nova-compute[73258]: INFO nova.compute.manager [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Detaching volume 45df2c25-eefe-418c-b2b3-1df12aa8ed8e
Aug 27 06:59:46 user nova-compute[73258]: INFO nova.virt.block_device [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Attempting to driver detach volume 45df2c25-eefe-418c-b2b3-1df12aa8ed8e from mountpoint /dev/vdb
Aug 27 06:59:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Attempting to detach device vdb from instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:59:46 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:59:46 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 06:59:46 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:59:46 user nova-compute[73258]:   <serial>45df2c25-eefe-418c-b2b3-1df12aa8ed8e</serial>
Aug 27 06:59:46 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:59:46 user nova-compute[73258]: </disk>
Aug 27 06:59:46 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:59:46 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Successfully detached device vdb from instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 from the persistent domain config.
Aug 27 06:59:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 06:59:46 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 06:59:46 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 06:59:46 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 06:59:46 user nova-compute[73258]:   <serial>45df2c25-eefe-418c-b2b3-1df12aa8ed8e</serial>
Aug 27 06:59:46 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 06:59:46 user nova-compute[73258]: </disk>
Aug 27 06:59:46 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693119586.8860102, 54697fcb-9ffe-4660-b7d2-7b89dfd72439 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 06:59:46 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Successfully detached device vdb from instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 from the live domain config.
Aug 27 06:59:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JopCMSfs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 06:59:46 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 06:59:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf2cfc9-7dc7-4ff4-9e97-18a23deaf7fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[04195704-abc7-4594-bd4c-013e9e95813f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:59:46 user nova-compute[73258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 06:59:46 user nova-compute[73258]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e (non-flash)
Aug 27 06:59:46 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 06:59:46 user nova-compute[73258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 06:59:46 user nova-compute[73258]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e (non-flash)
Aug 27 06:59:46 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa410520700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e'): ({'sdc'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Removing single pathed devices sdc {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d577e8f0-88db-4845-8f14-e5bcb5787893]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d267d8fa-9e44-4a17-a735-a377ed1f894f]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Flushing IO for device /dev/sdc {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6783fa1-ba55-49bb-8943-c5735bb72a2a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7acca9-899b-4aec-997e-72190bd3fde8]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e517c00e-6eff-4a77-b84a-8b3cc0bb182c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[24928fe6-4ad7-416b-a164-2c9103a2a957]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e, portal: 172.16.0.220,3260]
Aug 27 06:59:47 user nova-compute[73258]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e, portal: 172.16.0.220,3260] successful.
Aug 27 06:59:47 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45df2c25-eefe-418c-b2b3-1df12aa8ed8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f37067-d448-44a3-82e0-f8c931df4623]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] <== disconnect_volume: return (286ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 06:59:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 06:59:48 user nova-compute[73258]: DEBUG nova.objects.instance [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lazy-loading 'flavor' on Instance uuid 54697fcb-9ffe-4660-b7d2-7b89dfd72439 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:59:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7baa71dc-1de5-43b5-a875-c871dc39d6ad tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.819s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:59:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:52 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:59:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:53 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:59:53 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:59:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:54 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:59:55 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:59:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:59:55 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Didn't find any instances for network info cache update. {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 06:59:55 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:59:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:59:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:59:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:59:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:59:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:00 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:00:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:00 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:00:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:00:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:01 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:00:01 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:02 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:03 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:00:03 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:00:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=7898MB free_disk=23.681087493896484GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:00:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a836678e-240d-4ead-b0b5-64d146910a23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:00:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 7ee743f1-9611-4165-838e-54fccb332f1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:00:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:00:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:00:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance d2edd67c-c877-4c45-ae13-ee5f82853066 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:00:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance b17c6dd1-2525-411d-8b81-eb87c81c8527 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:00:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:00:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:00:04 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:00:04 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:00:04 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:00:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:07 user nova-compute[73258]: INFO nova.compute.manager [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Terminating instance
Aug 27 07:00:07 user nova-compute[73258]: DEBUG nova.compute.manager [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG nova.compute.manager [req-27612e1b-9344-4d28-a602-c2596345f331 req-60d831fe-e982-413b-bcda-d98ae9230328 service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Received event network-vif-unplugged-7652cd00-a6c7-4a33-8a78-4feb11948b71 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-27612e1b-9344-4d28-a602-c2596345f331 req-60d831fe-e982-413b-bcda-d98ae9230328 service nova] Acquiring lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-27612e1b-9344-4d28-a602-c2596345f331 req-60d831fe-e982-413b-bcda-d98ae9230328 service nova] Lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-27612e1b-9344-4d28-a602-c2596345f331 req-60d831fe-e982-413b-bcda-d98ae9230328 service nova] Lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG nova.compute.manager [req-27612e1b-9344-4d28-a602-c2596345f331 req-60d831fe-e982-413b-bcda-d98ae9230328 service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] No waiting events found dispatching network-vif-unplugged-7652cd00-a6c7-4a33-8a78-4feb11948b71 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG nova.compute.manager [req-27612e1b-9344-4d28-a602-c2596345f331 req-60d831fe-e982-413b-bcda-d98ae9230328 service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Received event network-vif-unplugged-7652cd00-a6c7-4a33-8a78-4feb11948b71 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 07:00:07 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Instance destroyed successfully.
Aug 27 07:00:07 user nova-compute[73258]: DEBUG nova.objects.instance [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'resources' on Instance uuid 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-563501826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-563501826',id=35,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:50:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81cf34590d8d4b8b89b9626c6e150df6',ramdisk_id='',reservation_id='r-iwuu71a9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:52:39Z,user_data=None,user_id='36c0faed29a446aa9fa6ff8692581aba',uuid=686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "address": "fa:16:3e:6f:e0:41", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7652cd00-a6", "ovs_interfaceid": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converting VIF {"id": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "address": "fa:16:3e:6f:e0:41", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7652cd00-a6", "ovs_interfaceid": "7652cd00-a6c7-4a33-8a78-4feb11948b71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:e0:41,bridge_name='br-int',has_traffic_filtering=True,id=7652cd00-a6c7-4a33-8a78-4feb11948b71,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7652cd00-a6') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG os_vif [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:e0:41,bridge_name='br-int',has_traffic_filtering=True,id=7652cd00-a6c7-4a33-8a78-4feb11948b71,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7652cd00-a6') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7652cd00-a6, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:00:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:00:08 user nova-compute[73258]: INFO os_vif [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:e0:41,bridge_name='br-int',has_traffic_filtering=True,id=7652cd00-a6c7-4a33-8a78-4feb11948b71,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7652cd00-a6')
Aug 27 07:00:08 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Deleting instance files /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5_del
Aug 27 07:00:08 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Deletion of /opt/stack/data/nova/instances/686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5_del complete
Aug 27 07:00:08 user nova-compute[73258]: INFO nova.compute.manager [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 27 07:00:08 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 07:00:08 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 07:00:08 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 07:00:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:09 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:00:09 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Took 0.89 seconds to deallocate network for instance.
Aug 27 07:00:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-c3cb51ee-394a-4c37-bade-648d6540c931 req-7608ee26-10c2-49df-95a5-589753082e53 service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Received event network-vif-deleted-7652cd00-a6c7-4a33-8a78-4feb11948b71 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:00:09 user nova-compute[73258]: INFO nova.compute.manager [req-c3cb51ee-394a-4c37-bade-648d6540c931 req-7608ee26-10c2-49df-95a5-589753082e53 service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Neutron deleted interface 7652cd00-a6c7-4a33-8a78-4feb11948b71; detaching it from the instance and deleting it from the info cache
Aug 27 07:00:09 user nova-compute[73258]: DEBUG nova.network.neutron [req-c3cb51ee-394a-4c37-bade-648d6540c931 req-7608ee26-10c2-49df-95a5-589753082e53 service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:00:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-c3cb51ee-394a-4c37-bade-648d6540c931 req-7608ee26-10c2-49df-95a5-589753082e53 service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Detach interface failed, port_id=7652cd00-a6c7-4a33-8a78-4feb11948b71, reason: Instance 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5 could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 07:00:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:09 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:00:09 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:00:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:09 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Deleted allocations for instance 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5
Aug 27 07:00:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cd59e9db-67d0-475b-8f80-106c2c0ea455 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.321s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-66bb1157-bfd8-4bf3-bc20-74018748f53b req-5574e9a0-fe6e-4b46-939e-dc0edfdcf435 service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Received event network-vif-plugged-7652cd00-a6c7-4a33-8a78-4feb11948b71 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:00:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-66bb1157-bfd8-4bf3-bc20-74018748f53b req-5574e9a0-fe6e-4b46-939e-dc0edfdcf435 service nova] Acquiring lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-66bb1157-bfd8-4bf3-bc20-74018748f53b req-5574e9a0-fe6e-4b46-939e-dc0edfdcf435 service nova] Lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-66bb1157-bfd8-4bf3-bc20-74018748f53b req-5574e9a0-fe6e-4b46-939e-dc0edfdcf435 service nova] Lock "686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-66bb1157-bfd8-4bf3-bc20-74018748f53b req-5574e9a0-fe6e-4b46-939e-dc0edfdcf435 service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] No waiting events found dispatching network-vif-plugged-7652cd00-a6c7-4a33-8a78-4feb11948b71 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:00:09 user nova-compute[73258]: WARNING nova.compute.manager [req-66bb1157-bfd8-4bf3-bc20-74018748f53b req-5574e9a0-fe6e-4b46-939e-dc0edfdcf435 service nova] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Received unexpected event network-vif-plugged-7652cd00-a6c7-4a33-8a78-4feb11948b71 for instance with vm_state deleted and task_state None.
Aug 27 07:00:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "c7726af8-f937-49ae-ba07-54ed57e18a50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:18 user nova-compute[73258]: DEBUG nova.compute.manager [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 07:00:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:18 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 07:00:18 user nova-compute[73258]: INFO nova.compute.claims [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Claim successful on node user
Aug 27 07:00:18 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:00:18 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:00:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:18 user nova-compute[73258]: DEBUG nova.compute.manager [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 07:00:18 user nova-compute[73258]: DEBUG nova.compute.manager [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 07:00:18 user nova-compute[73258]: DEBUG nova.network.neutron [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 07:00:18 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 07:00:18 user nova-compute[73258]: DEBUG nova.compute.manager [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 07:00:18 user nova-compute[73258]: DEBUG nova.policy [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '63c94d20493445b9bd59f82646b1b63b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4444c10053404b2684e82b5986b8a229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 07:00:18 user nova-compute[73258]: DEBUG nova.compute.manager [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 07:00:18 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 07:00:18 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Creating image(s)
Aug 27 07:00:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "/opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "/opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.196s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.204s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk 1073741824" returned: 0 in 0.074s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG nova.network.neutron [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Successfully created port: 1b84a563-103e-441c-85d5-41c39008196a {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.204s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Cannot resize image /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Ensure instance console log exists: /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:20 user nova-compute[73258]: DEBUG nova.network.neutron [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Successfully updated port: 1b84a563-103e-441c-85d5-41c39008196a {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 07:00:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "refresh_cache-c7726af8-f937-49ae-ba07-54ed57e18a50" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:00:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquired lock "refresh_cache-c7726af8-f937-49ae-ba07-54ed57e18a50" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:00:20 user nova-compute[73258]: DEBUG nova.network.neutron [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 07:00:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-d47f1eb8-3fae-4c6c-8a4b-ca3229b6a907 req-3a71b395-de29-40a5-8964-21b6be0c9bae service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Received event network-changed-1b84a563-103e-441c-85d5-41c39008196a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:00:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-d47f1eb8-3fae-4c6c-8a4b-ca3229b6a907 req-3a71b395-de29-40a5-8964-21b6be0c9bae service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Refreshing instance network info cache due to event network-changed-1b84a563-103e-441c-85d5-41c39008196a. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:00:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d47f1eb8-3fae-4c6c-8a4b-ca3229b6a907 req-3a71b395-de29-40a5-8964-21b6be0c9bae service nova] Acquiring lock "refresh_cache-c7726af8-f937-49ae-ba07-54ed57e18a50" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:00:20 user nova-compute[73258]: DEBUG nova.network.neutron [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 07:00:20 user nova-compute[73258]: DEBUG nova.network.neutron [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Updating instance_info_cache with network_info: [{"id": "1b84a563-103e-441c-85d5-41c39008196a", "address": "fa:16:3e:6d:71:a7", "network": {"id": "371866e1-b4cf-47fe-8d41-2c9e59f468ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1786605233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4444c10053404b2684e82b5986b8a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b84a563-10", "ovs_interfaceid": "1b84a563-103e-441c-85d5-41c39008196a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:00:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Releasing lock "refresh_cache-c7726af8-f937-49ae-ba07-54ed57e18a50" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:00:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Instance network_info: |[{"id": "1b84a563-103e-441c-85d5-41c39008196a", "address": "fa:16:3e:6d:71:a7", "network": {"id": "371866e1-b4cf-47fe-8d41-2c9e59f468ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1786605233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4444c10053404b2684e82b5986b8a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b84a563-10", "ovs_interfaceid": "1b84a563-103e-441c-85d5-41c39008196a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 07:00:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d47f1eb8-3fae-4c6c-8a4b-ca3229b6a907 req-3a71b395-de29-40a5-8964-21b6be0c9bae service nova] Acquired lock "refresh_cache-c7726af8-f937-49ae-ba07-54ed57e18a50" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:00:20 user nova-compute[73258]: DEBUG nova.network.neutron [req-d47f1eb8-3fae-4c6c-8a4b-ca3229b6a907 req-3a71b395-de29-40a5-8964-21b6be0c9bae service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Refreshing network info cache for port 1b84a563-103e-441c-85d5-41c39008196a {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Start _get_guest_xml network_info=[{"id": "1b84a563-103e-441c-85d5-41c39008196a", "address": "fa:16:3e:6d:71:a7", "network": {"id": "371866e1-b4cf-47fe-8d41-2c9e59f468ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1786605233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4444c10053404b2684e82b5986b8a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b84a563-10", "ovs_interfaceid": "1b84a563-103e-441c-85d5-41c39008196a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 07:00:21 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:00:21 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-372450740',display_name='tempest-TestServerVolumeAttachmentScenario-server-372450740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-372450740',id=43,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL1MNY+8zwUJ+i1YWqYGe5aF/ZAFOLwxxrA9K0KwFTC8aALc2hzNEVG01BwEGMxdUMIGG+7fqkQ1RROgQSiKcVDo2AuhqrxWQqIvtcLfG9csnUOWLtsmpXX3OiUCvlpdg==',key_name='tempest-keypair-1619340972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4444c10053404b2684e82b5986b8a229',ramdisk_id='',reservation_id='r-x2j4a4ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1694723633',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1694723633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:00:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63c94d20493445b9bd59f82646b1b63b',uuid=c7726af8-f937-49ae-ba07-54ed57e18a50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b84a563-103e-441c-85d5-41c39008196a", "address": "fa:16:3e:6d:71:a7", "network": {"id": "371866e1-b4cf-47fe-8d41-2c9e59f468ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1786605233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4444c10053404b2684e82b5986b8a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b84a563-10", "ovs_interfaceid": "1b84a563-103e-441c-85d5-41c39008196a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Converting VIF {"id": "1b84a563-103e-441c-85d5-41c39008196a", "address": "fa:16:3e:6d:71:a7", "network": {"id": "371866e1-b4cf-47fe-8d41-2c9e59f468ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1786605233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4444c10053404b2684e82b5986b8a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b84a563-10", "ovs_interfaceid": "1b84a563-103e-441c-85d5-41c39008196a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:71:a7,bridge_name='br-int',has_traffic_filtering=True,id=1b84a563-103e-441c-85d5-41c39008196a,network=Network(371866e1-b4cf-47fe-8d41-2c9e59f468ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b84a563-10') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.objects.instance [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lazy-loading 'pci_devices' on Instance uuid c7726af8-f937-49ae-ba07-54ed57e18a50 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] End _get_guest_xml xml=<domain type="kvm">
Aug 27 07:00:21 user nova-compute[73258]:   <uuid>c7726af8-f937-49ae-ba07-54ed57e18a50</uuid>
Aug 27 07:00:21 user nova-compute[73258]:   <name>instance-0000002b</name>
Aug 27 07:00:21 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 07:00:21 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 07:00:21 user nova-compute[73258]:   <metadata>
Aug 27 07:00:21 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 07:00:21 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 07:00:21 user nova-compute[73258]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-372450740</nova:name>
Aug 27 07:00:21 user nova-compute[73258]:       <nova:creationTime>2023-08-27 07:00:21</nova:creationTime>
Aug 27 07:00:21 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 07:00:21 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 07:00:21 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 07:00:21 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 07:00:21 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 07:00:21 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 07:00:21 user nova-compute[73258]:       </nova:flavor>
Aug 27 07:00:21 user nova-compute[73258]:       <nova:owner>
Aug 27 07:00:21 user nova-compute[73258]:         <nova:user uuid="63c94d20493445b9bd59f82646b1b63b">tempest-TestServerVolumeAttachmentScenario-1694723633-project-member</nova:user>
Aug 27 07:00:21 user nova-compute[73258]:         <nova:project uuid="4444c10053404b2684e82b5986b8a229">tempest-TestServerVolumeAttachmentScenario-1694723633</nova:project>
Aug 27 07:00:21 user nova-compute[73258]:       </nova:owner>
Aug 27 07:00:21 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 07:00:21 user nova-compute[73258]:       <nova:ports>
Aug 27 07:00:21 user nova-compute[73258]:         <nova:port uuid="1b84a563-103e-441c-85d5-41c39008196a">
Aug 27 07:00:21 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 07:00:21 user nova-compute[73258]:         </nova:port>
Aug 27 07:00:21 user nova-compute[73258]:       </nova:ports>
Aug 27 07:00:21 user nova-compute[73258]:     </nova:instance>
Aug 27 07:00:21 user nova-compute[73258]:   </metadata>
Aug 27 07:00:21 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 07:00:21 user nova-compute[73258]:     <system>
Aug 27 07:00:21 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 07:00:21 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 07:00:21 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 07:00:21 user nova-compute[73258]:       <entry name="serial">c7726af8-f937-49ae-ba07-54ed57e18a50</entry>
Aug 27 07:00:21 user nova-compute[73258]:       <entry name="uuid">c7726af8-f937-49ae-ba07-54ed57e18a50</entry>
Aug 27 07:00:21 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 07:00:21 user nova-compute[73258]:     </system>
Aug 27 07:00:21 user nova-compute[73258]:   </sysinfo>
Aug 27 07:00:21 user nova-compute[73258]:   <os>
Aug 27 07:00:21 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 07:00:21 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 07:00:21 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 07:00:21 user nova-compute[73258]:   </os>
Aug 27 07:00:21 user nova-compute[73258]:   <features>
Aug 27 07:00:21 user nova-compute[73258]:     <acpi/>
Aug 27 07:00:21 user nova-compute[73258]:     <apic/>
Aug 27 07:00:21 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 07:00:21 user nova-compute[73258]:   </features>
Aug 27 07:00:21 user nova-compute[73258]:   <clock offset="utc">
Aug 27 07:00:21 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 07:00:21 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 07:00:21 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 07:00:21 user nova-compute[73258]:   </clock>
Aug 27 07:00:21 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 07:00:21 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 07:00:21 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 07:00:21 user nova-compute[73258]:   </cpu>
Aug 27 07:00:21 user nova-compute[73258]:   <devices>
Aug 27 07:00:21 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 07:00:21 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 07:00:21 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk"/>
Aug 27 07:00:21 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 07:00:21 user nova-compute[73258]:     </disk>
Aug 27 07:00:21 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 07:00:21 user nova-compute[73258]:       <mac address="fa:16:3e:6d:71:a7"/>
Aug 27 07:00:21 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:00:21 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 07:00:21 user nova-compute[73258]:       <target dev="tap1b84a563-10"/>
Aug 27 07:00:21 user nova-compute[73258]:     </interface>
Aug 27 07:00:21 user nova-compute[73258]:     <serial type="pty">
Aug 27 07:00:21 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/console.log" append="off"/>
Aug 27 07:00:21 user nova-compute[73258]:     </serial>
Aug 27 07:00:21 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 07:00:21 user nova-compute[73258]:     <video>
Aug 27 07:00:21 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:00:21 user nova-compute[73258]:     </video>
Aug 27 07:00:21 user nova-compute[73258]:     <rng model="virtio">
Aug 27 07:00:21 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 07:00:21 user nova-compute[73258]:     </rng>
Aug 27 07:00:21 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 07:00:21 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 07:00:21 user nova-compute[73258]:       <stats period="10"/>
Aug 27 07:00:21 user nova-compute[73258]:     </memballoon>
Aug 27 07:00:21 user nova-compute[73258]:   </devices>
Aug 27 07:00:21 user nova-compute[73258]: </domain>
Aug 27 07:00:21 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-372450740',display_name='tempest-TestServerVolumeAttachmentScenario-server-372450740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-372450740',id=43,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL1MNY+8zwUJ+i1YWqYGe5aF/ZAFOLwxxrA9K0KwFTC8aALc2hzNEVG01BwEGMxdUMIGG+7fqkQ1RROgQSiKcVDo2AuhqrxWQqIvtcLfG9csnUOWLtsmpXX3OiUCvlpdg==',key_name='tempest-keypair-1619340972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4444c10053404b2684e82b5986b8a229',ramdisk_id='',reservation_id='r-x2j4a4ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1694723633',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1694723633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:00:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63c94d20493445b9bd59f82646b1b63b',uuid=c7726af8-f937-49ae-ba07-54ed57e18a50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b84a563-103e-441c-85d5-41c39008196a", "address": "fa:16:3e:6d:71:a7", "network": {"id": "371866e1-b4cf-47fe-8d41-2c9e59f468ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1786605233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4444c10053404b2684e82b5986b8a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b84a563-10", "ovs_interfaceid": "1b84a563-103e-441c-85d5-41c39008196a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Converting VIF {"id": "1b84a563-103e-441c-85d5-41c39008196a", "address": "fa:16:3e:6d:71:a7", "network": {"id": "371866e1-b4cf-47fe-8d41-2c9e59f468ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1786605233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4444c10053404b2684e82b5986b8a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b84a563-10", "ovs_interfaceid": "1b84a563-103e-441c-85d5-41c39008196a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:71:a7,bridge_name='br-int',has_traffic_filtering=True,id=1b84a563-103e-441c-85d5-41c39008196a,network=Network(371866e1-b4cf-47fe-8d41-2c9e59f468ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b84a563-10') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG os_vif [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:71:a7,bridge_name='br-int',has_traffic_filtering=True,id=1b84a563-103e-441c-85d5-41c39008196a,network=Network(371866e1-b4cf-47fe-8d41-2c9e59f468ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b84a563-10') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b84a563-10, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1b84a563-10, col_values=(('external_ids', {'iface-id': '1b84a563-103e-441c-85d5-41c39008196a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:71:a7', 'vm-uuid': 'c7726af8-f937-49ae-ba07-54ed57e18a50'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:21 user nova-compute[73258]: INFO os_vif [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:71:a7,bridge_name='br-int',has_traffic_filtering=True,id=1b84a563-103e-441c-85d5-41c39008196a,network=Network(371866e1-b4cf-47fe-8d41-2c9e59f468ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b84a563-10')
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] No VIF found with MAC fa:16:3e:6d:71:a7, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.network.neutron [req-d47f1eb8-3fae-4c6c-8a4b-ca3229b6a907 req-3a71b395-de29-40a5-8964-21b6be0c9bae service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Updated VIF entry in instance network info cache for port 1b84a563-103e-441c-85d5-41c39008196a. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG nova.network.neutron [req-d47f1eb8-3fae-4c6c-8a4b-ca3229b6a907 req-3a71b395-de29-40a5-8964-21b6be0c9bae service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Updating instance_info_cache with network_info: [{"id": "1b84a563-103e-441c-85d5-41c39008196a", "address": "fa:16:3e:6d:71:a7", "network": {"id": "371866e1-b4cf-47fe-8d41-2c9e59f468ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1786605233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4444c10053404b2684e82b5986b8a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b84a563-10", "ovs_interfaceid": "1b84a563-103e-441c-85d5-41c39008196a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:00:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d47f1eb8-3fae-4c6c-8a4b-ca3229b6a907 req-3a71b395-de29-40a5-8964-21b6be0c9bae service nova] Releasing lock "refresh_cache-c7726af8-f937-49ae-ba07-54ed57e18a50" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:00:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:22 user nova-compute[73258]: DEBUG nova.compute.manager [req-5de22a7c-bfe1-4470-8af1-e978f97d1a4a req-4805948d-40a9-434c-8be3-b17305badb4d service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Received event network-vif-plugged-1b84a563-103e-441c-85d5-41c39008196a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:00:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5de22a7c-bfe1-4470-8af1-e978f97d1a4a req-4805948d-40a9-434c-8be3-b17305badb4d service nova] Acquiring lock "c7726af8-f937-49ae-ba07-54ed57e18a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5de22a7c-bfe1-4470-8af1-e978f97d1a4a req-4805948d-40a9-434c-8be3-b17305badb4d service nova] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5de22a7c-bfe1-4470-8af1-e978f97d1a4a req-4805948d-40a9-434c-8be3-b17305badb4d service nova] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:22 user nova-compute[73258]: DEBUG nova.compute.manager [req-5de22a7c-bfe1-4470-8af1-e978f97d1a4a req-4805948d-40a9-434c-8be3-b17305badb4d service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] No waiting events found dispatching network-vif-plugged-1b84a563-103e-441c-85d5-41c39008196a {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:00:22 user nova-compute[73258]: WARNING nova.compute.manager [req-5de22a7c-bfe1-4470-8af1-e978f97d1a4a req-4805948d-40a9-434c-8be3-b17305badb4d service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Received unexpected event network-vif-plugged-1b84a563-103e-441c-85d5-41c39008196a for instance with vm_state building and task_state spawning.
Aug 27 07:00:22 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119607.9091182, 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:00:22 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] VM Stopped (Lifecycle Event)
Aug 27 07:00:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-b1f4827c-f9d8-4459-9d91-b839f19bad90 None None] [instance: 686bb9a9-1e59-41bd-b52a-6bc5c9e96bd5] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:00:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-c4e91630-6d58-45ad-853d-c8d58ddd0c4f req-a758b543-9522-4e05-8bad-06d519a403d6 service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Received event network-vif-plugged-1b84a563-103e-441c-85d5-41c39008196a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:00:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c4e91630-6d58-45ad-853d-c8d58ddd0c4f req-a758b543-9522-4e05-8bad-06d519a403d6 service nova] Acquiring lock "c7726af8-f937-49ae-ba07-54ed57e18a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c4e91630-6d58-45ad-853d-c8d58ddd0c4f req-a758b543-9522-4e05-8bad-06d519a403d6 service nova] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c4e91630-6d58-45ad-853d-c8d58ddd0c4f req-a758b543-9522-4e05-8bad-06d519a403d6 service nova] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-c4e91630-6d58-45ad-853d-c8d58ddd0c4f req-a758b543-9522-4e05-8bad-06d519a403d6 service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] No waiting events found dispatching network-vif-plugged-1b84a563-103e-441c-85d5-41c39008196a {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:00:24 user nova-compute[73258]: WARNING nova.compute.manager [req-c4e91630-6d58-45ad-853d-c8d58ddd0c4f req-a758b543-9522-4e05-8bad-06d519a403d6 service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Received unexpected event network-vif-plugged-1b84a563-103e-441c-85d5-41c39008196a for instance with vm_state building and task_state spawning.
Aug 27 07:00:24 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119624.9782565, c7726af8-f937-49ae-ba07-54ed57e18a50 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:00:24 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] VM Resumed (Lifecycle Event)
Aug 27 07:00:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 07:00:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 07:00:24 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Instance spawned successfully.
Aug 27 07:00:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 07:00:25 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:00:25 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:00:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:00:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:00:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:00:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:00:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:00:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:00:25 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:00:25 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119624.9795525, c7726af8-f937-49ae-ba07-54ed57e18a50 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:00:25 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] VM Started (Lifecycle Event)
Aug 27 07:00:25 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:00:25 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:00:25 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:00:25 user nova-compute[73258]: INFO nova.compute.manager [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Took 6.17 seconds to spawn the instance on the hypervisor.
Aug 27 07:00:25 user nova-compute[73258]: DEBUG nova.compute.manager [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:00:25 user nova-compute[73258]: INFO nova.compute.manager [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Took 6.95 seconds to build instance.
Aug 27 07:00:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-fcfef614-9fff-4a68-ab23-73a817dd403d tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.093s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Acquiring lock "b17c6dd1-2525-411d-8b81-eb87c81c8527" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Lock "b17c6dd1-2525-411d-8b81-eb87c81c8527" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Acquiring lock "b17c6dd1-2525-411d-8b81-eb87c81c8527-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Lock "b17c6dd1-2525-411d-8b81-eb87c81c8527-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Lock "b17c6dd1-2525-411d-8b81-eb87c81c8527-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:33 user nova-compute[73258]: INFO nova.compute.manager [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Terminating instance
Aug 27 07:00:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG nova.compute.manager [req-b81071a5-3d87-4b1d-9af6-09bd3e2b8091 req-5cdc7f57-0de0-4f3f-8eb1-b50d60c8db90 service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Received event network-vif-unplugged-18d33991-02ad-4170-b4f7-e58280997f72 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b81071a5-3d87-4b1d-9af6-09bd3e2b8091 req-5cdc7f57-0de0-4f3f-8eb1-b50d60c8db90 service nova] Acquiring lock "b17c6dd1-2525-411d-8b81-eb87c81c8527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b81071a5-3d87-4b1d-9af6-09bd3e2b8091 req-5cdc7f57-0de0-4f3f-8eb1-b50d60c8db90 service nova] Lock "b17c6dd1-2525-411d-8b81-eb87c81c8527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b81071a5-3d87-4b1d-9af6-09bd3e2b8091 req-5cdc7f57-0de0-4f3f-8eb1-b50d60c8db90 service nova] Lock "b17c6dd1-2525-411d-8b81-eb87c81c8527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG nova.compute.manager [req-b81071a5-3d87-4b1d-9af6-09bd3e2b8091 req-5cdc7f57-0de0-4f3f-8eb1-b50d60c8db90 service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] No waiting events found dispatching network-vif-unplugged-18d33991-02ad-4170-b4f7-e58280997f72 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG nova.compute.manager [req-b81071a5-3d87-4b1d-9af6-09bd3e2b8091 req-5cdc7f57-0de0-4f3f-8eb1-b50d60c8db90 service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Received event network-vif-unplugged-18d33991-02ad-4170-b4f7-e58280997f72 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 07:00:33 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Instance destroyed successfully.
Aug 27 07:00:33 user nova-compute[73258]: DEBUG nova.objects.instance [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Lazy-loading 'resources' on Instance uuid b17c6dd1-2525-411d-8b81-eb87c81c8527 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1675980342',display_name='tempest-VolumesActionsTest-instance-1675980342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1675980342',id=42,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:58:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b987eec62211484791651d45bdad37be',ramdisk_id='',reservation_id='r-cnod2hp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-10137930',owner_user_name='tempest-VolumesActionsTest-10137930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:58:34Z,user_data=None,user_id='1d65f266cc6d4beeb060324ab632e317',uuid=b17c6dd1-2525-411d-8b81-eb87c81c8527,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18d33991-02ad-4170-b4f7-e58280997f72", "address": "fa:16:3e:b1:e2:cd", "network": {"id": "0f039a84-551e-4075-8bb5-2c07ad845c46", "bridge": "br-int", "label": "tempest-VolumesActionsTest-572218927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b987eec62211484791651d45bdad37be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d33991-02", "ovs_interfaceid": "18d33991-02ad-4170-b4f7-e58280997f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Converting VIF {"id": "18d33991-02ad-4170-b4f7-e58280997f72", "address": "fa:16:3e:b1:e2:cd", "network": {"id": "0f039a84-551e-4075-8bb5-2c07ad845c46", "bridge": "br-int", "label": "tempest-VolumesActionsTest-572218927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b987eec62211484791651d45bdad37be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d33991-02", "ovs_interfaceid": "18d33991-02ad-4170-b4f7-e58280997f72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e2:cd,bridge_name='br-int',has_traffic_filtering=True,id=18d33991-02ad-4170-b4f7-e58280997f72,network=Network(0f039a84-551e-4075-8bb5-2c07ad845c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d33991-02') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG os_vif [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e2:cd,bridge_name='br-int',has_traffic_filtering=True,id=18d33991-02ad-4170-b4f7-e58280997f72,network=Network(0f039a84-551e-4075-8bb5-2c07ad845c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d33991-02') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18d33991-02, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:33 user nova-compute[73258]: INFO os_vif [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:e2:cd,bridge_name='br-int',has_traffic_filtering=True,id=18d33991-02ad-4170-b4f7-e58280997f72,network=Network(0f039a84-551e-4075-8bb5-2c07ad845c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d33991-02')
Aug 27 07:00:33 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Deleting instance files /opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527_del
Aug 27 07:00:33 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Deletion of /opt/stack/data/nova/instances/b17c6dd1-2525-411d-8b81-eb87c81c8527_del complete
Aug 27 07:00:33 user nova-compute[73258]: INFO nova.compute.manager [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 27 07:00:33 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 07:00:33 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 07:00:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:35 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:00:35 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Took 1.37 seconds to deallocate network for instance.
Aug 27 07:00:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-f20d4df8-8e2c-45b0-9875-7fd0b64a0610 req-a1b0f8d1-266c-4480-8b1c-e9ca2ce2e0a6 service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Received event network-vif-deleted-18d33991-02ad-4170-b4f7-e58280997f72 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:00:35 user nova-compute[73258]: INFO nova.compute.manager [req-f20d4df8-8e2c-45b0-9875-7fd0b64a0610 req-a1b0f8d1-266c-4480-8b1c-e9ca2ce2e0a6 service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Neutron deleted interface 18d33991-02ad-4170-b4f7-e58280997f72; detaching it from the instance and deleting it from the info cache
Aug 27 07:00:35 user nova-compute[73258]: DEBUG nova.network.neutron [req-f20d4df8-8e2c-45b0-9875-7fd0b64a0610 req-a1b0f8d1-266c-4480-8b1c-e9ca2ce2e0a6 service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:00:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-f20d4df8-8e2c-45b0-9875-7fd0b64a0610 req-a1b0f8d1-266c-4480-8b1c-e9ca2ce2e0a6 service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Detach interface failed, port_id=18d33991-02ad-4170-b4f7-e58280997f72, reason: Instance b17c6dd1-2525-411d-8b81-eb87c81c8527 could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 07:00:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:35 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:00:35 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:00:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-5cfd3965-8ac0-49d3-8779-670b8d3ce9d3 req-8599c512-3c2d-46fe-b0a5-38233d79d511 service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Received event network-vif-plugged-18d33991-02ad-4170-b4f7-e58280997f72 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:00:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5cfd3965-8ac0-49d3-8779-670b8d3ce9d3 req-8599c512-3c2d-46fe-b0a5-38233d79d511 service nova] Acquiring lock "b17c6dd1-2525-411d-8b81-eb87c81c8527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5cfd3965-8ac0-49d3-8779-670b8d3ce9d3 req-8599c512-3c2d-46fe-b0a5-38233d79d511 service nova] Lock "b17c6dd1-2525-411d-8b81-eb87c81c8527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5cfd3965-8ac0-49d3-8779-670b8d3ce9d3 req-8599c512-3c2d-46fe-b0a5-38233d79d511 service nova] Lock "b17c6dd1-2525-411d-8b81-eb87c81c8527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-5cfd3965-8ac0-49d3-8779-670b8d3ce9d3 req-8599c512-3c2d-46fe-b0a5-38233d79d511 service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] No waiting events found dispatching network-vif-plugged-18d33991-02ad-4170-b4f7-e58280997f72 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:00:35 user nova-compute[73258]: WARNING nova.compute.manager [req-5cfd3965-8ac0-49d3-8779-670b8d3ce9d3 req-8599c512-3c2d-46fe-b0a5-38233d79d511 service nova] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Received unexpected event network-vif-plugged-18d33991-02ad-4170-b4f7-e58280997f72 for instance with vm_state deleted and task_state None.
Aug 27 07:00:35 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Deleted allocations for instance b17c6dd1-2525-411d-8b81-eb87c81c8527
Aug 27 07:00:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-7af5f418-a31d-4509-ae18-64ee7b29a123 tempest-VolumesActionsTest-10137930 tempest-VolumesActionsTest-10137930-project-member] Lock "b17c6dd1-2525-411d-8b81-eb87c81c8527" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.479s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:41 user nova-compute[73258]: DEBUG nova.objects.instance [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lazy-loading 'flavor' on Instance uuid 54697fcb-9ffe-4660-b7d2-7b89dfd72439 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:00:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:41 user nova-compute[73258]: INFO nova.compute.manager [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Attaching volume ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f to /dev/vdb
Aug 27 07:00:41 user nova-compute[73258]: DEBUG os_brick.utils [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:00:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:41 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[640342d1-ca8b-4d10-b28f-877c41615ac0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:41 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d72843-91a5-4ae1-ac03-fb003fb6aa7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:41 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:41 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd6726b-e1f7-4ec2-9661-2c12d43b7c1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aacbc8f-15b1-4251-a382-c0cdce07b906]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:00:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 07:00:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:00:42 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 07:00:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5982c7f1-3e3c-4eae-b78b-3427e37c6467]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 07:00:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 07:00:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 07:00:42 user nova-compute[73258]: DEBUG os_brick.utils [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:00:42 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Updating existing volume attachment record: 7f6704a4-08aa-4b6d-9e27-e5b23c46bbf6 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 07:00:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:48 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119633.5850937, b17c6dd1-2525-411d-8b81-eb87c81c8527 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:00:48 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] VM Stopped (Lifecycle Event)
Aug 27 07:00:48 user nova-compute[73258]: DEBUG nova.compute.manager [None req-2260679a-7950-4c6f-a5f5-52afa24cbddd None None] [instance: b17c6dd1-2525-411d-8b81-eb87c81c8527] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:00:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJHzOyPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:00:53 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:00:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:00:53 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:00:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:00:53 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[579c619e-6781-4c6d-a209-e54ef0790a42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 07:00:53 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5f3b86-d684-4d05-b2dc-22b5269590e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f] added
Aug 27 07:00:53 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[06624585-57fe-4ae8-9a51-74c45c653dcb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d58f9c4-b992-4a98-93c0-9101e5af15eb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uJHzOyPb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uJHzOyPb" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[410b6b02-0808-45a6-acce-c937fe436608]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uJHzOyPb'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[548d4643-2aec-4b81-bb95-063c7bd0377b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a536e9-6715-47ef-8d7a-8cba36976edc]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 07:00:53 user nova-compute[73258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 07:00:53 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 07:00:53 user nova-compute[73258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 07:00:53 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:00:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a51a9eb-860b-43cf-8687-68579e604c18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f, portal: 172.16.0.220,3260]
Aug 27 07:00:54 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f, portal: 172.16.0.220,3260] successful.
Aug 27 07:00:54 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b8c07b-6951-4498-9798-cd1a64dd1431]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e04da1-5516-4b6f-b404-01a49e43206c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 07:00:54 user nova-compute[73258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 07:00:54 user nova-compute[73258]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f (non-flash)
Aug 27 07:00:54 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 07:00:54 user nova-compute[73258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 07:00:54 user nova-compute[73258]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f (non-flash)
Aug 27 07:00:54 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d252ea-7ec8-4b72-84b3-bf95a5130ae0]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 07:00:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:55 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 07:00:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJHzOyPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 07:00:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:00:55 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26134646636656162', 'path': '/dev/sdc'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:00:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134646636656162', 'path': '/dev/sdc'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 07:00:55 user nova-compute[73258]: DEBUG nova.objects.instance [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lazy-loading 'flavor' on Instance uuid 54697fcb-9ffe-4660-b7d2-7b89dfd72439 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:00:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 07:00:55 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:00:55 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 07:00:55 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 07:00:55 user nova-compute[73258]:   <serial>ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f</serial>
Aug 27 07:00:55 user nova-compute[73258]: </disk>
Aug 27 07:00:55 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 07:00:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:00:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:00:55 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] No VIF found with MAC fa:16:3e:0a:85:cd, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 07:00:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-85c97645-8d51-4967-9c67-76736e573e8f tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.844s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:00:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:00:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:00:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 07:00:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-a836678e-240d-4ead-b0b5-64d146910a23" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:00:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-a836678e-240d-4ead-b0b5-64d146910a23" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:00:56 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 07:00:56 user nova-compute[73258]: DEBUG nova.objects.instance [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lazy-loading 'info_cache' on Instance uuid a836678e-240d-4ead-b0b5-64d146910a23 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:00:56 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Updating instance_info_cache with network_info: [{"id": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "address": "fa:16:3e:00:0b:2b", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eae0f1e-d6", "ovs_interfaceid": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:00:56 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-a836678e-240d-4ead-b0b5-64d146910a23" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:00:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 07:00:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:00:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:00:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:00:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:00:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:57 user nova-compute[73258]: INFO nova.compute.manager [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Detaching volume ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f
Aug 27 07:00:57 user nova-compute[73258]: INFO nova.virt.block_device [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Attempting to driver detach volume ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f from mountpoint /dev/vdb
Aug 27 07:00:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Attempting to detach device vdb from instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 07:00:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 07:00:57 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:00:57 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 07:00:57 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 07:00:57 user nova-compute[73258]:   <serial>ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f</serial>
Aug 27 07:00:57 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 07:00:57 user nova-compute[73258]: </disk>
Aug 27 07:00:57 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 07:00:57 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:00:57 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:00:57 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Successfully detached device vdb from instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 from the persistent domain config.
Aug 27 07:00:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 07:00:57 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 07:00:57 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:00:57 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 07:00:57 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 07:00:57 user nova-compute[73258]:   <serial>ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f</serial>
Aug 27 07:00:57 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 07:00:57 user nova-compute[73258]: </disk>
Aug 27 07:00:57 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 07:00:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "7ee743f1-9611-4165-838e-54fccb332f1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "7ee743f1-9611-4165-838e-54fccb332f1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:57 user nova-compute[73258]: INFO nova.compute.manager [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Terminating instance
Aug 27 07:00:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG nova.compute.manager [req-ddeb602b-2ebb-41e8-a065-7cf4e1eea2e0 req-974c6929-1f70-48e1-b4f6-2dcae0cacf3b service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received event network-vif-unplugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ddeb602b-2ebb-41e8-a065-7cf4e1eea2e0 req-974c6929-1f70-48e1-b4f6-2dcae0cacf3b service nova] Acquiring lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ddeb602b-2ebb-41e8-a065-7cf4e1eea2e0 req-974c6929-1f70-48e1-b4f6-2dcae0cacf3b service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ddeb602b-2ebb-41e8-a065-7cf4e1eea2e0 req-974c6929-1f70-48e1-b4f6-2dcae0cacf3b service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG nova.compute.manager [req-ddeb602b-2ebb-41e8-a065-7cf4e1eea2e0 req-974c6929-1f70-48e1-b4f6-2dcae0cacf3b service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] No waiting events found dispatching network-vif-unplugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG nova.compute.manager [req-ddeb602b-2ebb-41e8-a065-7cf4e1eea2e0 req-974c6929-1f70-48e1-b4f6-2dcae0cacf3b service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received event network-vif-unplugged-27d47d21-922e-43da-8dee-8d62f45edd64 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693119658.3485801, 54697fcb-9ffe-4660-b7d2-7b89dfd72439 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 07:00:58 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Successfully detached device vdb from instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 from the live domain config.
Aug 27 07:00:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJHzOyPb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:00:58 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfa1fd7-96fa-4bfc-9178-4bc597ada818]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[05eb0d47-843e-405f-a154-5ab56bfee869]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 07:00:58 user nova-compute[73258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 07:00:58 user nova-compute[73258]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f (non-flash)
Aug 27 07:00:58 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 07:00:58 user nova-compute[73258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 07:00:58 user nova-compute[73258]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f (non-flash)
Aug 27 07:00:58 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa41032b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f'): ({'sdc'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Removing single pathed devices sdc {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc98f0a-cf13-4c02-882a-144e23c6f5ca]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.065s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[217eb002-d164-4537-ab47-be5454d5ee6e]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Flushing IO for device /dev/sdc {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[123b8486-ae51-44d6-8894-d47af14719cc]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[31279a67-f9f9-4e1d-bbcf-370b001e4e0d]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.052s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f783e722-2f41-4afc-b763-08b2c39e6781]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:58 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Instance destroyed successfully.
Aug 27 07:00:58 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'resources' on Instance uuid 7ee743f1-9611-4165-838e-54fccb332f1a {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcc3d2b-7ff0-465c-b6dc-fbeafd74234e]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f, portal: 172.16.0.220,3260]
Aug 27 07:00:58 user nova-compute[73258]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f, portal: 172.16.0.220,3260] successful.
Aug 27 07:00:58 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:45:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2132461241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2132461241',id=26,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:47:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81cf34590d8d4b8b89b9626c6e150df6',ramdisk_id='',reservation_id='r-tebfip5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:48:52Z,user_data=None,user_id='36c0faed29a446aa9fa6ff8692581aba',uuid=7ee743f1-9611-4165-838e-54fccb332f1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27d47d21-922e-43da-8dee-8d62f45edd64", "address": "fa:16:3e:5c:73:20", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d47d21-92", "ovs_interfaceid": "27d47d21-922e-43da-8dee-8d62f45edd64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converting VIF {"id": "27d47d21-922e-43da-8dee-8d62f45edd64", "address": "fa:16:3e:5c:73:20", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d47d21-92", "ovs_interfaceid": "27d47d21-922e-43da-8dee-8d62f45edd64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:73:20,bridge_name='br-int',has_traffic_filtering=True,id=27d47d21-922e-43da-8dee-8d62f45edd64,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d47d21-92') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_vif [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:73:20,bridge_name='br-int',has_traffic_filtering=True,id=27d47d21-922e-43da-8dee-8d62f45edd64,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d47d21-92') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27d47d21-92, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:00:58 user nova-compute[73258]: INFO os_vif [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:73:20,bridge_name='br-int',has_traffic_filtering=True,id=27d47d21-922e-43da-8dee-8d62f45edd64,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d47d21-92')
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0e47ff-183c-44d6-b7a2-adc0e8af9c0f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e681cc4f-2d09-44f5-b781-40057d51be9a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] <== disconnect_volume: return (414ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKkwYrbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:00:58 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[be87be29-1809-43ca-bf47-19482b03d1df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f4efdf-b766-4d50-8e4f-f1a5368f5bc0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 07:00:58 user nova-compute[73258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 07:00:58 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 (non-flash)
Aug 27 07:00:58 user nova-compute[73258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 07:00:58 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4304ff6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7'): ({'sde'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Removing single pathed devices sde {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abbdfd7-8d41-4562-94e8-f45eb730c04f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a62e127-5de7-4287-a2cf-41f190073323]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Flushing IO for device /dev/sde {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[319f731f-b784-4c8d-8c85-351dbe0e1a2d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96add43-6f16-49ac-89ae-e0ac675884cd]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] SCSI volumes sde have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[941fe694-df37-43c8-961a-21b7139f7545]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:00:58 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:59 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f836f565-3ac0-4a0c-a5a7-411894747f72]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:59 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7, portal: 172.16.0.220,3260]
Aug 27 07:00:59 user nova-compute[73258]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7, portal: 172.16.0.220,3260] successful.
Aug 27 07:00:59 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:00:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:00:59 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:692b19f7-0f31-49f8-bfb3-fe4ef93542f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:00:59 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a4ffd7-bf2e-477a-b181-8c4d909cc506]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:00:59 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:00:59 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:00:59 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] <== disconnect_volume: return (267ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:00:59 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 07:00:59 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Deleting instance files /opt/stack/data/nova/instances/7ee743f1-9611-4165-838e-54fccb332f1a_del
Aug 27 07:00:59 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Deletion of /opt/stack/data/nova/instances/7ee743f1-9611-4165-838e-54fccb332f1a_del complete
Aug 27 07:00:59 user nova-compute[73258]: INFO nova.compute.manager [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 27 07:00:59 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 07:00:59 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 07:00:59 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 07:00:59 user nova-compute[73258]: DEBUG nova.objects.instance [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lazy-loading 'flavor' on Instance uuid 54697fcb-9ffe-4660-b7d2-7b89dfd72439 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:00:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-50370063-647b-4c05-b232-a2427b20e970 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.893s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:00:59 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:00:59 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Took 0.58 seconds to deallocate network for instance.
Aug 27 07:00:59 user nova-compute[73258]: DEBUG nova.compute.manager [req-9b9f62c7-7bf9-41dd-a72c-9fc3adadc200 req-8e219a2f-d9c5-45ca-b129-a1067a3ea27e service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received event network-vif-deleted-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:00:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:01:00 user nova-compute[73258]: DEBUG nova.compute.manager [req-a983eccd-af72-46ad-9c36-382684836c8d req-3ba61abc-2edf-4929-8d9a-ea46b061d961 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received event network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:01:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a983eccd-af72-46ad-9c36-382684836c8d req-3ba61abc-2edf-4929-8d9a-ea46b061d961 service nova] Acquiring lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:01:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a983eccd-af72-46ad-9c36-382684836c8d req-3ba61abc-2edf-4929-8d9a-ea46b061d961 service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:01:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a983eccd-af72-46ad-9c36-382684836c8d req-3ba61abc-2edf-4929-8d9a-ea46b061d961 service nova] Lock "7ee743f1-9611-4165-838e-54fccb332f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:01:00 user nova-compute[73258]: DEBUG nova.compute.manager [req-a983eccd-af72-46ad-9c36-382684836c8d req-3ba61abc-2edf-4929-8d9a-ea46b061d961 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] No waiting events found dispatching network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:01:00 user nova-compute[73258]: WARNING nova.compute.manager [req-a983eccd-af72-46ad-9c36-382684836c8d req-3ba61abc-2edf-4929-8d9a-ea46b061d961 service nova] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Received unexpected event network-vif-plugged-27d47d21-922e-43da-8dee-8d62f45edd64 for instance with vm_state active and task_state deleting.
Aug 27 07:01:00 user nova-compute[73258]: INFO nova.compute.manager [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Took 0.81 seconds to detach 1 volumes for instance.
Aug 27 07:01:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:01:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:01:00 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:01:00 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:01:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:01:00 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Deleted allocations for instance 7ee743f1-9611-4165-838e-54fccb332f1a
Aug 27 07:01:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a98245f4-7a7b-4e79-876e-e3d56ea2aae8 tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "7ee743f1-9611-4165-838e-54fccb332f1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.016s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:01:02 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:01:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:01:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:01:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:01:02 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:01:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:03 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:01:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:01:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:04 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:01:04 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:01:04 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8113MB free_disk=23.792083740234375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:01:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:01:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:01:05 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance a836678e-240d-4ead-b0b5-64d146910a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:01:05 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:01:05 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance d2edd67c-c877-4c45-ae13-ee5f82853066 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:01:05 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance c7726af8-f937-49ae-ba07-54ed57e18a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:01:05 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:01:05 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:01:05 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:01:05 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:01:05 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:01:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:01:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:01:13 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119658.7301264, 7ee743f1-9611-4165-838e-54fccb332f1a => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:01:13 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] VM Stopped (Lifecycle Event)
Aug 27 07:01:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-817a3c1f-a4be-498c-9a5f-f4c77a956849 None None] [instance: 7ee743f1-9611-4165-838e-54fccb332f1a] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:01:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:01:14 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:01:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:01:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:01:21 user nova-compute[73258]: DEBUG nova.compute.manager [req-9893ddda-4fda-4a3f-afc2-2b81e557592a req-a1f6b970-c33d-4890-962b-f6509bb9483e service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received event network-changed-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:01:21 user nova-compute[73258]: DEBUG nova.compute.manager [req-9893ddda-4fda-4a3f-afc2-2b81e557592a req-a1f6b970-c33d-4890-962b-f6509bb9483e service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Refreshing instance network info cache due to event network-changed-9e55f50f-3335-4d20-b9ca-5e497b226d95. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:01:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9893ddda-4fda-4a3f-afc2-2b81e557592a req-a1f6b970-c33d-4890-962b-f6509bb9483e service nova] Acquiring lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:01:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9893ddda-4fda-4a3f-afc2-2b81e557592a req-a1f6b970-c33d-4890-962b-f6509bb9483e service nova] Acquired lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:01:21 user nova-compute[73258]: DEBUG nova.network.neutron [req-9893ddda-4fda-4a3f-afc2-2b81e557592a req-a1f6b970-c33d-4890-962b-f6509bb9483e service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Refreshing network info cache for port 9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:01:22 user nova-compute[73258]: DEBUG nova.network.neutron [req-9893ddda-4fda-4a3f-afc2-2b81e557592a req-a1f6b970-c33d-4890-962b-f6509bb9483e service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Updated VIF entry in instance network info cache for port 9e55f50f-3335-4d20-b9ca-5e497b226d95. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:01:22 user nova-compute[73258]: DEBUG nova.network.neutron [req-9893ddda-4fda-4a3f-afc2-2b81e557592a req-a1f6b970-c33d-4890-962b-f6509bb9483e service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Updating instance_info_cache with network_info: [{"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:01:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9893ddda-4fda-4a3f-afc2-2b81e557592a req-a1f6b970-c33d-4890-962b-f6509bb9483e service nova] Releasing lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:01:22 user nova-compute[73258]: DEBUG nova.compute.manager [req-52bfec03-d448-40be-8650-c86fd8e807fb req-3fce9bcc-510d-43e6-b0a8-26a89e645b51 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received event network-changed-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:01:22 user nova-compute[73258]: DEBUG nova.compute.manager [req-52bfec03-d448-40be-8650-c86fd8e807fb req-3fce9bcc-510d-43e6-b0a8-26a89e645b51 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Refreshing instance network info cache due to event network-changed-9e55f50f-3335-4d20-b9ca-5e497b226d95. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:01:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-52bfec03-d448-40be-8650-c86fd8e807fb req-3fce9bcc-510d-43e6-b0a8-26a89e645b51 service nova] Acquiring lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:01:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-52bfec03-d448-40be-8650-c86fd8e807fb req-3fce9bcc-510d-43e6-b0a8-26a89e645b51 service nova] Acquired lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:01:22 user nova-compute[73258]: DEBUG nova.network.neutron [req-52bfec03-d448-40be-8650-c86fd8e807fb req-3fce9bcc-510d-43e6-b0a8-26a89e645b51 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Refreshing network info cache for port 9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:01:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "d2edd67c-c877-4c45-ae13-ee5f82853066" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:01:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:01:22 user nova-compute[73258]: INFO nova.compute.manager [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Detaching volume 949c879e-8298-4d6f-a4bf-4dcd526f8013
Aug 27 07:01:23 user nova-compute[73258]: INFO nova.virt.block_device [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Attempting to driver detach volume 949c879e-8298-4d6f-a4bf-4dcd526f8013 from mountpoint /dev/vdb
Aug 27 07:01:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Attempting to detach device vdb from instance d2edd67c-c877-4c45-ae13-ee5f82853066 from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 07:01:23 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:01:23 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 07:01:23 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 07:01:23 user nova-compute[73258]:   <serial>949c879e-8298-4d6f-a4bf-4dcd526f8013</serial>
Aug 27 07:01:23 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 07:01:23 user nova-compute[73258]: </disk>
Aug 27 07:01:23 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 07:01:23 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Successfully detached device vdb from instance d2edd67c-c877-4c45-ae13-ee5f82853066 from the persistent domain config.
Aug 27 07:01:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d2edd67c-c877-4c45-ae13-ee5f82853066 from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 07:01:23 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:01:23 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 07:01:23 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 07:01:23 user nova-compute[73258]:   <serial>949c879e-8298-4d6f-a4bf-4dcd526f8013</serial>
Aug 27 07:01:23 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 07:01:23 user nova-compute[73258]: </disk>
Aug 27 07:01:23 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG nova.network.neutron [req-52bfec03-d448-40be-8650-c86fd8e807fb req-3fce9bcc-510d-43e6-b0a8-26a89e645b51 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Updated VIF entry in instance network info cache for port 9e55f50f-3335-4d20-b9ca-5e497b226d95. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG nova.network.neutron [req-52bfec03-d448-40be-8650-c86fd8e807fb req-3fce9bcc-510d-43e6-b0a8-26a89e645b51 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Updating instance_info_cache with network_info: [{"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-52bfec03-d448-40be-8650-c86fd8e807fb req-3fce9bcc-510d-43e6-b0a8-26a89e645b51 service nova] Releasing lock "refresh_cache-d2edd67c-c877-4c45-ae13-ee5f82853066" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693119683.5702477, d2edd67c-c877-4c45-ae13-ee5f82853066 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d2edd67c-c877-4c45-ae13-ee5f82853066 {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 07:01:23 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Successfully detached device vdb from instance d2edd67c-c877-4c45-ae13-ee5f82853066 from the live domain config.
Aug 27 07:01:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjYXaKJx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:01:23 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:01:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5755d3a2-1ace-47b0-88c6-779121e84431]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba34361-75bc-4377-bb76-a43010d3a245]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 07:01:23 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 (non-flash)
Aug 27 07:01:23 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4304ffe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bab99e-1f4c-46f5-99ab-5a22da40574c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b72559f-5856-44f9-86a0-a6f5c4ec1dd3]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f90b987-7760-4946-b583-80ed786cd737]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6840a5ed-5c9f-49f3-a7fb-4dc6e9d6ed98]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[995aaabe-474b-432a-825f-3cfd0530e11d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3b05ad-5a22-4ae7-9ffa-d76da14e4878]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013, portal: 172.16.0.220,3260]
Aug 27 07:01:23 user nova-compute[73258]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013, portal: 172.16.0.220,3260] successful.
Aug 27 07:01:23 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949c879e-8298-4d6f-a4bf-4dcd526f8013 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[440500fe-550d-4e76-b1c7-7d1a9c8a2ac4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] <== disconnect_volume: return (313ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:01:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 07:01:24 user nova-compute[73258]: DEBUG nova.objects.instance [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lazy-loading 'flavor' on Instance uuid d2edd67c-c877-4c45-ae13-ee5f82853066 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:01:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-ca7473a3-6018-45ad-b0ae-58b7318c7910 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.792s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:01:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:01:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:01:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:01:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:01:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:01:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:01:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "a836678e-240d-4ead-b0b5-64d146910a23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:01:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "a836678e-240d-4ead-b0b5-64d146910a23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:01:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "a836678e-240d-4ead-b0b5-64d146910a23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:01:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "a836678e-240d-4ead-b0b5-64d146910a23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:01:48 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "a836678e-240d-4ead-b0b5-64d146910a23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:01:48 user nova-compute[73258]: INFO nova.compute.manager [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Terminating instance
Aug 27 07:01:48 user nova-compute[73258]: DEBUG nova.compute.manager [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 07:01:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:01:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:01:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:01:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:01:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-8e5f95fd-b8a2-44ec-8f56-a1a9c16322ce req-f0086622-a845-43f8-87d7-1f084cb2d1dd service nova] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Received event network-vif-unplugged-0eae0f1e-d6c2-48bd-ad15-dba679a91a9f {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:01:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8e5f95fd-b8a2-44ec-8f56-a1a9c16322ce req-f0086622-a845-43f8-87d7-1f084cb2d1dd service nova] Acquiring lock "a836678e-240d-4ead-b0b5-64d146910a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:01:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8e5f95fd-b8a2-44ec-8f56-a1a9c16322ce req-f0086622-a845-43f8-87d7-1f084cb2d1dd service nova] Lock "a836678e-240d-4ead-b0b5-64d146910a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:01:49 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8e5f95fd-b8a2-44ec-8f56-a1a9c16322ce req-f0086622-a845-43f8-87d7-1f084cb2d1dd service nova] Lock "a836678e-240d-4ead-b0b5-64d146910a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:01:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-8e5f95fd-b8a2-44ec-8f56-a1a9c16322ce req-f0086622-a845-43f8-87d7-1f084cb2d1dd service nova] [instance: a836678e-240d-4ead-b0b5-64d146910a23] No waiting events found dispatching network-vif-unplugged-0eae0f1e-d6c2-48bd-ad15-dba679a91a9f {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:01:49 user nova-compute[73258]: DEBUG nova.compute.manager [req-8e5f95fd-b8a2-44ec-8f56-a1a9c16322ce req-f0086622-a845-43f8-87d7-1f084cb2d1dd service nova] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Received event network-vif-unplugged-0eae0f1e-d6c2-48bd-ad15-dba679a91a9f for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 07:01:49 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Instance destroyed successfully.
Aug 27 07:01:49 user nova-compute[73258]: DEBUG nova.objects.instance [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lazy-loading 'resources' on Instance uuid a836678e-240d-4ead-b0b5-64d146910a23 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:01:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:42:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-858882651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-858882651',id=18,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:42:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81cf34590d8d4b8b89b9626c6e150df6',ramdisk_id='',reservation_id='r-cksx805o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:44:02Z,user_data=None,user_id='36c0faed29a446aa9fa6ff8692581aba',uuid=a836678e-240d-4ead-b0b5-64d146910a23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "address": "fa:16:3e:00:0b:2b", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eae0f1e-d6", "ovs_interfaceid": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 07:01:49 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converting VIF {"id": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "address": "fa:16:3e:00:0b:2b", "network": {"id": "fb516478-34c4-4e73-b93c-0f2cabe1d956", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-204673190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81cf34590d8d4b8b89b9626c6e150df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eae0f1e-d6", "ovs_interfaceid": "0eae0f1e-d6c2-48bd-ad15-dba679a91a9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:01:49 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:0b:2b,bridge_name='br-int',has_traffic_filtering=True,id=0eae0f1e-d6c2-48bd-ad15-dba679a91a9f,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eae0f1e-d6') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:01:49 user nova-compute[73258]: DEBUG os_vif [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:0b:2b,bridge_name='br-int',has_traffic_filtering=True,id=0eae0f1e-d6c2-48bd-ad15-dba679a91a9f,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eae0f1e-d6') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 07:01:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:01:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0eae0f1e-d6, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:01:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:01:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:01:49 user nova-compute[73258]: INFO os_vif [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:0b:2b,bridge_name='br-int',has_traffic_filtering=True,id=0eae0f1e-d6c2-48bd-ad15-dba679a91a9f,network=Network(fb516478-34c4-4e73-b93c-0f2cabe1d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eae0f1e-d6')
Aug 27 07:01:49 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Deleting instance files /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23_del
Aug 27 07:01:49 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Deletion of /opt/stack/data/nova/instances/a836678e-240d-4ead-b0b5-64d146910a23_del complete
Aug 27 07:01:49 user nova-compute[73258]: INFO nova.compute.manager [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 27 07:01:49 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 07:01:49 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 07:01:49 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: a836678e-240d-4ead-b0b5-64d146910a23] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 07:01:50 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:01:50 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Took 0.49 seconds to deallocate network for instance.
Aug 27 07:01:50 user nova-compute[73258]: DEBUG nova.compute.manager [req-a5f2b55a-42b4-449f-b483-177ae46958e5 req-dcbefe43-9bde-464a-9408-1c5169e7616f service nova] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Received event network-vif-deleted-0eae0f1e-d6c2-48bd-ad15-dba679a91a9f {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:01:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:01:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:01:50 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:01:50 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:01:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:01:50 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Deleted allocations for instance a836678e-240d-4ead-b0b5-64d146910a23
Aug 27 07:01:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0d9fa046-488c-404c-b450-2c6073170f4e tempest-ServerBootFromVolumeStableRescueTest-1306655557 tempest-ServerBootFromVolumeStableRescueTest-1306655557-project-member] Lock "a836678e-240d-4ead-b0b5-64d146910a23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.816s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:01:51 user nova-compute[73258]: DEBUG nova.compute.manager [req-c9959567-0a57-4c3d-a887-cfc0832b4f58 req-d888c527-d7b8-4283-8c0f-8f2a0246ae27 service nova] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Received event network-vif-plugged-0eae0f1e-d6c2-48bd-ad15-dba679a91a9f {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:01:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c9959567-0a57-4c3d-a887-cfc0832b4f58 req-d888c527-d7b8-4283-8c0f-8f2a0246ae27 service nova] Acquiring lock "a836678e-240d-4ead-b0b5-64d146910a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:01:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c9959567-0a57-4c3d-a887-cfc0832b4f58 req-d888c527-d7b8-4283-8c0f-8f2a0246ae27 service nova] Lock "a836678e-240d-4ead-b0b5-64d146910a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:01:51 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c9959567-0a57-4c3d-a887-cfc0832b4f58 req-d888c527-d7b8-4283-8c0f-8f2a0246ae27 service nova] Lock "a836678e-240d-4ead-b0b5-64d146910a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:01:51 user nova-compute[73258]: DEBUG nova.compute.manager [req-c9959567-0a57-4c3d-a887-cfc0832b4f58 req-d888c527-d7b8-4283-8c0f-8f2a0246ae27 service nova] [instance: a836678e-240d-4ead-b0b5-64d146910a23] No waiting events found dispatching network-vif-plugged-0eae0f1e-d6c2-48bd-ad15-dba679a91a9f {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:01:51 user nova-compute[73258]: WARNING nova.compute.manager [req-c9959567-0a57-4c3d-a887-cfc0832b4f58 req-d888c527-d7b8-4283-8c0f-8f2a0246ae27 service nova] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Received unexpected event network-vif-plugged-0eae0f1e-d6c2-48bd-ad15-dba679a91a9f for instance with vm_state deleted and task_state None.
Aug 27 07:01:52 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:01:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:01:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:01:52 user nova-compute[73258]: DEBUG nova.objects.instance [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lazy-loading 'flavor' on Instance uuid 54697fcb-9ffe-4660-b7d2-7b89dfd72439 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:01:53 user nova-compute[73258]: INFO nova.compute.manager [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Attaching volume 7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 to /dev/vdb
Aug 27 07:01:53 user nova-compute[73258]: DEBUG os_brick.utils [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe2f975-c167-4828-9e93-088ad54766da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c93ec7-61bb-470a-bb3b-03fc3f028c93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6467b9-0796-45fd-9406-1eb9fe91d32a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdff209d-7d46-4f9a-ae3a-6d507d444bd9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:01:53 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 07:01:53 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[229b72fd-49c6-4c07-9f15-7765d9fe8733]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG os_brick.utils [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:01:53 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Updating existing volume attachment record: 59a4be47-31e2-400f-9edc-c4cbd2eea70a {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 07:01:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:01:54 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:01:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:01:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:01:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:01:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-54697fcb-9ffe-4660-b7d2-7b89dfd72439" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:01:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-54697fcb-9ffe-4660-b7d2-7b89dfd72439" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:01:57 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 07:01:57 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Updating instance_info_cache with network_info: [{"id": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "address": "fa:16:3e:0a:85:cd", "network": {"id": "8868be84-8d19-484f-9732-0a212f789a1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1368955490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5caed6c4efcf4ebab7c5dc47d0d7736c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe41900c-5a", "ovs_interfaceid": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:01:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-54697fcb-9ffe-4660-b7d2-7b89dfd72439" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:01:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 07:01:57 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:01:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:01:57 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:01:57 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:01:57 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:01:58 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:01:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:02 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:02:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:02:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:02:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:02:02 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:02:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119709.7052996, a836678e-240d-4ead-b0b5-64d146910a23 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:02:04 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: a836678e-240d-4ead-b0b5-64d146910a23] VM Stopped (Lifecycle Event)
Aug 27 07:02:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuJDExIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:02:04 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:02:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:02:04 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:02:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:02:04 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:04 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:02:04 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:02:04 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8272MB free_disk=23.905807495117188GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-5157e751-ef16-4d1a-91ab-e77d509474a6 None None] [instance: a836678e-240d-4ead-b0b5-64d146910a23] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d5d626-b5f9-47c3-a05d-ade1cc07ee26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 07:02:04 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[538e2fd5-ae82-4c6c-a5ff-2655e4e9950f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35] added
Aug 27 07:02:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a610cbb2-11ef-4ad2-99a5-9586b553c3b8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[00763673-1c50-412a-82fe-78212e2c1e0e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance d2edd67c-c877-4c45-ae13-ee5f82853066 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance c7726af8-f937-49ae-ba07-54ed57e18a50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuJDExIF {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuJDExIF" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ca4618-e578-49f9-8174-9830c347be48]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HuJDExIF'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73e20bb-4275-440a-bf50-a212dcf64b43]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46f9eb4-92be-4e65-8d03-598fa263c2bc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 07:02:04 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 07:02:04 user nova-compute[73258]:  {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:02:04 user nova-compute[73258]: WARNING os_brick.initiator.connectors.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 07:02:04 user nova-compute[73258]: 
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a56453-b1f0-41c5-ac49-b50683ce46f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35, portal: 172.16.0.220,3260]
Aug 27 07:02:04 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35, portal: 172.16.0.220,3260] successful.
Aug 27 07:02:04 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c1e9d2-22ee-40b9-9b73-2906a329a42d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:05 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6d5135-ea72-4730-b731-ce1f799db335]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 (non-flash)
Aug 27 07:02:05 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:02:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 (non-flash)
Aug 27 07:02:05 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:02:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:02:05 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 07:02:05 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 07:02:05 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 07:02:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:05 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[918a0e37-f45d-4a54-accc-f00c83fe7d74]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:05 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 07:02:06 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 07:02:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuJDExIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 07:02:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:02:06 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23036633731636363', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:02:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036633731636363', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 07:02:06 user nova-compute[73258]: DEBUG nova.objects.instance [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lazy-loading 'flavor' on Instance uuid 54697fcb-9ffe-4660-b7d2-7b89dfd72439 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:02:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 07:02:06 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:02:06 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 07:02:06 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 07:02:06 user nova-compute[73258]:   <serial>7f57bfb8-0c2b-437f-ad52-363b5c4d9b35</serial>
Aug 27 07:02:06 user nova-compute[73258]: </disk>
Aug 27 07:02:06 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 07:02:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:02:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:02:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] No VIF found with MAC fa:16:3e:0a:85:cd, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 07:02:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-4175cae6-cb41-48c5-9bb9-105e507824c0 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.724s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:02:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:02:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:02:08 user nova-compute[73258]: INFO nova.compute.manager [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Detaching volume 7f57bfb8-0c2b-437f-ad52-363b5c4d9b35
Aug 27 07:02:09 user nova-compute[73258]: INFO nova.virt.block_device [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Attempting to driver detach volume 7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 from mountpoint /dev/vdb
Aug 27 07:02:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Attempting to detach device vdb from instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 07:02:09 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:02:09 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 07:02:09 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 07:02:09 user nova-compute[73258]:   <serial>7f57bfb8-0c2b-437f-ad52-363b5c4d9b35</serial>
Aug 27 07:02:09 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 07:02:09 user nova-compute[73258]: </disk>
Aug 27 07:02:09 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 07:02:09 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Successfully detached device vdb from instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 from the persistent domain config.
Aug 27 07:02:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 07:02:09 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:02:09 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 07:02:09 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 07:02:09 user nova-compute[73258]:   <serial>7f57bfb8-0c2b-437f-ad52-363b5c4d9b35</serial>
Aug 27 07:02:09 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 07:02:09 user nova-compute[73258]: </disk>
Aug 27 07:02:09 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693119729.5487971, 54697fcb-9ffe-4660-b7d2-7b89dfd72439 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 07:02:09 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Successfully detached device vdb from instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 from the live domain config.
Aug 27 07:02:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuJDExIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:02:09 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:02:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bc40ae-002e-4817-b0f6-0dd6de166724]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e32756d-7b44-4948-8b0d-8d435f211f23]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 (non-flash)
Aug 27 07:02:09 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 (non-flash)
Aug 27 07:02:09 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4107b5b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fdaa06-d73b-4ecf-831a-67c87752137e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f917e83-bad9-4e0b-b952-a637f94f31a2]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b521a3-e62c-4019-9eb4-5f353fd7eb98]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a9b4e7-833d-48d3-9533-597e78842b66]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[089009ef-17d2-46e4-ae19-2088d2e7b714]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0e8403-3d1d-4cfd-9871-a48cb93f3e7f]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35, portal: 172.16.0.220,3260]
Aug 27 07:02:09 user nova-compute[73258]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35, portal: 172.16.0.220,3260] successful.
Aug 27 07:02:09 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f57bfb8-0c2b-437f-ad52-363b5c4d9b35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf35030-4d82-4913-b474-2560028b10b8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] <== disconnect_volume: return (273ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 07:02:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-0bc8f8ce-2747-4d14-91ba-deffdc709f85 req-7bd5e9dc-4a08-42a0-9a78-37599ae4aa16 service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Received event network-changed-1b84a563-103e-441c-85d5-41c39008196a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:02:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-0bc8f8ce-2747-4d14-91ba-deffdc709f85 req-7bd5e9dc-4a08-42a0-9a78-37599ae4aa16 service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Refreshing instance network info cache due to event network-changed-1b84a563-103e-441c-85d5-41c39008196a. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:02:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0bc8f8ce-2747-4d14-91ba-deffdc709f85 req-7bd5e9dc-4a08-42a0-9a78-37599ae4aa16 service nova] Acquiring lock "refresh_cache-c7726af8-f937-49ae-ba07-54ed57e18a50" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:02:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0bc8f8ce-2747-4d14-91ba-deffdc709f85 req-7bd5e9dc-4a08-42a0-9a78-37599ae4aa16 service nova] Acquired lock "refresh_cache-c7726af8-f937-49ae-ba07-54ed57e18a50" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:02:10 user nova-compute[73258]: DEBUG nova.network.neutron [req-0bc8f8ce-2747-4d14-91ba-deffdc709f85 req-7bd5e9dc-4a08-42a0-9a78-37599ae4aa16 service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Refreshing network info cache for port 1b84a563-103e-441c-85d5-41c39008196a {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:02:10 user nova-compute[73258]: DEBUG nova.network.neutron [req-0bc8f8ce-2747-4d14-91ba-deffdc709f85 req-7bd5e9dc-4a08-42a0-9a78-37599ae4aa16 service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Updated VIF entry in instance network info cache for port 1b84a563-103e-441c-85d5-41c39008196a. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:02:10 user nova-compute[73258]: DEBUG nova.network.neutron [req-0bc8f8ce-2747-4d14-91ba-deffdc709f85 req-7bd5e9dc-4a08-42a0-9a78-37599ae4aa16 service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Updating instance_info_cache with network_info: [{"id": "1b84a563-103e-441c-85d5-41c39008196a", "address": "fa:16:3e:6d:71:a7", "network": {"id": "371866e1-b4cf-47fe-8d41-2c9e59f468ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1786605233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4444c10053404b2684e82b5986b8a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b84a563-10", "ovs_interfaceid": "1b84a563-103e-441c-85d5-41c39008196a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:02:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-0bc8f8ce-2747-4d14-91ba-deffdc709f85 req-7bd5e9dc-4a08-42a0-9a78-37599ae4aa16 service nova] Releasing lock "refresh_cache-c7726af8-f937-49ae-ba07-54ed57e18a50" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:02:10 user nova-compute[73258]: DEBUG nova.objects.instance [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lazy-loading 'flavor' on Instance uuid 54697fcb-9ffe-4660-b7d2-7b89dfd72439 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:02:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-732a4a26-08f0-4113-a301-34441f7b0245 tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.934s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "c7726af8-f937-49ae-ba07-54ed57e18a50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG nova.objects.instance [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lazy-loading 'flavor' on Instance uuid c7726af8-f937-49ae-ba07-54ed57e18a50 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "c7726af8-f937-49ae-ba07-54ed57e18a50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:02:11 user nova-compute[73258]: INFO nova.compute.manager [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Attaching volume be67bf9a-29ed-4ee6-be1f-7263d82bf364 to /dev/vdb
Aug 27 07:02:11 user nova-compute[73258]: DEBUG os_brick.utils [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2259ecb-7937-4270-b8e7-b91b686ed85f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.052s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f731042e-c01d-42d4-a36e-53bb832abd49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dc0bc1-60cb-4c98-a2b9-67006db8e75e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8065c2c-b2a9-41e2-a146-359a528132d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:02:11 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 07:02:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c76a1e-644d-4f02-9a8a-74b743659c00]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG os_brick.utils [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:02:11 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Updating existing volume attachment record: 7105d528-1b86-409a-b26b-893e2465bc01 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 07:02:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "d2edd67c-c877-4c45-ae13-ee5f82853066" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:02:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:02:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:02:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:02:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:02:22 user nova-compute[73258]: INFO nova.compute.manager [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Terminating instance
Aug 27 07:02:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 07:02:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:22 user nova-compute[73258]: DEBUG nova.compute.manager [req-d125a527-6a4d-42af-906f-dd62d3d33eb7 req-bf8b94df-e903-41b3-a0fe-520200aa1f3b service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received event network-vif-unplugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:02:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d125a527-6a4d-42af-906f-dd62d3d33eb7 req-bf8b94df-e903-41b3-a0fe-520200aa1f3b service nova] Acquiring lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:02:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d125a527-6a4d-42af-906f-dd62d3d33eb7 req-bf8b94df-e903-41b3-a0fe-520200aa1f3b service nova] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:02:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d125a527-6a4d-42af-906f-dd62d3d33eb7 req-bf8b94df-e903-41b3-a0fe-520200aa1f3b service nova] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:02:22 user nova-compute[73258]: DEBUG nova.compute.manager [req-d125a527-6a4d-42af-906f-dd62d3d33eb7 req-bf8b94df-e903-41b3-a0fe-520200aa1f3b service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] No waiting events found dispatching network-vif-unplugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:02:22 user nova-compute[73258]: DEBUG nova.compute.manager [req-d125a527-6a4d-42af-906f-dd62d3d33eb7 req-bf8b94df-e903-41b3-a0fe-520200aa1f3b service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received event network-vif-unplugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 07:02:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:22 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Instance destroyed successfully.
Aug 27 07:02:22 user nova-compute[73258]: DEBUG nova.objects.instance [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lazy-loading 'resources' on Instance uuid d2edd67c-c877-4c45-ae13-ee5f82853066 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:56:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-230825290',display_name='tempest-TestMinimumBasicScenario-server-230825290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-230825290',id=41,image_ref='219587c8-b0ee-47ab-aa54-8b2d42fe9b89',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuoVS0M13jEH/jCiVKamjqoQl7T8gy6Y61js/cVhfSR87vdnvOrLJ2jnn3eqtAAM6GxfvMPwc5M3rsN5ROIABUb6JurY5u9Lbvzo4Cmo0ps1r74VIpsNxuNj3rC3V5Nvw==',key_name='tempest-TestMinimumBasicScenario-1377282219',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:56:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b34f6a09d79c43c282e56cfda50001d7',ramdisk_id='',reservation_id='r-zqr6he04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='219587c8-b0ee-47ab-aa54-8b2d42fe9b89',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1509066975',owner_user_name='tempest-TestMinimumBasicScenario-1509066975-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:59:37Z,user_data=None,user_id='8de65612a05142ebb509012c126b89b0',uuid=d2edd67c-c877-4c45-ae13-ee5f82853066,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Converting VIF {"id": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "address": "fa:16:3e:96:f3:ab", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e55f50f-33", "ovs_interfaceid": "9e55f50f-3335-4d20-b9ca-5e497b226d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:f3:ab,bridge_name='br-int',has_traffic_filtering=True,id=9e55f50f-3335-4d20-b9ca-5e497b226d95,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e55f50f-33') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_vif [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:f3:ab,bridge_name='br-int',has_traffic_filtering=True,id=9e55f50f-3335-4d20-b9ca-5e497b226d95,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e55f50f-33') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e55f50f-33, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:02:23 user nova-compute[73258]: INFO os_vif [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:f3:ab,bridge_name='br-int',has_traffic_filtering=True,id=9e55f50f-3335-4d20-b9ca-5e497b226d95,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e55f50f-33')
Aug 27 07:02:23 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Deleting instance files /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066_del
Aug 27 07:02:23 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Deletion of /opt/stack/data/nova/instances/d2edd67c-c877-4c45-ae13-ee5f82853066_del complete
Aug 27 07:02:23 user nova-compute[73258]: INFO nova.compute.manager [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJMVueEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:02:23 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:02:23 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:02:23 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:23 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Took 0.54 seconds to deallocate network for instance.
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae025325-8af1-48a2-99a6-4ee82d947ff4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 07:02:23 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG nova.compute.manager [req-2177230a-9a57-4002-b5e9-d81227fcde17 req-f545b708-39e4-4706-b2fc-a1c16b7d8140 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received event network-vif-deleted-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5320f98-7e1c-4eca-8981-99e661e40742]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364] added
Aug 27 07:02:23 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ca3bb2-24a7-43f5-abad-6e6c865b5611]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[671d363b-e4f7-4616-a8cb-3e61800b004d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJMVueEL {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJMVueEL" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3026d1c-a0bc-41b6-8582-d2d36f992137]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZJMVueEL'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d590821-75c0-4acd-93f0-1715a9c27a80]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[850975b0-0d0e-4265-9a54-fba6c28dab15]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 07:02:23 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 07:02:23 user nova-compute[73258]:  {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:02:23 user nova-compute[73258]: WARNING os_brick.initiator.connectors.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 07:02:23 user nova-compute[73258]: 
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ae328d-e90d-40b9-b384-d0d66e88f4d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364, portal: 172.16.0.220,3260]
Aug 27 07:02:23 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364, portal: 172.16.0.220,3260] successful.
Aug 27 07:02:23 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f71f5c9-c3ed-471c-9d0e-c313d772c602]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dadb309-dcab-4341-9235-02755d5958e9]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 (non-flash)
Aug 27 07:02:23 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 (non-flash)
Aug 27 07:02:23 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda43da2-86a7-4660-9ad2-1664ef390902]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 07:02:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJMVueEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 07:02:24 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Deleted allocations for instance d2edd67c-c877-4c45-ae13-ee5f82853066
Aug 27 07:02:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-3aa511ff-3a13-43d2-a87a-072664846eb5 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.973s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:02:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-d29f2a93-f014-4cbc-bb88-8b9da9faa9a8 req-13667b0f-30c7-4df6-a05f-5f256ac9b9c7 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received event network-vif-plugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:02:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d29f2a93-f014-4cbc-bb88-8b9da9faa9a8 req-13667b0f-30c7-4df6-a05f-5f256ac9b9c7 service nova] Acquiring lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:02:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d29f2a93-f014-4cbc-bb88-8b9da9faa9a8 req-13667b0f-30c7-4df6-a05f-5f256ac9b9c7 service nova] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:02:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d29f2a93-f014-4cbc-bb88-8b9da9faa9a8 req-13667b0f-30c7-4df6-a05f-5f256ac9b9c7 service nova] Lock "d2edd67c-c877-4c45-ae13-ee5f82853066-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:02:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-d29f2a93-f014-4cbc-bb88-8b9da9faa9a8 req-13667b0f-30c7-4df6-a05f-5f256ac9b9c7 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] No waiting events found dispatching network-vif-plugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:02:24 user nova-compute[73258]: WARNING nova.compute.manager [req-d29f2a93-f014-4cbc-bb88-8b9da9faa9a8 req-13667b0f-30c7-4df6-a05f-5f256ac9b9c7 service nova] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Received unexpected event network-vif-plugged-9e55f50f-3335-4d20-b9ca-5e497b226d95 for instance with vm_state deleted and task_state None.
Aug 27 07:02:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:02:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23434323463306633', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:02:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434323463306633', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 07:02:25 user nova-compute[73258]: DEBUG nova.objects.instance [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lazy-loading 'flavor' on Instance uuid c7726af8-f937-49ae-ba07-54ed57e18a50 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:02:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 07:02:25 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:02:25 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 07:02:25 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 07:02:25 user nova-compute[73258]:   <serial>be67bf9a-29ed-4ee6-be1f-7263d82bf364</serial>
Aug 27 07:02:25 user nova-compute[73258]: </disk>
Aug 27 07:02:25 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 07:02:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:02:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:02:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] No VIF found with MAC fa:16:3e:6d:71:a7, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 07:02:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-05fa6bcb-c659-4027-bebd-3391acf5f78e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.331s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:02:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "c7726af8-f937-49ae-ba07-54ed57e18a50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:02:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:02:29 user nova-compute[73258]: DEBUG nova.objects.instance [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lazy-loading 'flavor' on Instance uuid c7726af8-f937-49ae-ba07-54ed57e18a50 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:02:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:02:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "c7726af8-f937-49ae-ba07-54ed57e18a50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:02:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:02:29 user nova-compute[73258]: INFO nova.compute.manager [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Attaching volume 1610eed1-858e-4e27-9327-41d5360030ae to /dev/vdc
Aug 27 07:02:30 user nova-compute[73258]: DEBUG os_brick.utils [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4315897e-e679-485c-8d95-fc8475286e6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bfa3df-e037-4d68-9d9f-d2cc68a78308]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe7001f-21d0-4b33-a167-a3fd4f8979de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9a61ef-8d8e-4101-baa2-6c0734b90ec4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:02:30 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 07:02:30 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[393f3413-e392-4d46-afe2-dd86c231e111]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG os_brick.utils [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:02:30 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Updating existing volume attachment record: a407d624-0e72-4576-8297-a558ea28fcdf {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 07:02:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:02:37 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119742.9893353, d2edd67c-c877-4c45-ae13-ee5f82853066 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:02:37 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] VM Stopped (Lifecycle Event)
Aug 27 07:02:38 user nova-compute[73258]: DEBUG nova.compute.manager [None req-406759b7-5833-4c2f-be28-74a078e9c14d None None] [instance: d2edd67c-c877-4c45-ae13-ee5f82853066] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:02:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:02:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:02:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:02:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:02:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 07:02:41 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEHjqolw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:02:42 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:02:42 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:02:42 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad23d76-3d05-4f72-a69a-449585fb3d12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 07:02:42 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9d69e4-893e-48e0-8e27-fc2b201de10d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae] added
Aug 27 07:02:42 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[400114fb-1cf6-4d20-a9ad-802d136eb631]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bebc0b-d8a6-4ec8-8d85-f39904fa2b4f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TEHjqolw {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TEHjqolw" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[13829c57-9f51-4e69-a9b8-ccd8d15f8917]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TEHjqolw'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c66a92-8638-4f41-8735-23bfa575e54b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[846dd10c-43bb-4b10-9b01-488d9066fc27]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 (non-flash)
Aug 27 07:02:42 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 (non-flash)
Aug 27 07:02:42 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ede9df-14c1-4b87-9795-1cb86c8803fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae, portal: 172.16.0.220,3260]
Aug 27 07:02:42 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae, portal: 172.16.0.220,3260] successful.
Aug 27 07:02:42 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d85a3d7-8013-48e8-b655-0a431234626b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9fbcb3-948d-471b-8daa-bc00cfb58559]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 (non-flash)
Aug 27 07:02:42 user nova-compute[73258]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae (non-flash)
Aug 27 07:02:42 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 (non-flash)
Aug 27 07:02:42 user nova-compute[73258]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae (non-flash)
Aug 27 07:02:42 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2de0335-265c-42f4-a5bd-24ab58a86c77]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEHjqolw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 07:02:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:02:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23239363034373666', 'path': '/dev/sdc'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:02:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239363034373666', 'path': '/dev/sdc'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 07:02:43 user nova-compute[73258]: DEBUG nova.objects.instance [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lazy-loading 'flavor' on Instance uuid c7726af8-f937-49ae-ba07-54ed57e18a50 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:02:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 07:02:43 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:02:43 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 07:02:43 user nova-compute[73258]:   <target dev="vdc" bus="virtio"/>
Aug 27 07:02:43 user nova-compute[73258]:   <serial>1610eed1-858e-4e27-9327-41d5360030ae</serial>
Aug 27 07:02:43 user nova-compute[73258]: </disk>
Aug 27 07:02:43 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 07:02:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:02:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:02:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:02:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] No VIF found with MAC fa:16:3e:6d:71:a7, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 07:02:43 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-796684fe-e440-47a6-a963-7c10926b992e tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.981s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:02:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "c7726af8-f937-49ae-ba07-54ed57e18a50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:02:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:02:45 user nova-compute[73258]: INFO nova.compute.manager [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Detaching volume 1610eed1-858e-4e27-9327-41d5360030ae
Aug 27 07:02:45 user nova-compute[73258]: INFO nova.virt.block_device [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Attempting to driver detach volume 1610eed1-858e-4e27-9327-41d5360030ae from mountpoint /dev/vdc
Aug 27 07:02:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Attempting to detach device vdc from instance c7726af8-f937-49ae-ba07-54ed57e18a50 from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 07:02:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 07:02:45 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:02:45 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 07:02:45 user nova-compute[73258]:   <target dev="vdc" bus="virtio"/>
Aug 27 07:02:45 user nova-compute[73258]:   <serial>1610eed1-858e-4e27-9327-41d5360030ae</serial>
Aug 27 07:02:45 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 07:02:45 user nova-compute[73258]: </disk>
Aug 27 07:02:45 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 07:02:45 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Successfully detached device vdc from instance c7726af8-f937-49ae-ba07-54ed57e18a50 from the persistent domain config.
Aug 27 07:02:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c7726af8-f937-49ae-ba07-54ed57e18a50 from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 07:02:45 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 07:02:45 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:02:45 user nova-compute[73258]:   <source dev="/dev/sdc"/>
Aug 27 07:02:45 user nova-compute[73258]:   <target dev="vdc" bus="virtio"/>
Aug 27 07:02:45 user nova-compute[73258]:   <serial>1610eed1-858e-4e27-9327-41d5360030ae</serial>
Aug 27 07:02:45 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 07:02:45 user nova-compute[73258]: </disk>
Aug 27 07:02:45 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693119766.1199348, c7726af8-f937-49ae-ba07-54ed57e18a50 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c7726af8-f937-49ae-ba07-54ed57e18a50 {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 07:02:46 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Successfully detached device vdc from instance c7726af8-f937-49ae-ba07-54ed57e18a50 from the live domain config.
Aug 27 07:02:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEHjqolw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:02:46 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:02:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5d7207-1bfe-4884-95f0-521a5cd008be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ea5ee3-b612-44cf-bf44-d65ee2cfef6a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 (non-flash)
Aug 27 07:02:46 user nova-compute[73258]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae (non-flash)
Aug 27 07:02:46 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 (non-flash)
Aug 27 07:02:46 user nova-compute[73258]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae (non-flash)
Aug 27 07:02:46 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4107b5cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae'): ({'sdc'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Removing single pathed devices sdc {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c1358a-fb23-4502-b095-0ef341f41e3d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c148b536-bded-4b16-ab72-3b5d6df1b350]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Flushing IO for device /dev/sdc {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ed17ea-bc05-4de9-ab08-d326274148f5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8ea47d-c36a-495d-9dea-5bbd95e8ae3e]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0656a9ce-2b10-490f-93ea-2634c241f4a9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[575d874f-4411-405c-9a07-120f41c6ac4d]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae, portal: 172.16.0.220,3260]
Aug 27 07:02:46 user nova-compute[73258]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae, portal: 172.16.0.220,3260] successful.
Aug 27 07:02:46 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1610eed1-858e-4e27-9327-41d5360030ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[35460ea1-7a25-4bda-9ff3-9cb3f7968040]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] <== disconnect_volume: return (315ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:02:46 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 07:02:47 user nova-compute[73258]: DEBUG nova.objects.instance [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lazy-loading 'flavor' on Instance uuid c7726af8-f937-49ae-ba07-54ed57e18a50 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:02:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-507065c1-b1e1-492c-a209-fa5bed6d0773 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.910s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:02:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:02:55 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:02:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:02:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:02:56 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:02:57 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:02:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:02:58 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:02:58 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:02:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-c7726af8-f937-49ae-ba07-54ed57e18a50" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:02:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-c7726af8-f937-49ae-ba07-54ed57e18a50" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:02:59 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 07:02:59 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Updating instance_info_cache with network_info: [{"id": "1b84a563-103e-441c-85d5-41c39008196a", "address": "fa:16:3e:6d:71:a7", "network": {"id": "371866e1-b4cf-47fe-8d41-2c9e59f468ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1786605233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4444c10053404b2684e82b5986b8a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b84a563-10", "ovs_interfaceid": "1b84a563-103e-441c-85d5-41c39008196a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:02:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-c7726af8-f937-49ae-ba07-54ed57e18a50" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:02:59 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 07:02:59 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:02:59 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:03:00 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:03:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Acquiring lock "2f29054c-6b51-443d-89da-a69fbe658b49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Lock "2f29054c-6b51-443d-89da-a69fbe658b49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:02 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:03:02 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 07:03:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:02 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 07:03:03 user nova-compute[73258]: INFO nova.compute.claims [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Claim successful on node user
Aug 27 07:03:03 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Refreshing inventories for resource provider 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Updating ProviderTree inventory for provider 13f05024-5078-4590-94a5-110d29d864c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Updating inventory in ProviderTree for provider 13f05024-5078-4590-94a5-110d29d864c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Refreshing aggregate associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, aggregates: None {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Refreshing trait associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 07:03:03 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 07:03:03 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 07:03:04 user nova-compute[73258]: DEBUG nova.policy [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae9abe39b9de469ba7c64532e8955eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f3f0a6b5da4b789e9e7159326a1c8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 07:03:04 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:03:04 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:03:04 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8411MB free_disk=23.920616149902344GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance c7726af8-f937-49ae-ba07-54ed57e18a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 2f29054c-6b51-443d-89da-a69fbe658b49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 07:03:04 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Creating image(s)
Aug 27 07:03:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f29054c-6b51-443d-89da-a69fbe658b49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Lock "/opt/stack/data/nova/instances/2f29054c-6b51-443d-89da-a69fbe658b49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Lock "/opt/stack/data/nova/instances/2f29054c-6b51-443d-89da-a69fbe658b49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.222s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.201s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/2f29054c-6b51-443d-89da-a69fbe658b49/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/2f29054c-6b51-443d-89da-a69fbe658b49/disk 1073741824" returned: 0 in 0.056s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:04 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:03:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.267s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:05 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f29054c-6b51-443d-89da-a69fbe658b49/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 07:03:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f29054c-6b51-443d-89da-a69fbe658b49/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:05 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Successfully created port: 157709f5-9c66-44b4-88b7-2e38aebe35d5 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 07:03:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f29054c-6b51-443d-89da-a69fbe658b49/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:05 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Cannot resize image /opt/stack/data/nova/instances/2f29054c-6b51-443d-89da-a69fbe658b49/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 07:03:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 07:03:05 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Ensure instance console log exists: /opt/stack/data/nova/instances/2f29054c-6b51-443d-89da-a69fbe658b49/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 07:03:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Successfully updated port: 157709f5-9c66-44b4-88b7-2e38aebe35d5 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Acquiring lock "refresh_cache-2f29054c-6b51-443d-89da-a69fbe658b49" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Acquired lock "refresh_cache-2f29054c-6b51-443d-89da-a69fbe658b49" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.compute.manager [req-b4a4004d-46d3-44d2-9370-f0ccafef33cb req-a1862c32-f3b9-4d74-ba4c-9980f929819f service nova] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Received event network-changed-157709f5-9c66-44b4-88b7-2e38aebe35d5 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.compute.manager [req-b4a4004d-46d3-44d2-9370-f0ccafef33cb req-a1862c32-f3b9-4d74-ba4c-9980f929819f service nova] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Refreshing instance network info cache due to event network-changed-157709f5-9c66-44b4-88b7-2e38aebe35d5. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b4a4004d-46d3-44d2-9370-f0ccafef33cb req-a1862c32-f3b9-4d74-ba4c-9980f929819f service nova] Acquiring lock "refresh_cache-2f29054c-6b51-443d-89da-a69fbe658b49" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.network.neutron [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Updating instance_info_cache with network_info: [{"id": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "address": "fa:16:3e:70:87:b1", "network": {"id": "1f8d78c3-b8b2-4e0c-bbdd-f25ce36ff083", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a0fe6064085e4553aeec775fb8e6faeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157709f5-9c", "ovs_interfaceid": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Releasing lock "refresh_cache-2f29054c-6b51-443d-89da-a69fbe658b49" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Instance network_info: |[{"id": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "address": "fa:16:3e:70:87:b1", "network": {"id": "1f8d78c3-b8b2-4e0c-bbdd-f25ce36ff083", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a0fe6064085e4553aeec775fb8e6faeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157709f5-9c", "ovs_interfaceid": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b4a4004d-46d3-44d2-9370-f0ccafef33cb req-a1862c32-f3b9-4d74-ba4c-9980f929819f service nova] Acquired lock "refresh_cache-2f29054c-6b51-443d-89da-a69fbe658b49" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.network.neutron [req-b4a4004d-46d3-44d2-9370-f0ccafef33cb req-a1862c32-f3b9-4d74-ba4c-9980f929819f service nova] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Refreshing network info cache for port 157709f5-9c66-44b4-88b7-2e38aebe35d5 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Start _get_guest_xml network_info=[{"id": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "address": "fa:16:3e:70:87:b1", "network": {"id": "1f8d78c3-b8b2-4e0c-bbdd-f25ce36ff083", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a0fe6064085e4553aeec775fb8e6faeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157709f5-9c", "ovs_interfaceid": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 07:03:06 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:03:06 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:03:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1541183622',display_name='tempest-VolumesNegativeTest-instance-1541183622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1541183622',id=44,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70f3f0a6b5da4b789e9e7159326a1c8b',ramdisk_id='',reservation_id='r-v7jwwngn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1157579996',owner_user_name='tempest-VolumesNegativeTest-1157579996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:03:04Z,user_data=None,user_id='ae9abe39b9de469ba7c64532e8955eba',uuid=2f29054c-6b51-443d-89da-a69fbe658b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "address": "fa:16:3e:70:87:b1", "network": {"id": "1f8d78c3-b8b2-4e0c-bbdd-f25ce36ff083", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a0fe6064085e4553aeec775fb8e6faeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157709f5-9c", "ovs_interfaceid": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Converting VIF {"id": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "address": "fa:16:3e:70:87:b1", "network": {"id": "1f8d78c3-b8b2-4e0c-bbdd-f25ce36ff083", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a0fe6064085e4553aeec775fb8e6faeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157709f5-9c", "ovs_interfaceid": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:87:b1,bridge_name='br-int',has_traffic_filtering=True,id=157709f5-9c66-44b4-88b7-2e38aebe35d5,network=Network(1f8d78c3-b8b2-4e0c-bbdd-f25ce36ff083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap157709f5-9c') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.objects.instance [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f29054c-6b51-443d-89da-a69fbe658b49 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] End _get_guest_xml xml=<domain type="kvm">
Aug 27 07:03:06 user nova-compute[73258]:   <uuid>2f29054c-6b51-443d-89da-a69fbe658b49</uuid>
Aug 27 07:03:06 user nova-compute[73258]:   <name>instance-0000002c</name>
Aug 27 07:03:06 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 07:03:06 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 07:03:06 user nova-compute[73258]:   <metadata>
Aug 27 07:03:06 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 07:03:06 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 07:03:06 user nova-compute[73258]:       <nova:name>tempest-VolumesNegativeTest-instance-1541183622</nova:name>
Aug 27 07:03:06 user nova-compute[73258]:       <nova:creationTime>2023-08-27 07:03:06</nova:creationTime>
Aug 27 07:03:06 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 07:03:06 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 07:03:06 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 07:03:06 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 07:03:06 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 07:03:06 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 07:03:06 user nova-compute[73258]:       </nova:flavor>
Aug 27 07:03:06 user nova-compute[73258]:       <nova:owner>
Aug 27 07:03:06 user nova-compute[73258]:         <nova:user uuid="ae9abe39b9de469ba7c64532e8955eba">tempest-VolumesNegativeTest-1157579996-project-member</nova:user>
Aug 27 07:03:06 user nova-compute[73258]:         <nova:project uuid="70f3f0a6b5da4b789e9e7159326a1c8b">tempest-VolumesNegativeTest-1157579996</nova:project>
Aug 27 07:03:06 user nova-compute[73258]:       </nova:owner>
Aug 27 07:03:06 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 07:03:06 user nova-compute[73258]:       <nova:ports>
Aug 27 07:03:06 user nova-compute[73258]:         <nova:port uuid="157709f5-9c66-44b4-88b7-2e38aebe35d5">
Aug 27 07:03:06 user nova-compute[73258]:           <nova:ip type="fixed" address="192.168.233.23" ipVersion="4"/>
Aug 27 07:03:06 user nova-compute[73258]:         </nova:port>
Aug 27 07:03:06 user nova-compute[73258]:       </nova:ports>
Aug 27 07:03:06 user nova-compute[73258]:     </nova:instance>
Aug 27 07:03:06 user nova-compute[73258]:   </metadata>
Aug 27 07:03:06 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 07:03:06 user nova-compute[73258]:     <system>
Aug 27 07:03:06 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 07:03:06 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 07:03:06 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 07:03:06 user nova-compute[73258]:       <entry name="serial">2f29054c-6b51-443d-89da-a69fbe658b49</entry>
Aug 27 07:03:06 user nova-compute[73258]:       <entry name="uuid">2f29054c-6b51-443d-89da-a69fbe658b49</entry>
Aug 27 07:03:06 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 07:03:06 user nova-compute[73258]:     </system>
Aug 27 07:03:06 user nova-compute[73258]:   </sysinfo>
Aug 27 07:03:06 user nova-compute[73258]:   <os>
Aug 27 07:03:06 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 07:03:06 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 07:03:06 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 07:03:06 user nova-compute[73258]:   </os>
Aug 27 07:03:06 user nova-compute[73258]:   <features>
Aug 27 07:03:06 user nova-compute[73258]:     <acpi/>
Aug 27 07:03:06 user nova-compute[73258]:     <apic/>
Aug 27 07:03:06 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 07:03:06 user nova-compute[73258]:   </features>
Aug 27 07:03:06 user nova-compute[73258]:   <clock offset="utc">
Aug 27 07:03:06 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 07:03:06 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 07:03:06 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 07:03:06 user nova-compute[73258]:   </clock>
Aug 27 07:03:06 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 07:03:06 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 07:03:06 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 07:03:06 user nova-compute[73258]:   </cpu>
Aug 27 07:03:06 user nova-compute[73258]:   <devices>
Aug 27 07:03:06 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 07:03:06 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 07:03:06 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/2f29054c-6b51-443d-89da-a69fbe658b49/disk"/>
Aug 27 07:03:06 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 07:03:06 user nova-compute[73258]:     </disk>
Aug 27 07:03:06 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 07:03:06 user nova-compute[73258]:       <mac address="fa:16:3e:70:87:b1"/>
Aug 27 07:03:06 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:03:06 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 07:03:06 user nova-compute[73258]:       <target dev="tap157709f5-9c"/>
Aug 27 07:03:06 user nova-compute[73258]:     </interface>
Aug 27 07:03:06 user nova-compute[73258]:     <serial type="pty">
Aug 27 07:03:06 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/2f29054c-6b51-443d-89da-a69fbe658b49/console.log" append="off"/>
Aug 27 07:03:06 user nova-compute[73258]:     </serial>
Aug 27 07:03:06 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 07:03:06 user nova-compute[73258]:     <video>
Aug 27 07:03:06 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:03:06 user nova-compute[73258]:     </video>
Aug 27 07:03:06 user nova-compute[73258]:     <rng model="virtio">
Aug 27 07:03:06 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 07:03:06 user nova-compute[73258]:     </rng>
Aug 27 07:03:06 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 07:03:06 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 07:03:06 user nova-compute[73258]:       <stats period="10"/>
Aug 27 07:03:06 user nova-compute[73258]:     </memballoon>
Aug 27 07:03:06 user nova-compute[73258]:   </devices>
Aug 27 07:03:06 user nova-compute[73258]: </domain>
Aug 27 07:03:06 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:03:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1541183622',display_name='tempest-VolumesNegativeTest-instance-1541183622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1541183622',id=44,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70f3f0a6b5da4b789e9e7159326a1c8b',ramdisk_id='',reservation_id='r-v7jwwngn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1157579996',owner_user_name='tempest-VolumesNegativeTest-1157579996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:03:04Z,user_data=None,user_id='ae9abe39b9de469ba7c64532e8955eba',uuid=2f29054c-6b51-443d-89da-a69fbe658b49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "address": "fa:16:3e:70:87:b1", "network": {"id": "1f8d78c3-b8b2-4e0c-bbdd-f25ce36ff083", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a0fe6064085e4553aeec775fb8e6faeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157709f5-9c", "ovs_interfaceid": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Converting VIF {"id": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "address": "fa:16:3e:70:87:b1", "network": {"id": "1f8d78c3-b8b2-4e0c-bbdd-f25ce36ff083", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a0fe6064085e4553aeec775fb8e6faeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157709f5-9c", "ovs_interfaceid": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:87:b1,bridge_name='br-int',has_traffic_filtering=True,id=157709f5-9c66-44b4-88b7-2e38aebe35d5,network=Network(1f8d78c3-b8b2-4e0c-bbdd-f25ce36ff083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap157709f5-9c') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG os_vif [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:87:b1,bridge_name='br-int',has_traffic_filtering=True,id=157709f5-9c66-44b4-88b7-2e38aebe35d5,network=Network(1f8d78c3-b8b2-4e0c-bbdd-f25ce36ff083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap157709f5-9c') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap157709f5-9c, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap157709f5-9c, col_values=(('external_ids', {'iface-id': '157709f5-9c66-44b4-88b7-2e38aebe35d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:87:b1', 'vm-uuid': '2f29054c-6b51-443d-89da-a69fbe658b49'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:06 user nova-compute[73258]: INFO os_vif [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:87:b1,bridge_name='br-int',has_traffic_filtering=True,id=157709f5-9c66-44b4-88b7-2e38aebe35d5,network=Network(1f8d78c3-b8b2-4e0c-bbdd-f25ce36ff083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap157709f5-9c')
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:03:06 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] No VIF found with MAC fa:16:3e:70:87:b1, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 07:03:07 user nova-compute[73258]: DEBUG nova.network.neutron [req-b4a4004d-46d3-44d2-9370-f0ccafef33cb req-a1862c32-f3b9-4d74-ba4c-9980f929819f service nova] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Updated VIF entry in instance network info cache for port 157709f5-9c66-44b4-88b7-2e38aebe35d5. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:03:07 user nova-compute[73258]: DEBUG nova.network.neutron [req-b4a4004d-46d3-44d2-9370-f0ccafef33cb req-a1862c32-f3b9-4d74-ba4c-9980f929819f service nova] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Updating instance_info_cache with network_info: [{"id": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "address": "fa:16:3e:70:87:b1", "network": {"id": "1f8d78c3-b8b2-4e0c-bbdd-f25ce36ff083", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a0fe6064085e4553aeec775fb8e6faeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157709f5-9c", "ovs_interfaceid": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:03:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b4a4004d-46d3-44d2-9370-f0ccafef33cb req-a1862c32-f3b9-4d74-ba4c-9980f929819f service nova] Releasing lock "refresh_cache-2f29054c-6b51-443d-89da-a69fbe658b49" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:03:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-aae01055-b105-40d9-a7cd-0194de8dd999 req-f1efc3fb-0fdd-4d4f-bee6-a9fa0c5950ce service nova] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Received event network-vif-plugged-157709f5-9c66-44b4-88b7-2e38aebe35d5 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:03:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-aae01055-b105-40d9-a7cd-0194de8dd999 req-f1efc3fb-0fdd-4d4f-bee6-a9fa0c5950ce service nova] Acquiring lock "2f29054c-6b51-443d-89da-a69fbe658b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-aae01055-b105-40d9-a7cd-0194de8dd999 req-f1efc3fb-0fdd-4d4f-bee6-a9fa0c5950ce service nova] Lock "2f29054c-6b51-443d-89da-a69fbe658b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-aae01055-b105-40d9-a7cd-0194de8dd999 req-f1efc3fb-0fdd-4d4f-bee6-a9fa0c5950ce service nova] Lock "2f29054c-6b51-443d-89da-a69fbe658b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-aae01055-b105-40d9-a7cd-0194de8dd999 req-f1efc3fb-0fdd-4d4f-bee6-a9fa0c5950ce service nova] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] No waiting events found dispatching network-vif-plugged-157709f5-9c66-44b4-88b7-2e38aebe35d5 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:03:08 user nova-compute[73258]: WARNING nova.compute.manager [req-aae01055-b105-40d9-a7cd-0194de8dd999 req-f1efc3fb-0fdd-4d4f-bee6-a9fa0c5950ce service nova] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Received unexpected event network-vif-plugged-157709f5-9c66-44b4-88b7-2e38aebe35d5 for instance with vm_state building and task_state spawning.
Aug 27 07:03:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-f24fe90c-d108-417d-b675-238e864b9f90 req-5511f443-e4b8-42bb-955a-040631c38da6 service nova] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Received event network-vif-plugged-157709f5-9c66-44b4-88b7-2e38aebe35d5 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:03:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f24fe90c-d108-417d-b675-238e864b9f90 req-5511f443-e4b8-42bb-955a-040631c38da6 service nova] Acquiring lock "2f29054c-6b51-443d-89da-a69fbe658b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f24fe90c-d108-417d-b675-238e864b9f90 req-5511f443-e4b8-42bb-955a-040631c38da6 service nova] Lock "2f29054c-6b51-443d-89da-a69fbe658b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f24fe90c-d108-417d-b675-238e864b9f90 req-5511f443-e4b8-42bb-955a-040631c38da6 service nova] Lock "2f29054c-6b51-443d-89da-a69fbe658b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-f24fe90c-d108-417d-b675-238e864b9f90 req-5511f443-e4b8-42bb-955a-040631c38da6 service nova] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] No waiting events found dispatching network-vif-plugged-157709f5-9c66-44b4-88b7-2e38aebe35d5 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:03:10 user nova-compute[73258]: WARNING nova.compute.manager [req-f24fe90c-d108-417d-b675-238e864b9f90 req-5511f443-e4b8-42bb-955a-040631c38da6 service nova] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Received unexpected event network-vif-plugged-157709f5-9c66-44b4-88b7-2e38aebe35d5 for instance with vm_state building and task_state spawning.
Aug 27 07:03:10 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119790.69954, 2f29054c-6b51-443d-89da-a69fbe658b49 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:03:10 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] VM Resumed (Lifecycle Event)
Aug 27 07:03:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 07:03:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 07:03:10 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Instance spawned successfully.
Aug 27 07:03:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 07:03:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:03:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:03:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:03:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:03:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:03:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:03:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:03:10 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:03:10 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:03:10 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119790.7012048, 2f29054c-6b51-443d-89da-a69fbe658b49 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:03:10 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] VM Started (Lifecycle Event)
Aug 27 07:03:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:03:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:03:10 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:03:10 user nova-compute[73258]: INFO nova.compute.manager [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Took 6.48 seconds to spawn the instance on the hypervisor.
Aug 27 07:03:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:03:10 user nova-compute[73258]: INFO nova.compute.manager [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Took 7.93 seconds to build instance.
Aug 27 07:03:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9353cb1e-e373-4d6f-9a13-5c8f7e77f925 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Lock "2f29054c-6b51-443d-89da-a69fbe658b49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.043s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:13 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:03:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:17 user nova-compute[73258]: DEBUG nova.compute.manager [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 07:03:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:17 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 07:03:17 user nova-compute[73258]: INFO nova.compute.claims [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Claim successful on node user
Aug 27 07:03:17 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:03:17 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 07:03:17 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] There are 0 instances to clean {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 07:03:17 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:03:18 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:03:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:18 user nova-compute[73258]: DEBUG nova.compute.manager [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 07:03:18 user nova-compute[73258]: DEBUG nova.compute.manager [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 07:03:18 user nova-compute[73258]: DEBUG nova.network.neutron [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 07:03:18 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 07:03:18 user nova-compute[73258]: DEBUG nova.compute.manager [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 07:03:18 user nova-compute[73258]: DEBUG nova.policy [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8de65612a05142ebb509012c126b89b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f6a09d79c43c282e56cfda50001d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 07:03:18 user nova-compute[73258]: DEBUG nova.compute.manager [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 07:03:18 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 07:03:18 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Creating image(s)
Aug 27 07:03:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "/opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "/opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "/opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "64d4f3a5b62e7993cb9804b202c70a184a8286bc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "64d4f3a5b62e7993cb9804b202c70a184a8286bc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64d4f3a5b62e7993cb9804b202c70a184a8286bc.part --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:18 user nova-compute[73258]: DEBUG nova.network.neutron [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Successfully created port: 3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 07:03:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64d4f3a5b62e7993cb9804b202c70a184a8286bc.part --force-share --output=json" returned: 0 in 0.220s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:19 user nova-compute[73258]: DEBUG nova.virt.images [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] 03bb8985-c2cf-4689-b0ac-c76d7e115c44 was qcow2, converting to raw {{(pid=73258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 07:03:19 user nova-compute[73258]: DEBUG nova.privsep.utils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 07:03:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/64d4f3a5b62e7993cb9804b202c70a184a8286bc.part /opt/stack/data/nova/instances/_base/64d4f3a5b62e7993cb9804b202c70a184a8286bc.converted {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/64d4f3a5b62e7993cb9804b202c70a184a8286bc.part /opt/stack/data/nova/instances/_base/64d4f3a5b62e7993cb9804b202c70a184a8286bc.converted" returned: 0 in 0.327s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64d4f3a5b62e7993cb9804b202c70a184a8286bc.converted --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64d4f3a5b62e7993cb9804b202c70a184a8286bc.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "64d4f3a5b62e7993cb9804b202c70a184a8286bc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.327s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64d4f3a5b62e7993cb9804b202c70a184a8286bc --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64d4f3a5b62e7993cb9804b202c70a184a8286bc --force-share --output=json" returned: 0 in 0.200s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "64d4f3a5b62e7993cb9804b202c70a184a8286bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "64d4f3a5b62e7993cb9804b202c70a184a8286bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64d4f3a5b62e7993cb9804b202c70a184a8286bc --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:19 user nova-compute[73258]: DEBUG nova.network.neutron [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Successfully updated port: 3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquired lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.network.neutron [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-c0fb6af2-7b1a-4cf8-8f55-bcf8c70eca66 req-86c2736e-ba19-40f7-bfca-89ee60410a1e service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received event network-changed-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-c0fb6af2-7b1a-4cf8-8f55-bcf8c70eca66 req-86c2736e-ba19-40f7-bfca-89ee60410a1e service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Refreshing instance network info cache due to event network-changed-3adbe18d-bad6-47d6-945a-d961251c1e6c. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c0fb6af2-7b1a-4cf8-8f55-bcf8c70eca66 req-86c2736e-ba19-40f7-bfca-89ee60410a1e service nova] Acquiring lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.network.neutron [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64d4f3a5b62e7993cb9804b202c70a184a8286bc --force-share --output=json" returned: 0 in 0.216s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/64d4f3a5b62e7993cb9804b202c70a184a8286bc,backing_fmt=raw /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/64d4f3a5b62e7993cb9804b202c70a184a8286bc,backing_fmt=raw /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk 1073741824" returned: 0 in 0.065s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "64d4f3a5b62e7993cb9804b202c70a184a8286bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64d4f3a5b62e7993cb9804b202c70a184a8286bc --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64d4f3a5b62e7993cb9804b202c70a184a8286bc --force-share --output=json" returned: 0 in 0.171s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.network.neutron [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updating instance_info_cache with network_info: [{"id": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "address": "fa:16:3e:f9:70:7e", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3adbe18d-ba", "ovs_interfaceid": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Releasing lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Instance network_info: |[{"id": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "address": "fa:16:3e:f9:70:7e", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3adbe18d-ba", "ovs_interfaceid": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c0fb6af2-7b1a-4cf8-8f55-bcf8c70eca66 req-86c2736e-ba19-40f7-bfca-89ee60410a1e service nova] Acquired lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.network.neutron [req-c0fb6af2-7b1a-4cf8-8f55-bcf8c70eca66 req-86c2736e-ba19-40f7-bfca-89ee60410a1e service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Refreshing network info cache for port 3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Cannot resize image /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Ensure instance console log exists: /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Start _get_guest_xml network_info=[{"id": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "address": "fa:16:3e:f9:70:7e", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3adbe18d-ba", "ovs_interfaceid": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T07:03:14Z,direct_url=<?>,disk_format='qcow2',id=03bb8985-c2cf-4689-b0ac-c76d7e115c44,min_disk=0,min_ram=0,name='tempest-scenario-img--356848788',owner='b34f6a09d79c43c282e56cfda50001d7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T07:03:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '03bb8985-c2cf-4689-b0ac-c76d7e115c44'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 07:03:20 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:03:20 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T07:03:14Z,direct_url=<?>,disk_format='qcow2',id=03bb8985-c2cf-4689-b0ac-c76d7e115c44,min_disk=0,min_ram=0,name='tempest-scenario-img--356848788',owner='b34f6a09d79c43c282e56cfda50001d7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T07:03:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:03:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-598066848',display_name='tempest-TestMinimumBasicScenario-server-598066848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-598066848',id=45,image_ref='03bb8985-c2cf-4689-b0ac-c76d7e115c44',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYUwsE+wWLocnonNsDrY0mg5BWSHrZf4/cA7vPkbV/B9qwFbwwGIpFTXvnR8nMroeNQR5kZ8s22UQt0sHhiItTh7wKi1WLVRchjLi6Xk/ar3wryqCUl4diCgvyUI5jbfw==',key_name='tempest-TestMinimumBasicScenario-67594116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b34f6a09d79c43c282e56cfda50001d7',ramdisk_id='',reservation_id='r-nh80wh1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03bb8985-c2cf-4689-b0ac-c76d7e115c44',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1509066975',owner_user_name='tempest-TestMinimumBasicScenario-1509066975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:03:18Z,user_data=None,user_id='8de65612a05142ebb509012c126b89b0',uuid=18b1857e-4abc-48fa-8f77-5152ef8ee3b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "address": "fa:16:3e:f9:70:7e", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3adbe18d-ba", "ovs_interfaceid": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Converting VIF {"id": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "address": "fa:16:3e:f9:70:7e", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3adbe18d-ba", "ovs_interfaceid": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:70:7e,bridge_name='br-int',has_traffic_filtering=True,id=3adbe18d-bad6-47d6-945a-d961251c1e6c,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3adbe18d-ba') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.objects.instance [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lazy-loading 'pci_devices' on Instance uuid 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] End _get_guest_xml xml=<domain type="kvm">
Aug 27 07:03:20 user nova-compute[73258]:   <uuid>18b1857e-4abc-48fa-8f77-5152ef8ee3b6</uuid>
Aug 27 07:03:20 user nova-compute[73258]:   <name>instance-0000002d</name>
Aug 27 07:03:20 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 07:03:20 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 07:03:20 user nova-compute[73258]:   <metadata>
Aug 27 07:03:20 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 07:03:20 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 07:03:20 user nova-compute[73258]:       <nova:name>tempest-TestMinimumBasicScenario-server-598066848</nova:name>
Aug 27 07:03:20 user nova-compute[73258]:       <nova:creationTime>2023-08-27 07:03:20</nova:creationTime>
Aug 27 07:03:20 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 07:03:20 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 07:03:20 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 07:03:20 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 07:03:20 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 07:03:20 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 07:03:20 user nova-compute[73258]:       </nova:flavor>
Aug 27 07:03:20 user nova-compute[73258]:       <nova:owner>
Aug 27 07:03:20 user nova-compute[73258]:         <nova:user uuid="8de65612a05142ebb509012c126b89b0">tempest-TestMinimumBasicScenario-1509066975-project-member</nova:user>
Aug 27 07:03:20 user nova-compute[73258]:         <nova:project uuid="b34f6a09d79c43c282e56cfda50001d7">tempest-TestMinimumBasicScenario-1509066975</nova:project>
Aug 27 07:03:20 user nova-compute[73258]:       </nova:owner>
Aug 27 07:03:20 user nova-compute[73258]:       <nova:root type="image" uuid="03bb8985-c2cf-4689-b0ac-c76d7e115c44"/>
Aug 27 07:03:20 user nova-compute[73258]:       <nova:ports>
Aug 27 07:03:20 user nova-compute[73258]:         <nova:port uuid="3adbe18d-bad6-47d6-945a-d961251c1e6c">
Aug 27 07:03:20 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 07:03:20 user nova-compute[73258]:         </nova:port>
Aug 27 07:03:20 user nova-compute[73258]:       </nova:ports>
Aug 27 07:03:20 user nova-compute[73258]:     </nova:instance>
Aug 27 07:03:20 user nova-compute[73258]:   </metadata>
Aug 27 07:03:20 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 07:03:20 user nova-compute[73258]:     <system>
Aug 27 07:03:20 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 07:03:20 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 07:03:20 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 07:03:20 user nova-compute[73258]:       <entry name="serial">18b1857e-4abc-48fa-8f77-5152ef8ee3b6</entry>
Aug 27 07:03:20 user nova-compute[73258]:       <entry name="uuid">18b1857e-4abc-48fa-8f77-5152ef8ee3b6</entry>
Aug 27 07:03:20 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 07:03:20 user nova-compute[73258]:     </system>
Aug 27 07:03:20 user nova-compute[73258]:   </sysinfo>
Aug 27 07:03:20 user nova-compute[73258]:   <os>
Aug 27 07:03:20 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 07:03:20 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 07:03:20 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 07:03:20 user nova-compute[73258]:   </os>
Aug 27 07:03:20 user nova-compute[73258]:   <features>
Aug 27 07:03:20 user nova-compute[73258]:     <acpi/>
Aug 27 07:03:20 user nova-compute[73258]:     <apic/>
Aug 27 07:03:20 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 07:03:20 user nova-compute[73258]:   </features>
Aug 27 07:03:20 user nova-compute[73258]:   <clock offset="utc">
Aug 27 07:03:20 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 07:03:20 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 07:03:20 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 07:03:20 user nova-compute[73258]:   </clock>
Aug 27 07:03:20 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 07:03:20 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 07:03:20 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 07:03:20 user nova-compute[73258]:   </cpu>
Aug 27 07:03:20 user nova-compute[73258]:   <devices>
Aug 27 07:03:20 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 07:03:20 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 07:03:20 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk"/>
Aug 27 07:03:20 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 07:03:20 user nova-compute[73258]:     </disk>
Aug 27 07:03:20 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 07:03:20 user nova-compute[73258]:       <mac address="fa:16:3e:f9:70:7e"/>
Aug 27 07:03:20 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:03:20 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 07:03:20 user nova-compute[73258]:       <target dev="tap3adbe18d-ba"/>
Aug 27 07:03:20 user nova-compute[73258]:     </interface>
Aug 27 07:03:20 user nova-compute[73258]:     <serial type="pty">
Aug 27 07:03:20 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/console.log" append="off"/>
Aug 27 07:03:20 user nova-compute[73258]:     </serial>
Aug 27 07:03:20 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 07:03:20 user nova-compute[73258]:     <video>
Aug 27 07:03:20 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:03:20 user nova-compute[73258]:     </video>
Aug 27 07:03:20 user nova-compute[73258]:     <rng model="virtio">
Aug 27 07:03:20 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 07:03:20 user nova-compute[73258]:     </rng>
Aug 27 07:03:20 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 07:03:20 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 07:03:20 user nova-compute[73258]:       <stats period="10"/>
Aug 27 07:03:20 user nova-compute[73258]:     </memballoon>
Aug 27 07:03:20 user nova-compute[73258]:   </devices>
Aug 27 07:03:20 user nova-compute[73258]: </domain>
Aug 27 07:03:20 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:03:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-598066848',display_name='tempest-TestMinimumBasicScenario-server-598066848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-598066848',id=45,image_ref='03bb8985-c2cf-4689-b0ac-c76d7e115c44',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYUwsE+wWLocnonNsDrY0mg5BWSHrZf4/cA7vPkbV/B9qwFbwwGIpFTXvnR8nMroeNQR5kZ8s22UQt0sHhiItTh7wKi1WLVRchjLi6Xk/ar3wryqCUl4diCgvyUI5jbfw==',key_name='tempest-TestMinimumBasicScenario-67594116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b34f6a09d79c43c282e56cfda50001d7',ramdisk_id='',reservation_id='r-nh80wh1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03bb8985-c2cf-4689-b0ac-c76d7e115c44',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1509066975',owner_user_name='tempest-TestMinimumBasicScenario-1509066975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:03:18Z,user_data=None,user_id='8de65612a05142ebb509012c126b89b0',uuid=18b1857e-4abc-48fa-8f77-5152ef8ee3b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "address": "fa:16:3e:f9:70:7e", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3adbe18d-ba", "ovs_interfaceid": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Converting VIF {"id": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "address": "fa:16:3e:f9:70:7e", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3adbe18d-ba", "ovs_interfaceid": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:70:7e,bridge_name='br-int',has_traffic_filtering=True,id=3adbe18d-bad6-47d6-945a-d961251c1e6c,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3adbe18d-ba') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG os_vif [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:70:7e,bridge_name='br-int',has_traffic_filtering=True,id=3adbe18d-bad6-47d6-945a-d961251c1e6c,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3adbe18d-ba') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3adbe18d-ba, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3adbe18d-ba, col_values=(('external_ids', {'iface-id': '3adbe18d-bad6-47d6-945a-d961251c1e6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:70:7e', 'vm-uuid': '18b1857e-4abc-48fa-8f77-5152ef8ee3b6'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:20 user nova-compute[73258]: INFO os_vif [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:70:7e,bridge_name='br-int',has_traffic_filtering=True,id=3adbe18d-bad6-47d6-945a-d961251c1e6c,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3adbe18d-ba')
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:03:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] No VIF found with MAC fa:16:3e:f9:70:7e, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 07:03:21 user nova-compute[73258]: DEBUG nova.network.neutron [req-c0fb6af2-7b1a-4cf8-8f55-bcf8c70eca66 req-86c2736e-ba19-40f7-bfca-89ee60410a1e service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updated VIF entry in instance network info cache for port 3adbe18d-bad6-47d6-945a-d961251c1e6c. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:03:21 user nova-compute[73258]: DEBUG nova.network.neutron [req-c0fb6af2-7b1a-4cf8-8f55-bcf8c70eca66 req-86c2736e-ba19-40f7-bfca-89ee60410a1e service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updating instance_info_cache with network_info: [{"id": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "address": "fa:16:3e:f9:70:7e", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3adbe18d-ba", "ovs_interfaceid": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:03:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c0fb6af2-7b1a-4cf8-8f55-bcf8c70eca66 req-86c2736e-ba19-40f7-bfca-89ee60410a1e service nova] Releasing lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:03:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:22 user nova-compute[73258]: DEBUG nova.compute.manager [req-59fbf4fa-c0b1-4d28-8c1f-9b3507cf52c1 req-31d64705-3d33-4839-a433-8a302791e32c service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received event network-vif-plugged-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:03:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-59fbf4fa-c0b1-4d28-8c1f-9b3507cf52c1 req-31d64705-3d33-4839-a433-8a302791e32c service nova] Acquiring lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-59fbf4fa-c0b1-4d28-8c1f-9b3507cf52c1 req-31d64705-3d33-4839-a433-8a302791e32c service nova] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-59fbf4fa-c0b1-4d28-8c1f-9b3507cf52c1 req-31d64705-3d33-4839-a433-8a302791e32c service nova] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:22 user nova-compute[73258]: DEBUG nova.compute.manager [req-59fbf4fa-c0b1-4d28-8c1f-9b3507cf52c1 req-31d64705-3d33-4839-a433-8a302791e32c service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] No waiting events found dispatching network-vif-plugged-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:03:22 user nova-compute[73258]: WARNING nova.compute.manager [req-59fbf4fa-c0b1-4d28-8c1f-9b3507cf52c1 req-31d64705-3d33-4839-a433-8a302791e32c service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received unexpected event network-vif-plugged-3adbe18d-bad6-47d6-945a-d961251c1e6c for instance with vm_state building and task_state spawning.
Aug 27 07:03:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-3179ad06-52da-4b9f-8664-89361ad606e4 req-38aff228-66e7-4baf-b373-3de840640e62 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received event network-vif-plugged-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:03:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3179ad06-52da-4b9f-8664-89361ad606e4 req-38aff228-66e7-4baf-b373-3de840640e62 service nova] Acquiring lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3179ad06-52da-4b9f-8664-89361ad606e4 req-38aff228-66e7-4baf-b373-3de840640e62 service nova] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3179ad06-52da-4b9f-8664-89361ad606e4 req-38aff228-66e7-4baf-b373-3de840640e62 service nova] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-3179ad06-52da-4b9f-8664-89361ad606e4 req-38aff228-66e7-4baf-b373-3de840640e62 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] No waiting events found dispatching network-vif-plugged-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:03:24 user nova-compute[73258]: WARNING nova.compute.manager [req-3179ad06-52da-4b9f-8664-89361ad606e4 req-38aff228-66e7-4baf-b373-3de840640e62 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received unexpected event network-vif-plugged-3adbe18d-bad6-47d6-945a-d961251c1e6c for instance with vm_state building and task_state spawning.
Aug 27 07:03:24 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119804.4626591, 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:03:24 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] VM Resumed (Lifecycle Event)
Aug 27 07:03:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 07:03:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 07:03:24 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Instance spawned successfully.
Aug 27 07:03:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 07:03:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:03:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:03:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:03:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:03:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:03:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:03:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:03:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:03:24 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:03:24 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119804.4688475, 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:03:24 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] VM Started (Lifecycle Event)
Aug 27 07:03:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:03:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:03:24 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:03:24 user nova-compute[73258]: INFO nova.compute.manager [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Took 6.30 seconds to spawn the instance on the hypervisor.
Aug 27 07:03:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:03:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:24 user nova-compute[73258]: INFO nova.compute.manager [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Took 7.40 seconds to build instance.
Aug 27 07:03:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-c477dd71-57e5-43df-ab88-79c859bfa8b4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.506s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:33 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:03:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "c7726af8-f937-49ae-ba07-54ed57e18a50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:36 user nova-compute[73258]: INFO nova.compute.manager [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Detaching volume be67bf9a-29ed-4ee6-be1f-7263d82bf364
Aug 27 07:03:36 user nova-compute[73258]: INFO nova.virt.block_device [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Attempting to driver detach volume be67bf9a-29ed-4ee6-be1f-7263d82bf364 from mountpoint /dev/vdb
Aug 27 07:03:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Attempting to detach device vdb from instance c7726af8-f937-49ae-ba07-54ed57e18a50 from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 07:03:36 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:03:36 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 07:03:36 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 07:03:36 user nova-compute[73258]:   <serial>be67bf9a-29ed-4ee6-be1f-7263d82bf364</serial>
Aug 27 07:03:36 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 07:03:36 user nova-compute[73258]: </disk>
Aug 27 07:03:36 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 07:03:36 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Successfully detached device vdb from instance c7726af8-f937-49ae-ba07-54ed57e18a50 from the persistent domain config.
Aug 27 07:03:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c7726af8-f937-49ae-ba07-54ed57e18a50 from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 07:03:36 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:03:36 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 07:03:36 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 07:03:36 user nova-compute[73258]:   <serial>be67bf9a-29ed-4ee6-be1f-7263d82bf364</serial>
Aug 27 07:03:36 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 07:03:36 user nova-compute[73258]: </disk>
Aug 27 07:03:36 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693119816.5430822, c7726af8-f937-49ae-ba07-54ed57e18a50 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c7726af8-f937-49ae-ba07-54ed57e18a50 {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 07:03:36 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Successfully detached device vdb from instance c7726af8-f937-49ae-ba07-54ed57e18a50 from the live domain config.
Aug 27 07:03:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJMVueEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:03:36 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:03:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[48532790-ad09-454b-a143-9dc38c8fda07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff9d976-afa7-47aa-a71f-51951abf836d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 (non-flash)
Aug 27 07:03:36 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 (non-flash)
Aug 27 07:03:36 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa41035f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccadbc90-9bf8-4996-b9e4-d8bc9bcdd884]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f139f702-16a5-4fa6-808e-69d342d58d4a]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52255cb-f53a-45e9-b4de-ecb19fb90b23]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c793692-d755-46c0-b89b-290915ddfb12]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[665ab47e-1ce2-4e1f-ac59-948f69090926]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c30081-79c9-44df-a584-80faec1ed070]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364, portal: 172.16.0.220,3260]
Aug 27 07:03:36 user nova-compute[73258]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364, portal: 172.16.0.220,3260] successful.
Aug 27 07:03:36 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be67bf9a-29ed-4ee6-be1f-7263d82bf364 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2070df-a9ba-45aa-973b-f6f14a57757f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] <== disconnect_volume: return (286ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:03:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 07:03:37 user nova-compute[73258]: DEBUG nova.objects.instance [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lazy-loading 'flavor' on Instance uuid c7726af8-f937-49ae-ba07-54ed57e18a50 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:03:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e4321731-ee42-4313-b18d-7678f35cce71 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.666s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:55 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:03:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:57 user nova-compute[73258]: INFO nova.compute.manager [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Terminating instance
Aug 27 07:03:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 07:03:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:57 user nova-compute[73258]: DEBUG nova.compute.manager [req-9d87b6a8-0c2d-4cfa-be27-52151c4baff5 req-03b7effd-93d9-45fe-92c7-b23da8e8b05d service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Received event network-vif-unplugged-be41900c-5aad-4659-9e21-fc2c0c0b8bd1 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:03:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9d87b6a8-0c2d-4cfa-be27-52151c4baff5 req-03b7effd-93d9-45fe-92c7-b23da8e8b05d service nova] Acquiring lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9d87b6a8-0c2d-4cfa-be27-52151c4baff5 req-03b7effd-93d9-45fe-92c7-b23da8e8b05d service nova] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:57 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9d87b6a8-0c2d-4cfa-be27-52151c4baff5 req-03b7effd-93d9-45fe-92c7-b23da8e8b05d service nova] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:57 user nova-compute[73258]: DEBUG nova.compute.manager [req-9d87b6a8-0c2d-4cfa-be27-52151c4baff5 req-03b7effd-93d9-45fe-92c7-b23da8e8b05d service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] No waiting events found dispatching network-vif-unplugged-be41900c-5aad-4659-9e21-fc2c0c0b8bd1 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:03:57 user nova-compute[73258]: DEBUG nova.compute.manager [req-9d87b6a8-0c2d-4cfa-be27-52151c4baff5 req-03b7effd-93d9-45fe-92c7-b23da8e8b05d service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Received event network-vif-unplugged-be41900c-5aad-4659-9e21-fc2c0c0b8bd1 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 07:03:57 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:03:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:03:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:58 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Instance destroyed successfully.
Aug 27 07:03:58 user nova-compute[73258]: DEBUG nova.objects.instance [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lazy-loading 'resources' on Instance uuid 54697fcb-9ffe-4660-b7d2-7b89dfd72439 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:03:58 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T06:55:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1140115155',display_name='tempest-SnapshotDataIntegrityTests-server-1140115155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1140115155',id=40,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6XxxUWvpp9AyShA4tf/HafMN5QFAven2ZPhwUZGpBiN5PxSVqcDrkjF7gdlWh2x/O0vCN4qqcAZOu4WYNelEVNtIP6M+JVS/B4oqwJSNLRwSpXvufmqXzwDB0X9TZPig==',key_name='tempest-keypair-827887380',keypairs=<?>,launch_index=0,launched_at=2023-08-27T06:55:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5caed6c4efcf4ebab7c5dc47d0d7736c',ramdisk_id='',reservation_id='r-23lwt5gw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-464395838',owner_user_name='tempest-SnapshotDataIntegrityTests-464395838-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T06:55:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9beefbe3addc4db1b2b1092601853ca8',uuid=54697fcb-9ffe-4660-b7d2-7b89dfd72439,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "address": "fa:16:3e:0a:85:cd", "network": {"id": "8868be84-8d19-484f-9732-0a212f789a1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1368955490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5caed6c4efcf4ebab7c5dc47d0d7736c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe41900c-5a", "ovs_interfaceid": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 07:03:58 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Converting VIF {"id": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "address": "fa:16:3e:0a:85:cd", "network": {"id": "8868be84-8d19-484f-9732-0a212f789a1f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1368955490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5caed6c4efcf4ebab7c5dc47d0d7736c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe41900c-5a", "ovs_interfaceid": "be41900c-5aad-4659-9e21-fc2c0c0b8bd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:03:58 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:85:cd,bridge_name='br-int',has_traffic_filtering=True,id=be41900c-5aad-4659-9e21-fc2c0c0b8bd1,network=Network(8868be84-8d19-484f-9732-0a212f789a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe41900c-5a') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:03:58 user nova-compute[73258]: DEBUG os_vif [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:85:cd,bridge_name='br-int',has_traffic_filtering=True,id=be41900c-5aad-4659-9e21-fc2c0c0b8bd1,network=Network(8868be84-8d19-484f-9732-0a212f789a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe41900c-5a') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 07:03:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe41900c-5a, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:03:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:03:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:03:58 user nova-compute[73258]: INFO os_vif [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:85:cd,bridge_name='br-int',has_traffic_filtering=True,id=be41900c-5aad-4659-9e21-fc2c0c0b8bd1,network=Network(8868be84-8d19-484f-9732-0a212f789a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe41900c-5a')
Aug 27 07:03:58 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Deleting instance files /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439_del
Aug 27 07:03:58 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Deletion of /opt/stack/data/nova/instances/54697fcb-9ffe-4660-b7d2-7b89dfd72439_del complete
Aug 27 07:03:58 user nova-compute[73258]: INFO nova.compute.manager [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 27 07:03:58 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 07:03:58 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 07:03:58 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 07:03:58 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:03:58 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:03:58 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:03:59 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:03:59 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Took 1.05 seconds to deallocate network for instance.
Aug 27 07:03:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:59 user nova-compute[73258]: DEBUG nova.compute.manager [req-1bb4c313-6685-4259-a377-bd08921f5881 req-42679f73-3e06-43d6-9979-ac812e3e3bd2 service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Received event network-vif-deleted-be41900c-5aad-4659-9e21-fc2c0c0b8bd1 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:03:59 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:03:59 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:03:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:59 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Deleted allocations for instance 54697fcb-9ffe-4660-b7d2-7b89dfd72439
Aug 27 07:03:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-27121458-847a-43d6-ad7d-a4a088d95a0c tempest-SnapshotDataIntegrityTests-464395838 tempest-SnapshotDataIntegrityTests-464395838-project-member] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.365s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:59 user nova-compute[73258]: DEBUG nova.compute.manager [req-6493c2ba-236e-4034-ae95-5088d0a4ec5d req-048e6ad8-36b5-45d6-a521-570c5a0f66a4 service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Received event network-vif-plugged-be41900c-5aad-4659-9e21-fc2c0c0b8bd1 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:03:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6493c2ba-236e-4034-ae95-5088d0a4ec5d req-048e6ad8-36b5-45d6-a521-570c5a0f66a4 service nova] Acquiring lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:03:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6493c2ba-236e-4034-ae95-5088d0a4ec5d req-048e6ad8-36b5-45d6-a521-570c5a0f66a4 service nova] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:03:59 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-6493c2ba-236e-4034-ae95-5088d0a4ec5d req-048e6ad8-36b5-45d6-a521-570c5a0f66a4 service nova] Lock "54697fcb-9ffe-4660-b7d2-7b89dfd72439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:03:59 user nova-compute[73258]: DEBUG nova.compute.manager [req-6493c2ba-236e-4034-ae95-5088d0a4ec5d req-048e6ad8-36b5-45d6-a521-570c5a0f66a4 service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] No waiting events found dispatching network-vif-plugged-be41900c-5aad-4659-9e21-fc2c0c0b8bd1 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:03:59 user nova-compute[73258]: WARNING nova.compute.manager [req-6493c2ba-236e-4034-ae95-5088d0a4ec5d req-048e6ad8-36b5-45d6-a521-570c5a0f66a4 service nova] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Received unexpected event network-vif-plugged-be41900c-5aad-4659-9e21-fc2c0c0b8bd1 for instance with vm_state deleted and task_state None.
Aug 27 07:04:00 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:04:00 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:04:00 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 07:04:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-c7726af8-f937-49ae-ba07-54ed57e18a50" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:04:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-c7726af8-f937-49ae-ba07-54ed57e18a50" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:04:00 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 07:04:00 user nova-compute[73258]: DEBUG nova.objects.instance [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lazy-loading 'info_cache' on Instance uuid c7726af8-f937-49ae-ba07-54ed57e18a50 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:04:01 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Updating instance_info_cache with network_info: [{"id": "1b84a563-103e-441c-85d5-41c39008196a", "address": "fa:16:3e:6d:71:a7", "network": {"id": "371866e1-b4cf-47fe-8d41-2c9e59f468ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1786605233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4444c10053404b2684e82b5986b8a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b84a563-10", "ovs_interfaceid": "1b84a563-103e-441c-85d5-41c39008196a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:04:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-c7726af8-f937-49ae-ba07-54ed57e18a50" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:04:01 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 07:04:01 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:04:01 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:04:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:03 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:04:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:04:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:04:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:04:03 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:04:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:04:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:04:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:04:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:04:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f29054c-6b51-443d-89da-a69fbe658b49/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:04:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f29054c-6b51-443d-89da-a69fbe658b49/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:04:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f29054c-6b51-443d-89da-a69fbe658b49/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:04:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f29054c-6b51-443d-89da-a69fbe658b49/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:04:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:04:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:04:04 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:04:05 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:04:05 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:04:05 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:04:05 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8317MB free_disk=23.85982894897461GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:04:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:04:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:04:05 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance c7726af8-f937-49ae-ba07-54ed57e18a50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:04:05 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 2f29054c-6b51-443d-89da-a69fbe658b49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:04:05 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:04:05 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:04:05 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:04:05 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:04:05 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:04:05 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:04:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:04:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:04:12 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_power_states {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:04:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid c7726af8-f937-49ae-ba07-54ed57e18a50 {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 07:04:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid 2f29054c-6b51-443d-89da-a69fbe658b49 {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 07:04:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Triggering sync for uuid 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 {{(pid=73258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 07:04:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "c7726af8-f937-49ae-ba07-54ed57e18a50" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:04:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:04:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "2f29054c-6b51-443d-89da-a69fbe658b49" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:04:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "2f29054c-6b51-443d-89da-a69fbe658b49" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:04:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:04:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:04:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:04:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "2f29054c-6b51-443d-89da-a69fbe658b49" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:04:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:04:13 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119838.0636537, 54697fcb-9ffe-4660-b7d2-7b89dfd72439 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:04:13 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] VM Stopped (Lifecycle Event)
Aug 27 07:04:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-58224bb5-4a0d-4c9c-b6f1-5a47ee4c7ec1 None None] [instance: 54697fcb-9ffe-4660-b7d2-7b89dfd72439] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:04:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:04:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:04:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:04:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:04:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:04:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:04:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "c7726af8-f937-49ae-ba07-54ed57e18a50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:04:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:04:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "c7726af8-f937-49ae-ba07-54ed57e18a50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:04:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:04:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:04:26 user nova-compute[73258]: INFO nova.compute.manager [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Terminating instance
Aug 27 07:04:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 07:04:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-d663a525-3b86-4053-a15d-257b707ac96a req-a1b34d71-b6ec-475e-ac75-8ca5cc98575a service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Received event network-vif-unplugged-1b84a563-103e-441c-85d5-41c39008196a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:04:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d663a525-3b86-4053-a15d-257b707ac96a req-a1b34d71-b6ec-475e-ac75-8ca5cc98575a service nova] Acquiring lock "c7726af8-f937-49ae-ba07-54ed57e18a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:04:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d663a525-3b86-4053-a15d-257b707ac96a req-a1b34d71-b6ec-475e-ac75-8ca5cc98575a service nova] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:04:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d663a525-3b86-4053-a15d-257b707ac96a req-a1b34d71-b6ec-475e-ac75-8ca5cc98575a service nova] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:04:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-d663a525-3b86-4053-a15d-257b707ac96a req-a1b34d71-b6ec-475e-ac75-8ca5cc98575a service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] No waiting events found dispatching network-vif-unplugged-1b84a563-103e-441c-85d5-41c39008196a {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:04:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-d663a525-3b86-4053-a15d-257b707ac96a req-a1b34d71-b6ec-475e-ac75-8ca5cc98575a service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Received event network-vif-unplugged-1b84a563-103e-441c-85d5-41c39008196a for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 07:04:27 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Instance destroyed successfully.
Aug 27 07:04:27 user nova-compute[73258]: DEBUG nova.objects.instance [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lazy-loading 'resources' on Instance uuid c7726af8-f937-49ae-ba07-54ed57e18a50 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:04:27 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-372450740',display_name='tempest-TestServerVolumeAttachmentScenario-server-372450740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-372450740',id=43,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL1MNY+8zwUJ+i1YWqYGe5aF/ZAFOLwxxrA9K0KwFTC8aALc2hzNEVG01BwEGMxdUMIGG+7fqkQ1RROgQSiKcVDo2AuhqrxWQqIvtcLfG9csnUOWLtsmpXX3OiUCvlpdg==',key_name='tempest-keypair-1619340972',keypairs=<?>,launch_index=0,launched_at=2023-08-27T07:00:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4444c10053404b2684e82b5986b8a229',ramdisk_id='',reservation_id='r-x2j4a4ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1694723633',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1694723633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T07:00:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63c94d20493445b9bd59f82646b1b63b',uuid=c7726af8-f937-49ae-ba07-54ed57e18a50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b84a563-103e-441c-85d5-41c39008196a", "address": "fa:16:3e:6d:71:a7", "network": {"id": "371866e1-b4cf-47fe-8d41-2c9e59f468ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1786605233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4444c10053404b2684e82b5986b8a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b84a563-10", "ovs_interfaceid": "1b84a563-103e-441c-85d5-41c39008196a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 07:04:27 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Converting VIF {"id": "1b84a563-103e-441c-85d5-41c39008196a", "address": "fa:16:3e:6d:71:a7", "network": {"id": "371866e1-b4cf-47fe-8d41-2c9e59f468ab", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1786605233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4444c10053404b2684e82b5986b8a229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b84a563-10", "ovs_interfaceid": "1b84a563-103e-441c-85d5-41c39008196a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:04:27 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:71:a7,bridge_name='br-int',has_traffic_filtering=True,id=1b84a563-103e-441c-85d5-41c39008196a,network=Network(371866e1-b4cf-47fe-8d41-2c9e59f468ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b84a563-10') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:04:27 user nova-compute[73258]: DEBUG os_vif [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:71:a7,bridge_name='br-int',has_traffic_filtering=True,id=1b84a563-103e-441c-85d5-41c39008196a,network=Network(371866e1-b4cf-47fe-8d41-2c9e59f468ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b84a563-10') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 07:04:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b84a563-10, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:04:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:04:27 user nova-compute[73258]: INFO os_vif [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:71:a7,bridge_name='br-int',has_traffic_filtering=True,id=1b84a563-103e-441c-85d5-41c39008196a,network=Network(371866e1-b4cf-47fe-8d41-2c9e59f468ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b84a563-10')
Aug 27 07:04:27 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Deleting instance files /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50_del
Aug 27 07:04:27 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Deletion of /opt/stack/data/nova/instances/c7726af8-f937-49ae-ba07-54ed57e18a50_del complete
Aug 27 07:04:27 user nova-compute[73258]: INFO nova.compute.manager [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 27 07:04:27 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 07:04:27 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 07:04:27 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 07:04:28 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:04:28 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Took 0.90 seconds to deallocate network for instance.
Aug 27 07:04:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-a24c93fc-ccde-4fb6-901c-5753e2ece009 req-a667d38b-6a6d-4dc4-8d98-377d1bdb5877 service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Received event network-vif-deleted-1b84a563-103e-441c-85d5-41c39008196a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:04:28 user nova-compute[73258]: INFO nova.compute.manager [req-a24c93fc-ccde-4fb6-901c-5753e2ece009 req-a667d38b-6a6d-4dc4-8d98-377d1bdb5877 service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Neutron deleted interface 1b84a563-103e-441c-85d5-41c39008196a; detaching it from the instance and deleting it from the info cache
Aug 27 07:04:28 user nova-compute[73258]: DEBUG nova.network.neutron [req-a24c93fc-ccde-4fb6-901c-5753e2ece009 req-a667d38b-6a6d-4dc4-8d98-377d1bdb5877 service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:04:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-a24c93fc-ccde-4fb6-901c-5753e2ece009 req-a667d38b-6a6d-4dc4-8d98-377d1bdb5877 service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Detach interface failed, port_id=1b84a563-103e-441c-85d5-41c39008196a, reason: Instance c7726af8-f937-49ae-ba07-54ed57e18a50 could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 07:04:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:04:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:04:28 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:04:28 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:04:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:04:28 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Deleted allocations for instance c7726af8-f937-49ae-ba07-54ed57e18a50
Aug 27 07:04:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f407cd2c-4ab9-4d1e-b7de-a6848ddaa245 tempest-TestServerVolumeAttachmentScenario-1694723633 tempest-TestServerVolumeAttachmentScenario-1694723633-project-member] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.113s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:04:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-b49d59d8-62e5-4d66-8c8a-177beb34c4a9 req-51c21d9e-806b-46c6-80ad-73bf2d801186 service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Received event network-vif-plugged-1b84a563-103e-441c-85d5-41c39008196a {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:04:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b49d59d8-62e5-4d66-8c8a-177beb34c4a9 req-51c21d9e-806b-46c6-80ad-73bf2d801186 service nova] Acquiring lock "c7726af8-f937-49ae-ba07-54ed57e18a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:04:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b49d59d8-62e5-4d66-8c8a-177beb34c4a9 req-51c21d9e-806b-46c6-80ad-73bf2d801186 service nova] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:04:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b49d59d8-62e5-4d66-8c8a-177beb34c4a9 req-51c21d9e-806b-46c6-80ad-73bf2d801186 service nova] Lock "c7726af8-f937-49ae-ba07-54ed57e18a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:04:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-b49d59d8-62e5-4d66-8c8a-177beb34c4a9 req-51c21d9e-806b-46c6-80ad-73bf2d801186 service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] No waiting events found dispatching network-vif-plugged-1b84a563-103e-441c-85d5-41c39008196a {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:04:28 user nova-compute[73258]: WARNING nova.compute.manager [req-b49d59d8-62e5-4d66-8c8a-177beb34c4a9 req-51c21d9e-806b-46c6-80ad-73bf2d801186 service nova] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Received unexpected event network-vif-plugged-1b84a563-103e-441c-85d5-41c39008196a for instance with vm_state deleted and task_state None.
Aug 27 07:04:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:42 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119867.1313374, c7726af8-f937-49ae-ba07-54ed57e18a50 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:04:42 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] VM Stopped (Lifecycle Event)
Aug 27 07:04:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e15770b5-c360-4f83-999e-164644b5636a None None] [instance: c7726af8-f937-49ae-ba07-54ed57e18a50] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:04:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:04:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:04:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:04:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:04:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Acquiring lock "2f29054c-6b51-443d-89da-a69fbe658b49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:04:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Lock "2f29054c-6b51-443d-89da-a69fbe658b49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:04:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Acquiring lock "2f29054c-6b51-443d-89da-a69fbe658b49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:04:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Lock "2f29054c-6b51-443d-89da-a69fbe658b49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:04:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Lock "2f29054c-6b51-443d-89da-a69fbe658b49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:04:52 user nova-compute[73258]: INFO nova.compute.manager [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Terminating instance
Aug 27 07:04:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG nova.compute.manager [req-e4a15de1-72f3-4d6f-bda9-e5e630862ae9 req-609c9797-d4e6-416e-992e-a4f7b62404c8 service nova] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Received event network-vif-unplugged-157709f5-9c66-44b4-88b7-2e38aebe35d5 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e4a15de1-72f3-4d6f-bda9-e5e630862ae9 req-609c9797-d4e6-416e-992e-a4f7b62404c8 service nova] Acquiring lock "2f29054c-6b51-443d-89da-a69fbe658b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e4a15de1-72f3-4d6f-bda9-e5e630862ae9 req-609c9797-d4e6-416e-992e-a4f7b62404c8 service nova] Lock "2f29054c-6b51-443d-89da-a69fbe658b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e4a15de1-72f3-4d6f-bda9-e5e630862ae9 req-609c9797-d4e6-416e-992e-a4f7b62404c8 service nova] Lock "2f29054c-6b51-443d-89da-a69fbe658b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG nova.compute.manager [req-e4a15de1-72f3-4d6f-bda9-e5e630862ae9 req-609c9797-d4e6-416e-992e-a4f7b62404c8 service nova] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] No waiting events found dispatching network-vif-unplugged-157709f5-9c66-44b4-88b7-2e38aebe35d5 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG nova.compute.manager [req-e4a15de1-72f3-4d6f-bda9-e5e630862ae9 req-609c9797-d4e6-416e-992e-a4f7b62404c8 service nova] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Received event network-vif-unplugged-157709f5-9c66-44b4-88b7-2e38aebe35d5 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 07:04:53 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Instance destroyed successfully.
Aug 27 07:04:53 user nova-compute[73258]: DEBUG nova.objects.instance [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Lazy-loading 'resources' on Instance uuid 2f29054c-6b51-443d-89da-a69fbe658b49 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:03:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1541183622',display_name='tempest-VolumesNegativeTest-instance-1541183622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1541183622',id=44,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T07:03:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70f3f0a6b5da4b789e9e7159326a1c8b',ramdisk_id='',reservation_id='r-v7jwwngn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1157579996',owner_user_name='tempest-VolumesNegativeTest-1157579996-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T07:03:11Z,user_data=None,user_id='ae9abe39b9de469ba7c64532e8955eba',uuid=2f29054c-6b51-443d-89da-a69fbe658b49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "address": "fa:16:3e:70:87:b1", "network": {"id": "1f8d78c3-b8b2-4e0c-bbdd-f25ce36ff083", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a0fe6064085e4553aeec775fb8e6faeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157709f5-9c", "ovs_interfaceid": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Converting VIF {"id": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "address": "fa:16:3e:70:87:b1", "network": {"id": "1f8d78c3-b8b2-4e0c-bbdd-f25ce36ff083", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a0fe6064085e4553aeec775fb8e6faeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap157709f5-9c", "ovs_interfaceid": "157709f5-9c66-44b4-88b7-2e38aebe35d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:87:b1,bridge_name='br-int',has_traffic_filtering=True,id=157709f5-9c66-44b4-88b7-2e38aebe35d5,network=Network(1f8d78c3-b8b2-4e0c-bbdd-f25ce36ff083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap157709f5-9c') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG os_vif [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:87:b1,bridge_name='br-int',has_traffic_filtering=True,id=157709f5-9c66-44b4-88b7-2e38aebe35d5,network=Network(1f8d78c3-b8b2-4e0c-bbdd-f25ce36ff083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap157709f5-9c') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap157709f5-9c, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:04:53 user nova-compute[73258]: INFO os_vif [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:87:b1,bridge_name='br-int',has_traffic_filtering=True,id=157709f5-9c66-44b4-88b7-2e38aebe35d5,network=Network(1f8d78c3-b8b2-4e0c-bbdd-f25ce36ff083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap157709f5-9c')
Aug 27 07:04:53 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Deleting instance files /opt/stack/data/nova/instances/2f29054c-6b51-443d-89da-a69fbe658b49_del
Aug 27 07:04:53 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Deletion of /opt/stack/data/nova/instances/2f29054c-6b51-443d-89da-a69fbe658b49_del complete
Aug 27 07:04:53 user nova-compute[73258]: INFO nova.compute.manager [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Took 0.65 seconds to destroy the instance on the hypervisor.
Aug 27 07:04:53 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 07:04:53 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 07:04:54 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:04:54 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Took 0.55 seconds to deallocate network for instance.
Aug 27 07:04:54 user nova-compute[73258]: DEBUG nova.compute.manager [req-7b16f27b-ae05-452f-84ef-778f4427273b req-1bd1d621-4823-4ecd-b4cd-8e3ad714bf6b service nova] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Received event network-vif-deleted-157709f5-9c66-44b4-88b7-2e38aebe35d5 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:04:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:04:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:04:54 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:04:54 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:04:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:04:54 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Deleted allocations for instance 2f29054c-6b51-443d-89da-a69fbe658b49
Aug 27 07:04:54 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-cb7e1f8e-0140-4290-aef2-c67ea9e490e4 tempest-VolumesNegativeTest-1157579996 tempest-VolumesNegativeTest-1157579996-project-member] Lock "2f29054c-6b51-443d-89da-a69fbe658b49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.530s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:04:55 user nova-compute[73258]: DEBUG nova.compute.manager [req-781e5a42-67e8-4bed-8499-d4a5befc236a req-6e92c37d-d2b2-4078-83c4-5e0b4b2d1e83 service nova] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Received event network-vif-plugged-157709f5-9c66-44b4-88b7-2e38aebe35d5 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:04:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-781e5a42-67e8-4bed-8499-d4a5befc236a req-6e92c37d-d2b2-4078-83c4-5e0b4b2d1e83 service nova] Acquiring lock "2f29054c-6b51-443d-89da-a69fbe658b49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:04:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-781e5a42-67e8-4bed-8499-d4a5befc236a req-6e92c37d-d2b2-4078-83c4-5e0b4b2d1e83 service nova] Lock "2f29054c-6b51-443d-89da-a69fbe658b49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:04:55 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-781e5a42-67e8-4bed-8499-d4a5befc236a req-6e92c37d-d2b2-4078-83c4-5e0b4b2d1e83 service nova] Lock "2f29054c-6b51-443d-89da-a69fbe658b49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:04:55 user nova-compute[73258]: DEBUG nova.compute.manager [req-781e5a42-67e8-4bed-8499-d4a5befc236a req-6e92c37d-d2b2-4078-83c4-5e0b4b2d1e83 service nova] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] No waiting events found dispatching network-vif-plugged-157709f5-9c66-44b4-88b7-2e38aebe35d5 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:04:55 user nova-compute[73258]: WARNING nova.compute.manager [req-781e5a42-67e8-4bed-8499-d4a5befc236a req-6e92c37d-d2b2-4078-83c4-5e0b4b2d1e83 service nova] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Received unexpected event network-vif-plugged-157709f5-9c66-44b4-88b7-2e38aebe35d5 for instance with vm_state deleted and task_state None.
Aug 27 07:04:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:04:57 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:04:57 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:04:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:04:58 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:04:59 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:04:59 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:05:00 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:05:00 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:05:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:05:00 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:05:00 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 07:05:01 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updating instance_info_cache with network_info: [{"id": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "address": "fa:16:3e:f9:70:7e", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3adbe18d-ba", "ovs_interfaceid": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:05:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:05:01 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 07:05:01 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:05:01 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:05:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:05 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:05:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:05:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:05:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:05:05 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:05:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:05:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:05:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:05:06 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:05:06 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:05:06 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:05:06 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8619MB free_disk=23.912826538085938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:05:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:05:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:05:06 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:05:06 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:05:06 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:05:07 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:05:07 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:05:07 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:05:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:05:08 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693119893.5071864, 2f29054c-6b51-443d-89da-a69fbe658b49 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:05:08 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] VM Stopped (Lifecycle Event)
Aug 27 07:05:08 user nova-compute[73258]: DEBUG nova.compute.manager [None req-96b0cbdd-f714-4d88-bfb2-1f7d3ddf756a None None] [instance: 2f29054c-6b51-443d-89da-a69fbe658b49] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:05:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:05:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG nova.objects.instance [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lazy-loading 'flavor' on Instance uuid 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:05:13 user nova-compute[73258]: INFO nova.compute.manager [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Attaching volume cf7d349d-98b5-4231-a474-fd64e4ca72cc to /dev/vdb
Aug 27 07:05:13 user nova-compute[73258]: DEBUG os_brick.utils [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c86ed20-ce35-4e54-bc23-65815c8800ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a87cef9-f347-4e01-ae86-c17c1c048536]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[138bb238-b844-49a3-ada7-3c6acf6a4395]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c814176-92e8-4f50-963f-cf5051225d9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:05:13 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 07:05:13 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[29aefd5d-4411-4807-b35e-6db9b6ed55a1]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG os_brick.utils [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updating existing volume attachment record: a0673cf0-5627-4bcb-97ab-196d19fe34f8 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 07:05:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:19 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:05:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JgkpTRIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:05:24 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:05:24 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:05:24 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d75e19c-32c3-425e-8b9c-b777f2ebc148]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 07:05:24 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3124c42-2470-4a4c-bdd4-ebb55f53c123]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc] added
Aug 27 07:05:24 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce94083-aab3-4705-9c50-4c24b722e2b2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[77121ae0-605a-44f8-942e-cd763f1f7034]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JgkpTRIm {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JgkpTRIm" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee8aab1-fbf7-4a46-b72f-77b99a273f7e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JgkpTRIm'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d247727c-ca96-4c23-af39-b833da492c96]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3342defd-ab31-480b-a736-a670cb2e4b9f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 07:05:24 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 07:05:24 user nova-compute[73258]:  {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:05:24 user nova-compute[73258]: WARNING os_brick.initiator.connectors.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 07:05:24 user nova-compute[73258]: 
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[72916e3a-b850-44c1-9c8e-12019a0b4123]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc, portal: 172.16.0.220,3260]
Aug 27 07:05:24 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc, portal: 172.16.0.220,3260] successful.
Aug 27 07:05:24 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9f9679-5b71-40e0-9f0e-734f478cc033]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfc0773-1158-42be-a6e4-b3abc5935763]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc (non-flash)
Aug 27 07:05:24 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc (non-flash)
Aug 27 07:05:24 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61552a5-9b60-4356-b7eb-2168a7c71cd4]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 07:05:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JgkpTRIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 07:05:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:05:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26365363033656263', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:05:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365363033656263', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 07:05:25 user nova-compute[73258]: DEBUG nova.objects.instance [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lazy-loading 'flavor' on Instance uuid 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:05:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 07:05:25 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:05:25 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 07:05:25 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 07:05:25 user nova-compute[73258]:   <serial>cf7d349d-98b5-4231-a474-fd64e4ca72cc</serial>
Aug 27 07:05:25 user nova-compute[73258]: </disk>
Aug 27 07:05:25 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 07:05:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:05:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:05:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] No VIF found with MAC fa:16:3e:f9:70:7e, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 07:05:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-8d669b1a-7fee-4e4b-91e0-bb843b23c3d4 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.102s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:05:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:05:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:05:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:05:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:05:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:05:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:05:29 user nova-compute[73258]: DEBUG nova.compute.manager [req-eabf5ec0-2cdf-4a3e-8b95-6020e3000d56 req-6d428c66-3bba-49d4-be83-f599ef4d1a20 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received event network-changed-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:05:29 user nova-compute[73258]: DEBUG nova.compute.manager [req-eabf5ec0-2cdf-4a3e-8b95-6020e3000d56 req-6d428c66-3bba-49d4-be83-f599ef4d1a20 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Refreshing instance network info cache due to event network-changed-3adbe18d-bad6-47d6-945a-d961251c1e6c. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:05:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-eabf5ec0-2cdf-4a3e-8b95-6020e3000d56 req-6d428c66-3bba-49d4-be83-f599ef4d1a20 service nova] Acquiring lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:05:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-eabf5ec0-2cdf-4a3e-8b95-6020e3000d56 req-6d428c66-3bba-49d4-be83-f599ef4d1a20 service nova] Acquired lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:05:29 user nova-compute[73258]: DEBUG nova.network.neutron [req-eabf5ec0-2cdf-4a3e-8b95-6020e3000d56 req-6d428c66-3bba-49d4-be83-f599ef4d1a20 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Refreshing network info cache for port 3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:05:30 user nova-compute[73258]: DEBUG nova.network.neutron [req-eabf5ec0-2cdf-4a3e-8b95-6020e3000d56 req-6d428c66-3bba-49d4-be83-f599ef4d1a20 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updated VIF entry in instance network info cache for port 3adbe18d-bad6-47d6-945a-d961251c1e6c. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:05:30 user nova-compute[73258]: DEBUG nova.network.neutron [req-eabf5ec0-2cdf-4a3e-8b95-6020e3000d56 req-6d428c66-3bba-49d4-be83-f599ef4d1a20 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updating instance_info_cache with network_info: [{"id": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "address": "fa:16:3e:f9:70:7e", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3adbe18d-ba", "ovs_interfaceid": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:05:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-eabf5ec0-2cdf-4a3e-8b95-6020e3000d56 req-6d428c66-3bba-49d4-be83-f599ef4d1a20 service nova] Releasing lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:05:31 user nova-compute[73258]: DEBUG nova.compute.manager [req-ac0184f0-3a1e-4158-9c56-8cea589f639d req-318de058-7a87-48ed-bee5-2c2d472e44f8 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received event network-changed-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:05:31 user nova-compute[73258]: DEBUG nova.compute.manager [req-ac0184f0-3a1e-4158-9c56-8cea589f639d req-318de058-7a87-48ed-bee5-2c2d472e44f8 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Refreshing instance network info cache due to event network-changed-3adbe18d-bad6-47d6-945a-d961251c1e6c. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:05:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ac0184f0-3a1e-4158-9c56-8cea589f639d req-318de058-7a87-48ed-bee5-2c2d472e44f8 service nova] Acquiring lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:05:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ac0184f0-3a1e-4158-9c56-8cea589f639d req-318de058-7a87-48ed-bee5-2c2d472e44f8 service nova] Acquired lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:05:31 user nova-compute[73258]: DEBUG nova.network.neutron [req-ac0184f0-3a1e-4158-9c56-8cea589f639d req-318de058-7a87-48ed-bee5-2c2d472e44f8 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Refreshing network info cache for port 3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:05:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1295451e-2c33-4135-a774-e9f616cf1e7e tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:05:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1295451e-2c33-4135-a774-e9f616cf1e7e tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:05:31 user nova-compute[73258]: INFO nova.compute.manager [None req-1295451e-2c33-4135-a774-e9f616cf1e7e tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Rebooting instance
Aug 27 07:05:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1295451e-2c33-4135-a774-e9f616cf1e7e tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:05:32 user nova-compute[73258]: DEBUG nova.network.neutron [req-ac0184f0-3a1e-4158-9c56-8cea589f639d req-318de058-7a87-48ed-bee5-2c2d472e44f8 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updated VIF entry in instance network info cache for port 3adbe18d-bad6-47d6-945a-d961251c1e6c. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:05:32 user nova-compute[73258]: DEBUG nova.network.neutron [req-ac0184f0-3a1e-4158-9c56-8cea589f639d req-318de058-7a87-48ed-bee5-2c2d472e44f8 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updating instance_info_cache with network_info: [{"id": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "address": "fa:16:3e:f9:70:7e", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3adbe18d-ba", "ovs_interfaceid": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:05:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ac0184f0-3a1e-4158-9c56-8cea589f639d req-318de058-7a87-48ed-bee5-2c2d472e44f8 service nova] Releasing lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:05:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1295451e-2c33-4135-a774-e9f616cf1e7e tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquired lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:05:32 user nova-compute[73258]: DEBUG nova.network.neutron [None req-1295451e-2c33-4135-a774-e9f616cf1e7e tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 07:05:32 user nova-compute[73258]: DEBUG nova.network.neutron [None req-1295451e-2c33-4135-a774-e9f616cf1e7e tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updating instance_info_cache with network_info: [{"id": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "address": "fa:16:3e:f9:70:7e", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3adbe18d-ba", "ovs_interfaceid": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:05:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1295451e-2c33-4135-a774-e9f616cf1e7e tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Releasing lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:05:32 user nova-compute[73258]: DEBUG nova.compute.manager [None req-1295451e-2c33-4135-a774-e9f616cf1e7e tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:05:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:05:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-b28d0e9f-ab58-44cc-adc2-d380257bcab0 req-905acc2c-63fa-450d-af02-096a92808b1e service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received event network-vif-unplugged-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:05:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b28d0e9f-ab58-44cc-adc2-d380257bcab0 req-905acc2c-63fa-450d-af02-096a92808b1e service nova] Acquiring lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:05:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b28d0e9f-ab58-44cc-adc2-d380257bcab0 req-905acc2c-63fa-450d-af02-096a92808b1e service nova] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:05:35 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b28d0e9f-ab58-44cc-adc2-d380257bcab0 req-905acc2c-63fa-450d-af02-096a92808b1e service nova] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:05:35 user nova-compute[73258]: DEBUG nova.compute.manager [req-b28d0e9f-ab58-44cc-adc2-d380257bcab0 req-905acc2c-63fa-450d-af02-096a92808b1e service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] No waiting events found dispatching network-vif-unplugged-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:05:35 user nova-compute[73258]: WARNING nova.compute.manager [req-b28d0e9f-ab58-44cc-adc2-d380257bcab0 req-905acc2c-63fa-450d-af02-096a92808b1e service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received unexpected event network-vif-unplugged-3adbe18d-bad6-47d6-945a-d961251c1e6c for instance with vm_state active and task_state reboot_started.
Aug 27 07:05:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:35 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-1295451e-2c33-4135-a774-e9f616cf1e7e tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Instance shutdown successfully.
Aug 27 07:05:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:37 user nova-compute[73258]: DEBUG nova.compute.manager [req-379b37bc-a6d0-4248-9501-d974f132bf33 req-b2d0b842-5b20-4755-b0cd-222468544280 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received event network-vif-plugged-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:05:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-379b37bc-a6d0-4248-9501-d974f132bf33 req-b2d0b842-5b20-4755-b0cd-222468544280 service nova] Acquiring lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:05:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-379b37bc-a6d0-4248-9501-d974f132bf33 req-b2d0b842-5b20-4755-b0cd-222468544280 service nova] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:05:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-379b37bc-a6d0-4248-9501-d974f132bf33 req-b2d0b842-5b20-4755-b0cd-222468544280 service nova] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:05:37 user nova-compute[73258]: DEBUG nova.compute.manager [req-379b37bc-a6d0-4248-9501-d974f132bf33 req-b2d0b842-5b20-4755-b0cd-222468544280 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] No waiting events found dispatching network-vif-plugged-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:05:37 user nova-compute[73258]: WARNING nova.compute.manager [req-379b37bc-a6d0-4248-9501-d974f132bf33 req-b2d0b842-5b20-4755-b0cd-222468544280 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received unexpected event network-vif-plugged-3adbe18d-bad6-47d6-945a-d961251c1e6c for instance with vm_state active and task_state reboot_started.
Aug 27 07:05:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:39 user nova-compute[73258]: DEBUG nova.compute.manager [req-47f5fb61-6c94-4fa8-a3d6-cb3f046f812b req-6f2556ed-0ff3-4d2b-9348-97ce70d70c64 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received event network-vif-plugged-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:05:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-47f5fb61-6c94-4fa8-a3d6-cb3f046f812b req-6f2556ed-0ff3-4d2b-9348-97ce70d70c64 service nova] Acquiring lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:05:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-47f5fb61-6c94-4fa8-a3d6-cb3f046f812b req-6f2556ed-0ff3-4d2b-9348-97ce70d70c64 service nova] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:05:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-47f5fb61-6c94-4fa8-a3d6-cb3f046f812b req-6f2556ed-0ff3-4d2b-9348-97ce70d70c64 service nova] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:05:39 user nova-compute[73258]: DEBUG nova.compute.manager [req-47f5fb61-6c94-4fa8-a3d6-cb3f046f812b req-6f2556ed-0ff3-4d2b-9348-97ce70d70c64 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] No waiting events found dispatching network-vif-plugged-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:05:39 user nova-compute[73258]: WARNING nova.compute.manager [req-47f5fb61-6c94-4fa8-a3d6-cb3f046f812b req-6f2556ed-0ff3-4d2b-9348-97ce70d70c64 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received unexpected event network-vif-plugged-3adbe18d-bad6-47d6-945a-d961251c1e6c for instance with vm_state active and task_state reboot_started.
Aug 27 07:05:39 user nova-compute[73258]: DEBUG nova.compute.manager [req-47f5fb61-6c94-4fa8-a3d6-cb3f046f812b req-6f2556ed-0ff3-4d2b-9348-97ce70d70c64 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received event network-vif-plugged-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:05:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-47f5fb61-6c94-4fa8-a3d6-cb3f046f812b req-6f2556ed-0ff3-4d2b-9348-97ce70d70c64 service nova] Acquiring lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:05:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-47f5fb61-6c94-4fa8-a3d6-cb3f046f812b req-6f2556ed-0ff3-4d2b-9348-97ce70d70c64 service nova] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:05:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-47f5fb61-6c94-4fa8-a3d6-cb3f046f812b req-6f2556ed-0ff3-4d2b-9348-97ce70d70c64 service nova] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:05:39 user nova-compute[73258]: DEBUG nova.compute.manager [req-47f5fb61-6c94-4fa8-a3d6-cb3f046f812b req-6f2556ed-0ff3-4d2b-9348-97ce70d70c64 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] No waiting events found dispatching network-vif-plugged-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:05:39 user nova-compute[73258]: WARNING nova.compute.manager [req-47f5fb61-6c94-4fa8-a3d6-cb3f046f812b req-6f2556ed-0ff3-4d2b-9348-97ce70d70c64 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received unexpected event network-vif-plugged-3adbe18d-bad6-47d6-945a-d961251c1e6c for instance with vm_state active and task_state reboot_started.
Aug 27 07:05:39 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Removed pending event for 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 due to event {{(pid=73258) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 07:05:39 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119939.4569478, 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:05:39 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] VM Resumed (Lifecycle Event)
Aug 27 07:05:39 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Instance running successfully.
Aug 27 07:05:39 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-1295451e-2c33-4135-a774-e9f616cf1e7e tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Instance soft rebooted successfully.
Aug 27 07:05:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-1295451e-2c33-4135-a774-e9f616cf1e7e tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:05:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:05:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:05:39 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 27 07:05:39 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119939.4604845, 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:05:39 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] VM Started (Lifecycle Event)
Aug 27 07:05:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:05:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1295451e-2c33-4135-a774-e9f616cf1e7e tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.589s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:05:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:05:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:56 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:05:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:05:59 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:05:59 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:05:59 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:06:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:00 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:06:00 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:06:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:01 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:06:02 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:06:02 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:06:02 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 07:06:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:06:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:06:03 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 07:06:03 user nova-compute[73258]: DEBUG nova.objects.instance [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lazy-loading 'info_cache' on Instance uuid 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:06:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:03 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updating instance_info_cache with network_info: [{"id": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "address": "fa:16:3e:f9:70:7e", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3adbe18d-ba", "ovs_interfaceid": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:06:03 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:06:03 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 07:06:03 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:06:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:07 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:06:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:06:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:06:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:06:07 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:06:07 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:06:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:08 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:06:08 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:06:08 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8670MB free_disk=23.899852752685547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:06:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:06:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:06:08 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:06:08 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:06:08 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:06:09 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:06:09 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:06:09 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:06:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:06:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Acquiring lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:06:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:06:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 07:06:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:06:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:06:13 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 07:06:13 user nova-compute[73258]: INFO nova.compute.claims [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Claim successful on node user
Aug 27 07:06:14 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 07:06:14 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 07:06:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG nova.policy [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11fe625c40184074bb14b810ebd03c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7776d299af40b8ac39f127185c4da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 07:06:14 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Creating image(s)
Aug 27 07:06:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Acquiring lock "/opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "/opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "/opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.227s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Acquiring lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.187s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk 1073741824 {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33,backing_fmt=raw /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk 1073741824" returned: 0 in 0.070s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "93f2e1ab1d6c088987f6f405f979a976f4e31c33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:06:14 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 --force-share --output=json" returned: 0 in 0.199s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk. size=1073741824 {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Successfully created port: 550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG nova.virt.disk.api [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Cannot resize image /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk to a smaller size. {{(pid=73258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Created local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Ensure instance console log exists: /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Successfully updated port: 550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Acquiring lock "refresh_cache-1570970a-1b5c-44f6-9326-e7574ce9fe6f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Acquired lock "refresh_cache-1570970a-1b5c-44f6-9326-e7574ce9fe6f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-480b514f-c4e1-4009-9140-840711fa0e79 req-c5a23b2e-bbbb-47cb-8f43-e4a5144558c2 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Received event network-changed-550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG nova.compute.manager [req-480b514f-c4e1-4009-9140-840711fa0e79 req-c5a23b2e-bbbb-47cb-8f43-e4a5144558c2 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Refreshing instance network info cache due to event network-changed-550bb78f-7337-4bae-90f0-f211ba6121ff. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-480b514f-c4e1-4009-9140-840711fa0e79 req-c5a23b2e-bbbb-47cb-8f43-e4a5144558c2 service nova] Acquiring lock "refresh_cache-1570970a-1b5c-44f6-9326-e7574ce9fe6f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:06:15 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.network.neutron [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Updating instance_info_cache with network_info: [{"id": "550bb78f-7337-4bae-90f0-f211ba6121ff", "address": "fa:16:3e:2a:96:e3", "network": {"id": "79c69f6d-d61f-45ee-aa36-bf268f40bb4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995097103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f7776d299af40b8ac39f127185c4da6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550bb78f-73", "ovs_interfaceid": "550bb78f-7337-4bae-90f0-f211ba6121ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Releasing lock "refresh_cache-1570970a-1b5c-44f6-9326-e7574ce9fe6f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Instance network_info: |[{"id": "550bb78f-7337-4bae-90f0-f211ba6121ff", "address": "fa:16:3e:2a:96:e3", "network": {"id": "79c69f6d-d61f-45ee-aa36-bf268f40bb4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995097103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f7776d299af40b8ac39f127185c4da6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550bb78f-73", "ovs_interfaceid": "550bb78f-7337-4bae-90f0-f211ba6121ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-480b514f-c4e1-4009-9140-840711fa0e79 req-c5a23b2e-bbbb-47cb-8f43-e4a5144558c2 service nova] Acquired lock "refresh_cache-1570970a-1b5c-44f6-9326-e7574ce9fe6f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.network.neutron [req-480b514f-c4e1-4009-9140-840711fa0e79 req-c5a23b2e-bbbb-47cb-8f43-e4a5144558c2 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Refreshing network info cache for port 550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Start _get_guest_xml network_info=[{"id": "550bb78f-7337-4bae-90f0-f211ba6121ff", "address": "fa:16:3e:2a:96:e3", "network": {"id": "79c69f6d-d61f-45ee-aa36-bf268f40bb4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995097103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f7776d299af40b8ac39f127185c4da6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550bb78f-73", "ovs_interfaceid": "550bb78f-7337-4bae-90f0-f211ba6121ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a1da8f3b-7558-465b-96c4-208255c7b142'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 07:06:16 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:06:16 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T06:32:57Z,direct_url=<?>,disk_format='qcow2',id=a1da8f3b-7558-465b-96c4-208255c7b142,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a0fe6064085e4553aeec775fb8e6faeb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T06:32:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-89791850',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-89791850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8979185',id=46,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0KpuyzXusK7mzegOgtnjk0jLroJypO95TAJQOhsgISCFhPWJh2FuU89LfBP9fxMyoiODIWNO/LXIvUqWT1PpPD0Qch7xgNNqb40fG8cDswbm7f6nGVh1hM2KK/6gfcCw==',key_name='tempest-keypair-1391875007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f7776d299af40b8ac39f127185c4da6',ramdisk_id='',reservation_id='r-0cb424qt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-149034104',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11fe625c40184074bb14b810ebd03c00',uuid=1570970a-1b5c-44f6-9326-e7574ce9fe6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "550bb78f-7337-4bae-90f0-f211ba6121ff", "address": "fa:16:3e:2a:96:e3", "network": {"id": "79c69f6d-d61f-45ee-aa36-bf268f40bb4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995097103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f7776d299af40b8ac39f127185c4da6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550bb78f-73", "ovs_interfaceid": "550bb78f-7337-4bae-90f0-f211ba6121ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Converting VIF {"id": "550bb78f-7337-4bae-90f0-f211ba6121ff", "address": "fa:16:3e:2a:96:e3", "network": {"id": "79c69f6d-d61f-45ee-aa36-bf268f40bb4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995097103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f7776d299af40b8ac39f127185c4da6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550bb78f-73", "ovs_interfaceid": "550bb78f-7337-4bae-90f0-f211ba6121ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:96:e3,bridge_name='br-int',has_traffic_filtering=True,id=550bb78f-7337-4bae-90f0-f211ba6121ff,network=Network(79c69f6d-d61f-45ee-aa36-bf268f40bb4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550bb78f-73') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.objects.instance [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lazy-loading 'pci_devices' on Instance uuid 1570970a-1b5c-44f6-9326-e7574ce9fe6f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 07:06:16 user nova-compute[73258]:   <uuid>1570970a-1b5c-44f6-9326-e7574ce9fe6f</uuid>
Aug 27 07:06:16 user nova-compute[73258]:   <name>instance-0000002e</name>
Aug 27 07:06:16 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 07:06:16 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 07:06:16 user nova-compute[73258]:   <metadata>
Aug 27 07:06:16 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 07:06:16 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 07:06:16 user nova-compute[73258]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-89791850</nova:name>
Aug 27 07:06:16 user nova-compute[73258]:       <nova:creationTime>2023-08-27 07:06:16</nova:creationTime>
Aug 27 07:06:16 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 07:06:16 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 07:06:16 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 07:06:16 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 07:06:16 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 07:06:16 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 07:06:16 user nova-compute[73258]:       </nova:flavor>
Aug 27 07:06:16 user nova-compute[73258]:       <nova:owner>
Aug 27 07:06:16 user nova-compute[73258]:         <nova:user uuid="11fe625c40184074bb14b810ebd03c00">tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member</nova:user>
Aug 27 07:06:16 user nova-compute[73258]:         <nova:project uuid="0f7776d299af40b8ac39f127185c4da6">tempest-TestServerVolumeAttachScenarioOldVersion-149034104</nova:project>
Aug 27 07:06:16 user nova-compute[73258]:       </nova:owner>
Aug 27 07:06:16 user nova-compute[73258]:       <nova:root type="image" uuid="a1da8f3b-7558-465b-96c4-208255c7b142"/>
Aug 27 07:06:16 user nova-compute[73258]:       <nova:ports>
Aug 27 07:06:16 user nova-compute[73258]:         <nova:port uuid="550bb78f-7337-4bae-90f0-f211ba6121ff">
Aug 27 07:06:16 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 07:06:16 user nova-compute[73258]:         </nova:port>
Aug 27 07:06:16 user nova-compute[73258]:       </nova:ports>
Aug 27 07:06:16 user nova-compute[73258]:     </nova:instance>
Aug 27 07:06:16 user nova-compute[73258]:   </metadata>
Aug 27 07:06:16 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 07:06:16 user nova-compute[73258]:     <system>
Aug 27 07:06:16 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 07:06:16 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 07:06:16 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 07:06:16 user nova-compute[73258]:       <entry name="serial">1570970a-1b5c-44f6-9326-e7574ce9fe6f</entry>
Aug 27 07:06:16 user nova-compute[73258]:       <entry name="uuid">1570970a-1b5c-44f6-9326-e7574ce9fe6f</entry>
Aug 27 07:06:16 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 07:06:16 user nova-compute[73258]:     </system>
Aug 27 07:06:16 user nova-compute[73258]:   </sysinfo>
Aug 27 07:06:16 user nova-compute[73258]:   <os>
Aug 27 07:06:16 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 07:06:16 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 07:06:16 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 07:06:16 user nova-compute[73258]:   </os>
Aug 27 07:06:16 user nova-compute[73258]:   <features>
Aug 27 07:06:16 user nova-compute[73258]:     <acpi/>
Aug 27 07:06:16 user nova-compute[73258]:     <apic/>
Aug 27 07:06:16 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 07:06:16 user nova-compute[73258]:   </features>
Aug 27 07:06:16 user nova-compute[73258]:   <clock offset="utc">
Aug 27 07:06:16 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 07:06:16 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 07:06:16 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 07:06:16 user nova-compute[73258]:   </clock>
Aug 27 07:06:16 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 07:06:16 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 07:06:16 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 07:06:16 user nova-compute[73258]:   </cpu>
Aug 27 07:06:16 user nova-compute[73258]:   <devices>
Aug 27 07:06:16 user nova-compute[73258]:     <disk type="file" device="disk">
Aug 27 07:06:16 user nova-compute[73258]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 07:06:16 user nova-compute[73258]:       <source file="/opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk"/>
Aug 27 07:06:16 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 07:06:16 user nova-compute[73258]:     </disk>
Aug 27 07:06:16 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 07:06:16 user nova-compute[73258]:       <mac address="fa:16:3e:2a:96:e3"/>
Aug 27 07:06:16 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:06:16 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 07:06:16 user nova-compute[73258]:       <target dev="tap550bb78f-73"/>
Aug 27 07:06:16 user nova-compute[73258]:     </interface>
Aug 27 07:06:16 user nova-compute[73258]:     <serial type="pty">
Aug 27 07:06:16 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/console.log" append="off"/>
Aug 27 07:06:16 user nova-compute[73258]:     </serial>
Aug 27 07:06:16 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 07:06:16 user nova-compute[73258]:     <video>
Aug 27 07:06:16 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:06:16 user nova-compute[73258]:     </video>
Aug 27 07:06:16 user nova-compute[73258]:     <rng model="virtio">
Aug 27 07:06:16 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 07:06:16 user nova-compute[73258]:     </rng>
Aug 27 07:06:16 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 07:06:16 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 07:06:16 user nova-compute[73258]:       <stats period="10"/>
Aug 27 07:06:16 user nova-compute[73258]:     </memballoon>
Aug 27 07:06:16 user nova-compute[73258]:   </devices>
Aug 27 07:06:16 user nova-compute[73258]: </domain>
Aug 27 07:06:16 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-89791850',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-89791850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8979185',id=46,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0KpuyzXusK7mzegOgtnjk0jLroJypO95TAJQOhsgISCFhPWJh2FuU89LfBP9fxMyoiODIWNO/LXIvUqWT1PpPD0Qch7xgNNqb40fG8cDswbm7f6nGVh1hM2KK/6gfcCw==',key_name='tempest-keypair-1391875007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f7776d299af40b8ac39f127185c4da6',ramdisk_id='',reservation_id='r-0cb424qt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-149034104',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11fe625c40184074bb14b810ebd03c00',uuid=1570970a-1b5c-44f6-9326-e7574ce9fe6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "550bb78f-7337-4bae-90f0-f211ba6121ff", "address": "fa:16:3e:2a:96:e3", "network": {"id": "79c69f6d-d61f-45ee-aa36-bf268f40bb4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995097103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f7776d299af40b8ac39f127185c4da6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550bb78f-73", "ovs_interfaceid": "550bb78f-7337-4bae-90f0-f211ba6121ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Converting VIF {"id": "550bb78f-7337-4bae-90f0-f211ba6121ff", "address": "fa:16:3e:2a:96:e3", "network": {"id": "79c69f6d-d61f-45ee-aa36-bf268f40bb4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995097103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f7776d299af40b8ac39f127185c4da6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550bb78f-73", "ovs_interfaceid": "550bb78f-7337-4bae-90f0-f211ba6121ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:96:e3,bridge_name='br-int',has_traffic_filtering=True,id=550bb78f-7337-4bae-90f0-f211ba6121ff,network=Network(79c69f6d-d61f-45ee-aa36-bf268f40bb4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550bb78f-73') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG os_vif [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:96:e3,bridge_name='br-int',has_traffic_filtering=True,id=550bb78f-7337-4bae-90f0-f211ba6121ff,network=Network(79c69f6d-d61f-45ee-aa36-bf268f40bb4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550bb78f-73') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap550bb78f-73, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap550bb78f-73, col_values=(('external_ids', {'iface-id': '550bb78f-7337-4bae-90f0-f211ba6121ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:96:e3', 'vm-uuid': '1570970a-1b5c-44f6-9326-e7574ce9fe6f'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:16 user nova-compute[73258]: INFO os_vif [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:96:e3,bridge_name='br-int',has_traffic_filtering=True,id=550bb78f-7337-4bae-90f0-f211ba6121ff,network=Network(79c69f6d-d61f-45ee-aa36-bf268f40bb4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550bb78f-73')
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] No VIF found with MAC fa:16:3e:2a:96:e3, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.network.neutron [req-480b514f-c4e1-4009-9140-840711fa0e79 req-c5a23b2e-bbbb-47cb-8f43-e4a5144558c2 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Updated VIF entry in instance network info cache for port 550bb78f-7337-4bae-90f0-f211ba6121ff. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG nova.network.neutron [req-480b514f-c4e1-4009-9140-840711fa0e79 req-c5a23b2e-bbbb-47cb-8f43-e4a5144558c2 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Updating instance_info_cache with network_info: [{"id": "550bb78f-7337-4bae-90f0-f211ba6121ff", "address": "fa:16:3e:2a:96:e3", "network": {"id": "79c69f6d-d61f-45ee-aa36-bf268f40bb4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995097103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f7776d299af40b8ac39f127185c4da6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550bb78f-73", "ovs_interfaceid": "550bb78f-7337-4bae-90f0-f211ba6121ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:06:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-480b514f-c4e1-4009-9140-840711fa0e79 req-c5a23b2e-bbbb-47cb-8f43-e4a5144558c2 service nova] Releasing lock "refresh_cache-1570970a-1b5c-44f6-9326-e7574ce9fe6f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:06:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "073ddd85-25de-4765-89e1-2fec03f131b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:06:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "073ddd85-25de-4765-89e1-2fec03f131b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:06:17 user nova-compute[73258]: DEBUG nova.compute.manager [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 07:06:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:06:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:06:17 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 07:06:17 user nova-compute[73258]: INFO nova.compute.claims [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Claim successful on node user
Aug 27 07:06:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-c1833d15-6b68-4ecb-a515-f07819e25275 req-6f9406ec-d235-492a-921a-28de5eb49045 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Received event network-vif-plugged-550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:06:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c1833d15-6b68-4ecb-a515-f07819e25275 req-6f9406ec-d235-492a-921a-28de5eb49045 service nova] Acquiring lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:06:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c1833d15-6b68-4ecb-a515-f07819e25275 req-6f9406ec-d235-492a-921a-28de5eb49045 service nova] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:06:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-c1833d15-6b68-4ecb-a515-f07819e25275 req-6f9406ec-d235-492a-921a-28de5eb49045 service nova] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:06:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-c1833d15-6b68-4ecb-a515-f07819e25275 req-6f9406ec-d235-492a-921a-28de5eb49045 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] No waiting events found dispatching network-vif-plugged-550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:06:17 user nova-compute[73258]: WARNING nova.compute.manager [req-c1833d15-6b68-4ecb-a515-f07819e25275 req-6f9406ec-d235-492a-921a-28de5eb49045 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Received unexpected event network-vif-plugged-550bb78f-7337-4bae-90f0-f211ba6121ff for instance with vm_state building and task_state spawning.
Aug 27 07:06:17 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:06:17 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:06:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:06:17 user nova-compute[73258]: DEBUG nova.compute.manager [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 07:06:17 user nova-compute[73258]: DEBUG nova.compute.manager [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 07:06:17 user nova-compute[73258]: DEBUG nova.network.neutron [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 07:06:17 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 07:06:18 user nova-compute[73258]: DEBUG nova.compute.manager [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 07:06:18 user nova-compute[73258]: DEBUG nova.policy [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75d7a7c63b654c47b9df519798186007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002188a1020a4181a03ce17d46608664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 07:06:18 user nova-compute[73258]: INFO nova.virt.block_device [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Booting with volume snapshot f86df269-b1c1-4b25-9243-b720f9e593c4 at /dev/vda
Aug 27 07:06:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:18 user nova-compute[73258]: DEBUG nova.network.neutron [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Successfully created port: dda2a49a-710f-4a0b-bfae-401437641410 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.network.neutron [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Successfully updated port: dda2a49a-710f-4a0b-bfae-401437641410 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "refresh_cache-073ddd85-25de-4765-89e1-2fec03f131b7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquired lock "refresh_cache-073ddd85-25de-4765-89e1-2fec03f131b7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.network.neutron [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.network.neutron [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-edebf397-8de3-4e56-adad-6e4bebd95427 req-1c4da049-f2f3-4971-87e3-e2b5b81afbcf service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Received event network-changed-dda2a49a-710f-4a0b-bfae-401437641410 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-edebf397-8de3-4e56-adad-6e4bebd95427 req-1c4da049-f2f3-4971-87e3-e2b5b81afbcf service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Refreshing instance network info cache due to event network-changed-dda2a49a-710f-4a0b-bfae-401437641410. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-edebf397-8de3-4e56-adad-6e4bebd95427 req-1c4da049-f2f3-4971-87e3-e2b5b81afbcf service nova] Acquiring lock "refresh_cache-073ddd85-25de-4765-89e1-2fec03f131b7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119979.7875612, 1570970a-1b5c-44f6-9326-e7574ce9fe6f => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:06:19 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] VM Resumed (Lifecycle Event)
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 07:06:19 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Instance spawned successfully.
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-44a21d8f-484a-4ec4-a046-75521b6d2835 req-43bb1fc2-5c82-49fd-9dcd-e3311a532cc4 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Received event network-vif-plugged-550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-44a21d8f-484a-4ec4-a046-75521b6d2835 req-43bb1fc2-5c82-49fd-9dcd-e3311a532cc4 service nova] Acquiring lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-44a21d8f-484a-4ec4-a046-75521b6d2835 req-43bb1fc2-5c82-49fd-9dcd-e3311a532cc4 service nova] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-44a21d8f-484a-4ec4-a046-75521b6d2835 req-43bb1fc2-5c82-49fd-9dcd-e3311a532cc4 service nova] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-44a21d8f-484a-4ec4-a046-75521b6d2835 req-43bb1fc2-5c82-49fd-9dcd-e3311a532cc4 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] No waiting events found dispatching network-vif-plugged-550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:06:19 user nova-compute[73258]: WARNING nova.compute.manager [req-44a21d8f-484a-4ec4-a046-75521b6d2835 req-43bb1fc2-5c82-49fd-9dcd-e3311a532cc4 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Received unexpected event network-vif-plugged-550bb78f-7337-4bae-90f0-f211ba6121ff for instance with vm_state building and task_state spawning.
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:06:19 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119979.791407, 1570970a-1b5c-44f6-9326-e7574ce9fe6f => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:06:19 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] VM Started (Lifecycle Event)
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:06:19 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:06:19 user nova-compute[73258]: INFO nova.compute.manager [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Took 5.56 seconds to spawn the instance on the hypervisor.
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.network.neutron [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Updating instance_info_cache with network_info: [{"id": "dda2a49a-710f-4a0b-bfae-401437641410", "address": "fa:16:3e:2e:2a:08", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2a49a-71", "ovs_interfaceid": "dda2a49a-710f-4a0b-bfae-401437641410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Releasing lock "refresh_cache-073ddd85-25de-4765-89e1-2fec03f131b7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Instance network_info: |[{"id": "dda2a49a-710f-4a0b-bfae-401437641410", "address": "fa:16:3e:2e:2a:08", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2a49a-71", "ovs_interfaceid": "dda2a49a-710f-4a0b-bfae-401437641410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-edebf397-8de3-4e56-adad-6e4bebd95427 req-1c4da049-f2f3-4971-87e3-e2b5b81afbcf service nova] Acquired lock "refresh_cache-073ddd85-25de-4765-89e1-2fec03f131b7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:06:19 user nova-compute[73258]: DEBUG nova.network.neutron [req-edebf397-8de3-4e56-adad-6e4bebd95427 req-1c4da049-f2f3-4971-87e3-e2b5b81afbcf service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Refreshing network info cache for port dda2a49a-710f-4a0b-bfae-401437641410 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:06:20 user nova-compute[73258]: INFO nova.compute.manager [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Took 6.12 seconds to build instance.
Aug 27 07:06:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-a28ba011-5a02-41b4-933b-ca4265f12c61 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.228s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:06:20 user nova-compute[73258]: DEBUG nova.network.neutron [req-edebf397-8de3-4e56-adad-6e4bebd95427 req-1c4da049-f2f3-4971-87e3-e2b5b81afbcf service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Updated VIF entry in instance network info cache for port dda2a49a-710f-4a0b-bfae-401437641410. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:06:20 user nova-compute[73258]: DEBUG nova.network.neutron [req-edebf397-8de3-4e56-adad-6e4bebd95427 req-1c4da049-f2f3-4971-87e3-e2b5b81afbcf service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Updating instance_info_cache with network_info: [{"id": "dda2a49a-710f-4a0b-bfae-401437641410", "address": "fa:16:3e:2e:2a:08", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2a49a-71", "ovs_interfaceid": "dda2a49a-710f-4a0b-bfae-401437641410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:06:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-edebf397-8de3-4e56-adad-6e4bebd95427 req-1c4da049-f2f3-4971-87e3-e2b5b81afbcf service nova] Releasing lock "refresh_cache-073ddd85-25de-4765-89e1-2fec03f131b7" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:06:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG os_brick.utils [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[733b8080-90b1-4bf8-84c7-beb6784d723f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb7df6b-72c1-4168-bb02-d87b166bb128]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[57db5b63-6759-4aa5-9809-087d872b45a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0852c02f-4471-4606-be9d-8955326c28cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:06:23 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 07:06:23 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bd784e-7f89-44c2-b896-2e6382dd5564]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG os_brick.utils [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:06:23 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Updating existing volume attachment record: b476131a-cb6c-4564-9b01-5a9324624580 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 07:06:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:06:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:06:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:06:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:06:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:34 user nova-compute[73258]: DEBUG nova.compute.manager [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 07:06:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 07:06:34 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Creating image(s)
Aug 27 07:06:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Did not create local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 07:06:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Ensure instance console log exists: /opt/stack/data/nova/instances/073ddd85-25de-4765-89e1-2fec03f131b7/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 07:06:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:06:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:06:34 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:06:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Start _get_guest_xml network_info=[{"id": "dda2a49a-710f-4a0b-bfae-401437641410", "address": "fa:16:3e:2e:2a:08", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2a49a-71", "ovs_interfaceid": "dda2a49a-710f-4a0b-bfae-401437641410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sZEfukAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '073ddd85-25de-4765-89e1-2fec03f131b7', 'attached_at': '', 'detached_at': '', 'volume_id': '63d8fc8a-1b86-4dee-8d57-8482a9de1038', 'serial': '63d8fc8a-1b86-4dee-8d57-8482a9de1038'}, 'attachment_id': 'b476131a-cb6c-4564-9b01-5a9324624580', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 07:06:34 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:06:34 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:06:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 07:06:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 07:06:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 07:06:34 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sZEfukAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:06:35 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:06:35 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:06:35 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 07:06:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6039e43e-aa7b-4999-8288-b0d2108afd5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 07:06:35 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53c6883-7ba3-48bf-970b-cba00cfac160]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038] added
Aug 27 07:06:35 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d65a9ed-2b75-4544-a6f0-65e3dfc46059]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf1e3df-b3e3-4c5a-96fb-24af1d8f7b3f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sZEfukAx {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sZEfukAx" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d435a7-6724-4ef2-bf76-a78078328eca]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sZEfukAx'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[50891aa4-0fe6-494c-ad47-6cf149e4c1c1]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[02492d3a-1c84-49c6-81a2-eb777f7f1320]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc (non-flash)
Aug 27 07:06:35 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc (non-flash)
Aug 27 07:06:35 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c89292d-f6fc-4f50-9483-5c2dcadc5dfa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038, portal: 172.16.0.220,3260]
Aug 27 07:06:35 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038, portal: 172.16.0.220,3260] successful.
Aug 27 07:06:35 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3651ee15-63ad-42f7-a9ea-c4d019e72297]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc347faa-b80c-4a64-8dfe-0933d37e8652]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc (non-flash)
Aug 27 07:06:35 user nova-compute[73258]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 (non-flash)
Aug 27 07:06:35 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc (non-flash)
Aug 27 07:06:35 user nova-compute[73258]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 (non-flash)
Aug 27 07:06:35 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3089fa66-f245-4e8e-b7c0-4cc0bdfa5189]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 07:06:35 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sZEfukAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23136613237363562', 'path': '/dev/sdc'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136613237363562', 'path': '/dev/sdc'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-174830906',display_name='tempest-TestVolumeBootPattern-server-174830906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-174830906',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='002188a1020a4181a03ce17d46608664',ramdisk_id='',reservation_id='r-diql7e9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-833647414',owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:06:18Z,user_data=None,user_id='75d7a7c63b654c47b9df519798186007',uuid=073ddd85-25de-4765-89e1-2fec03f131b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dda2a49a-710f-4a0b-bfae-401437641410", "address": "fa:16:3e:2e:2a:08", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2a49a-71", "ovs_interfaceid": "dda2a49a-710f-4a0b-bfae-401437641410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converting VIF {"id": "dda2a49a-710f-4a0b-bfae-401437641410", "address": "fa:16:3e:2e:2a:08", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2a49a-71", "ovs_interfaceid": "dda2a49a-710f-4a0b-bfae-401437641410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=dda2a49a-710f-4a0b-bfae-401437641410,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda2a49a-71') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG nova.objects.instance [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lazy-loading 'pci_devices' on Instance uuid 073ddd85-25de-4765-89e1-2fec03f131b7 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] End _get_guest_xml xml=<domain type="kvm">
Aug 27 07:06:36 user nova-compute[73258]:   <uuid>073ddd85-25de-4765-89e1-2fec03f131b7</uuid>
Aug 27 07:06:36 user nova-compute[73258]:   <name>instance-0000002f</name>
Aug 27 07:06:36 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 07:06:36 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 07:06:36 user nova-compute[73258]:   <metadata>
Aug 27 07:06:36 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 07:06:36 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 07:06:36 user nova-compute[73258]:       <nova:name>tempest-TestVolumeBootPattern-server-174830906</nova:name>
Aug 27 07:06:36 user nova-compute[73258]:       <nova:creationTime>2023-08-27 07:06:34</nova:creationTime>
Aug 27 07:06:36 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 07:06:36 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 07:06:36 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 07:06:36 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 07:06:36 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 07:06:36 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 07:06:36 user nova-compute[73258]:       </nova:flavor>
Aug 27 07:06:36 user nova-compute[73258]:       <nova:owner>
Aug 27 07:06:36 user nova-compute[73258]:         <nova:user uuid="75d7a7c63b654c47b9df519798186007">tempest-TestVolumeBootPattern-833647414-project-member</nova:user>
Aug 27 07:06:36 user nova-compute[73258]:         <nova:project uuid="002188a1020a4181a03ce17d46608664">tempest-TestVolumeBootPattern-833647414</nova:project>
Aug 27 07:06:36 user nova-compute[73258]:       </nova:owner>
Aug 27 07:06:36 user nova-compute[73258]:       <nova:ports>
Aug 27 07:06:36 user nova-compute[73258]:         <nova:port uuid="dda2a49a-710f-4a0b-bfae-401437641410">
Aug 27 07:06:36 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 07:06:36 user nova-compute[73258]:         </nova:port>
Aug 27 07:06:36 user nova-compute[73258]:       </nova:ports>
Aug 27 07:06:36 user nova-compute[73258]:     </nova:instance>
Aug 27 07:06:36 user nova-compute[73258]:   </metadata>
Aug 27 07:06:36 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 07:06:36 user nova-compute[73258]:     <system>
Aug 27 07:06:36 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 07:06:36 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 07:06:36 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 07:06:36 user nova-compute[73258]:       <entry name="serial">073ddd85-25de-4765-89e1-2fec03f131b7</entry>
Aug 27 07:06:36 user nova-compute[73258]:       <entry name="uuid">073ddd85-25de-4765-89e1-2fec03f131b7</entry>
Aug 27 07:06:36 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 07:06:36 user nova-compute[73258]:     </system>
Aug 27 07:06:36 user nova-compute[73258]:   </sysinfo>
Aug 27 07:06:36 user nova-compute[73258]:   <os>
Aug 27 07:06:36 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 07:06:36 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 07:06:36 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 07:06:36 user nova-compute[73258]:   </os>
Aug 27 07:06:36 user nova-compute[73258]:   <features>
Aug 27 07:06:36 user nova-compute[73258]:     <acpi/>
Aug 27 07:06:36 user nova-compute[73258]:     <apic/>
Aug 27 07:06:36 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 07:06:36 user nova-compute[73258]:   </features>
Aug 27 07:06:36 user nova-compute[73258]:   <clock offset="utc">
Aug 27 07:06:36 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 07:06:36 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 07:06:36 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 07:06:36 user nova-compute[73258]:   </clock>
Aug 27 07:06:36 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 07:06:36 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 07:06:36 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 07:06:36 user nova-compute[73258]:   </cpu>
Aug 27 07:06:36 user nova-compute[73258]:   <devices>
Aug 27 07:06:36 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 07:06:36 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:06:36 user nova-compute[73258]:       <source dev="/dev/sdc"/>
Aug 27 07:06:36 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 07:06:36 user nova-compute[73258]:       <serial>63d8fc8a-1b86-4dee-8d57-8482a9de1038</serial>
Aug 27 07:06:36 user nova-compute[73258]:     </disk>
Aug 27 07:06:36 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 07:06:36 user nova-compute[73258]:       <mac address="fa:16:3e:2e:2a:08"/>
Aug 27 07:06:36 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:06:36 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 07:06:36 user nova-compute[73258]:       <target dev="tapdda2a49a-71"/>
Aug 27 07:06:36 user nova-compute[73258]:     </interface>
Aug 27 07:06:36 user nova-compute[73258]:     <serial type="pty">
Aug 27 07:06:36 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/073ddd85-25de-4765-89e1-2fec03f131b7/console.log" append="off"/>
Aug 27 07:06:36 user nova-compute[73258]:     </serial>
Aug 27 07:06:36 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 07:06:36 user nova-compute[73258]:     <video>
Aug 27 07:06:36 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:06:36 user nova-compute[73258]:     </video>
Aug 27 07:06:36 user nova-compute[73258]:     <rng model="virtio">
Aug 27 07:06:36 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 07:06:36 user nova-compute[73258]:     </rng>
Aug 27 07:06:36 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 07:06:36 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 07:06:36 user nova-compute[73258]:       <stats period="10"/>
Aug 27 07:06:36 user nova-compute[73258]:     </memballoon>
Aug 27 07:06:36 user nova-compute[73258]:   </devices>
Aug 27 07:06:36 user nova-compute[73258]: </domain>
Aug 27 07:06:36 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-174830906',display_name='tempest-TestVolumeBootPattern-server-174830906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-174830906',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='002188a1020a4181a03ce17d46608664',ramdisk_id='',reservation_id='r-diql7e9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-833647414',owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:06:18Z,user_data=None,user_id='75d7a7c63b654c47b9df519798186007',uuid=073ddd85-25de-4765-89e1-2fec03f131b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dda2a49a-710f-4a0b-bfae-401437641410", "address": "fa:16:3e:2e:2a:08", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2a49a-71", "ovs_interfaceid": "dda2a49a-710f-4a0b-bfae-401437641410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converting VIF {"id": "dda2a49a-710f-4a0b-bfae-401437641410", "address": "fa:16:3e:2e:2a:08", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2a49a-71", "ovs_interfaceid": "dda2a49a-710f-4a0b-bfae-401437641410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=dda2a49a-710f-4a0b-bfae-401437641410,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda2a49a-71') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG os_vif [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=dda2a49a-710f-4a0b-bfae-401437641410,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda2a49a-71') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdda2a49a-71, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdda2a49a-71, col_values=(('external_ids', {'iface-id': 'dda2a49a-710f-4a0b-bfae-401437641410', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:2a:08', 'vm-uuid': '073ddd85-25de-4765-89e1-2fec03f131b7'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:36 user nova-compute[73258]: INFO os_vif [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=dda2a49a-710f-4a0b-bfae-401437641410,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda2a49a-71')
Aug 27 07:06:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:06:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] No VIF found with MAC fa:16:3e:2e:2a:08, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 07:06:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:37 user nova-compute[73258]: DEBUG nova.compute.manager [req-37f40a30-27e2-4ea9-b0db-6a6fbde5df75 req-0a77199f-101c-4bad-bf6c-d7c8981027f3 service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Received event network-vif-plugged-dda2a49a-710f-4a0b-bfae-401437641410 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:06:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-37f40a30-27e2-4ea9-b0db-6a6fbde5df75 req-0a77199f-101c-4bad-bf6c-d7c8981027f3 service nova] Acquiring lock "073ddd85-25de-4765-89e1-2fec03f131b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:06:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-37f40a30-27e2-4ea9-b0db-6a6fbde5df75 req-0a77199f-101c-4bad-bf6c-d7c8981027f3 service nova] Lock "073ddd85-25de-4765-89e1-2fec03f131b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:06:37 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-37f40a30-27e2-4ea9-b0db-6a6fbde5df75 req-0a77199f-101c-4bad-bf6c-d7c8981027f3 service nova] Lock "073ddd85-25de-4765-89e1-2fec03f131b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:06:37 user nova-compute[73258]: DEBUG nova.compute.manager [req-37f40a30-27e2-4ea9-b0db-6a6fbde5df75 req-0a77199f-101c-4bad-bf6c-d7c8981027f3 service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] No waiting events found dispatching network-vif-plugged-dda2a49a-710f-4a0b-bfae-401437641410 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:06:37 user nova-compute[73258]: WARNING nova.compute.manager [req-37f40a30-27e2-4ea9-b0db-6a6fbde5df75 req-0a77199f-101c-4bad-bf6c-d7c8981027f3 service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Received unexpected event network-vif-plugged-dda2a49a-710f-4a0b-bfae-401437641410 for instance with vm_state building and task_state spawning.
Aug 27 07:06:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 07:06:39 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 07:06:39 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119999.8334548, 073ddd85-25de-4765-89e1-2fec03f131b7 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:06:39 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] VM Resumed (Lifecycle Event)
Aug 27 07:06:39 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Instance spawned successfully.
Aug 27 07:06:39 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 07:06:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:06:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:06:39 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:06:39 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:06:39 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:06:39 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:06:39 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:06:39 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:06:39 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:06:39 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693119999.8340547, 073ddd85-25de-4765-89e1-2fec03f131b7 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:06:39 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] VM Started (Lifecycle Event)
Aug 27 07:06:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:06:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:06:39 user nova-compute[73258]: INFO nova.compute.manager [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Took 4.97 seconds to spawn the instance on the hypervisor.
Aug 27 07:06:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:06:39 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:06:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:40 user nova-compute[73258]: DEBUG nova.compute.manager [req-ebeee541-c47d-4d8c-9e09-1a02c28f6a96 req-9adfd986-7c93-47e7-98cc-15817e37db7b service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Received event network-vif-plugged-dda2a49a-710f-4a0b-bfae-401437641410 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:06:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ebeee541-c47d-4d8c-9e09-1a02c28f6a96 req-9adfd986-7c93-47e7-98cc-15817e37db7b service nova] Acquiring lock "073ddd85-25de-4765-89e1-2fec03f131b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:06:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ebeee541-c47d-4d8c-9e09-1a02c28f6a96 req-9adfd986-7c93-47e7-98cc-15817e37db7b service nova] Lock "073ddd85-25de-4765-89e1-2fec03f131b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:06:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ebeee541-c47d-4d8c-9e09-1a02c28f6a96 req-9adfd986-7c93-47e7-98cc-15817e37db7b service nova] Lock "073ddd85-25de-4765-89e1-2fec03f131b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:06:40 user nova-compute[73258]: DEBUG nova.compute.manager [req-ebeee541-c47d-4d8c-9e09-1a02c28f6a96 req-9adfd986-7c93-47e7-98cc-15817e37db7b service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] No waiting events found dispatching network-vif-plugged-dda2a49a-710f-4a0b-bfae-401437641410 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:06:40 user nova-compute[73258]: WARNING nova.compute.manager [req-ebeee541-c47d-4d8c-9e09-1a02c28f6a96 req-9adfd986-7c93-47e7-98cc-15817e37db7b service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Received unexpected event network-vif-plugged-dda2a49a-710f-4a0b-bfae-401437641410 for instance with vm_state building and task_state spawning.
Aug 27 07:06:40 user nova-compute[73258]: INFO nova.compute.manager [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Took 22.48 seconds to build instance.
Aug 27 07:06:40 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-765ce9af-2f42-4ec1-a907-5eccee8bcdac tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "073ddd85-25de-4765-89e1-2fec03f131b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.586s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:06:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:06:59 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:07:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:07:00 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:07:00 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:07:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:07:01 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:07:01 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:07:01 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:07:02 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:07:04 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:07:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:07:04 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 07:07:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:07:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:07:04 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 07:07:04 user nova-compute[73258]: DEBUG nova.objects.instance [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lazy-loading 'info_cache' on Instance uuid 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:07:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:07:05 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updating instance_info_cache with network_info: [{"id": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "address": "fa:16:3e:f9:70:7e", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3adbe18d-ba", "ovs_interfaceid": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:07:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:07:05 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 07:07:05 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:07:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:07:07 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:07:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:07:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:07:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:07:07 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:07:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:07:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:07:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:07:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:07:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:07:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:07:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:07:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:07:08 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:07:08 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:07:09 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:07:09 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:07:09 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8296MB free_disk=23.868698120117188GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:07:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:07:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:07:09 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:07:09 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1570970a-1b5c-44f6-9326-e7574ce9fe6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:07:09 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 073ddd85-25de-4765-89e1-2fec03f131b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:07:09 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:07:09 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:07:09 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:07:09 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:07:09 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:07:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:07:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:07:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:07:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:07:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:07:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:07:23 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:07:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:07:23 user nova-compute[73258]: DEBUG nova.compute.manager [req-db95c13b-c522-493a-bc44-717d70c33b83 req-2221b4f7-e05b-4998-80f5-a5a823c3884b service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received event network-changed-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:07:23 user nova-compute[73258]: DEBUG nova.compute.manager [req-db95c13b-c522-493a-bc44-717d70c33b83 req-2221b4f7-e05b-4998-80f5-a5a823c3884b service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Refreshing instance network info cache due to event network-changed-3adbe18d-bad6-47d6-945a-d961251c1e6c. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:07:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-db95c13b-c522-493a-bc44-717d70c33b83 req-2221b4f7-e05b-4998-80f5-a5a823c3884b service nova] Acquiring lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:07:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-db95c13b-c522-493a-bc44-717d70c33b83 req-2221b4f7-e05b-4998-80f5-a5a823c3884b service nova] Acquired lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:07:23 user nova-compute[73258]: DEBUG nova.network.neutron [req-db95c13b-c522-493a-bc44-717d70c33b83 req-2221b4f7-e05b-4998-80f5-a5a823c3884b service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Refreshing network info cache for port 3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:07:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-60d55737-50ce-4ba5-bf18-adaac09d9c55 req-0dedeba4-0935-4ecf-9aa4-52f634f8a766 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received event network-changed-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:07:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-60d55737-50ce-4ba5-bf18-adaac09d9c55 req-0dedeba4-0935-4ecf-9aa4-52f634f8a766 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Refreshing instance network info cache due to event network-changed-3adbe18d-bad6-47d6-945a-d961251c1e6c. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:07:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-60d55737-50ce-4ba5-bf18-adaac09d9c55 req-0dedeba4-0935-4ecf-9aa4-52f634f8a766 service nova] Acquiring lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:07:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:07:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:07:24 user nova-compute[73258]: INFO nova.compute.manager [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Detaching volume cf7d349d-98b5-4231-a474-fd64e4ca72cc
Aug 27 07:07:24 user nova-compute[73258]: DEBUG nova.network.neutron [req-db95c13b-c522-493a-bc44-717d70c33b83 req-2221b4f7-e05b-4998-80f5-a5a823c3884b service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updated VIF entry in instance network info cache for port 3adbe18d-bad6-47d6-945a-d961251c1e6c. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:07:24 user nova-compute[73258]: DEBUG nova.network.neutron [req-db95c13b-c522-493a-bc44-717d70c33b83 req-2221b4f7-e05b-4998-80f5-a5a823c3884b service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updating instance_info_cache with network_info: [{"id": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "address": "fa:16:3e:f9:70:7e", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3adbe18d-ba", "ovs_interfaceid": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:07:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-db95c13b-c522-493a-bc44-717d70c33b83 req-2221b4f7-e05b-4998-80f5-a5a823c3884b service nova] Releasing lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:07:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-60d55737-50ce-4ba5-bf18-adaac09d9c55 req-0dedeba4-0935-4ecf-9aa4-52f634f8a766 service nova] Acquired lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:07:24 user nova-compute[73258]: DEBUG nova.network.neutron [req-60d55737-50ce-4ba5-bf18-adaac09d9c55 req-0dedeba4-0935-4ecf-9aa4-52f634f8a766 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Refreshing network info cache for port 3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:07:24 user nova-compute[73258]: INFO nova.virt.block_device [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Attempting to driver detach volume cf7d349d-98b5-4231-a474-fd64e4ca72cc from mountpoint /dev/vdb
Aug 27 07:07:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Attempting to detach device vdb from instance 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 07:07:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 07:07:24 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:07:24 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 07:07:24 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 07:07:24 user nova-compute[73258]:   <serial>cf7d349d-98b5-4231-a474-fd64e4ca72cc</serial>
Aug 27 07:07:24 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 07:07:24 user nova-compute[73258]: </disk>
Aug 27 07:07:24 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 07:07:24 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Successfully detached device vdb from instance 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 from the persistent domain config.
Aug 27 07:07:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 07:07:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 07:07:24 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:07:24 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 07:07:24 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 07:07:24 user nova-compute[73258]:   <serial>cf7d349d-98b5-4231-a474-fd64e4ca72cc</serial>
Aug 27 07:07:24 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 07:07:24 user nova-compute[73258]: </disk>
Aug 27 07:07:24 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG nova.network.neutron [req-60d55737-50ce-4ba5-bf18-adaac09d9c55 req-0dedeba4-0935-4ecf-9aa4-52f634f8a766 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updated VIF entry in instance network info cache for port 3adbe18d-bad6-47d6-945a-d961251c1e6c. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG nova.network.neutron [req-60d55737-50ce-4ba5-bf18-adaac09d9c55 req-0dedeba4-0935-4ecf-9aa4-52f634f8a766 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updating instance_info_cache with network_info: [{"id": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "address": "fa:16:3e:f9:70:7e", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3adbe18d-ba", "ovs_interfaceid": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693120045.1630347, 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 07:07:25 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Successfully detached device vdb from instance 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 from the live domain config.
Aug 27 07:07:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JgkpTRIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:07:25 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:07:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-60d55737-50ce-4ba5-bf18-adaac09d9c55 req-0dedeba4-0935-4ecf-9aa4-52f634f8a766 service nova] Releasing lock "refresh_cache-18b1857e-4abc-48fa-8f77-5152ef8ee3b6" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b0c922-e1b5-48f0-ba37-81f3a34da5d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a4fed6-53c6-45e7-b9be-878da00ba5c0]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc (non-flash)
Aug 27 07:07:25 user nova-compute[73258]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 (non-flash)
Aug 27 07:07:25 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc (non-flash)
Aug 27 07:07:25 user nova-compute[73258]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 (non-flash)
Aug 27 07:07:25 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4307ec9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3935168f-007b-4571-93b2-7a32630019a5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ea8198-334a-400f-8874-8ab6350ebf11]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[caed787e-6fb8-4294-acc2-b503dc82fc82]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1169d5-19cb-4cad-9dc9-6d890b84c0e9]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa7e3b6-b18d-4303-8f9c-efb1aa8d09dc]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c0cd70-bab0-4f40-a32d-4a48f9e5eb4f]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc, portal: 172.16.0.220,3260]
Aug 27 07:07:25 user nova-compute[73258]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc, portal: 172.16.0.220,3260] successful.
Aug 27 07:07:25 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf7d349d-98b5-4231-a474-fd64e4ca72cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb5f09c-0526-449f-82a4-55ebad0833e1]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] <== disconnect_volume: return (258ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:07:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 07:07:26 user nova-compute[73258]: DEBUG nova.objects.instance [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lazy-loading 'flavor' on Instance uuid 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:07:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-9b134a5a-925a-4026-812f-8751a87c1b6f tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.576s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:07:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:07:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:07:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:07:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:07:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:07:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:07:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:07:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:07:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:07:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:07:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:07:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:07:57 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:08:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:01 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:08:01 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:08:02 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:08:03 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:08:03 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:08:03 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:08:04 user nova-compute[73258]: DEBUG nova.compute.manager [req-fbaf872a-588a-4b4d-ae9f-c437e749d0df req-9a9fb8ce-e2ae-411e-87f7-1845ce9bed2b service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Received event network-changed-550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:08:04 user nova-compute[73258]: DEBUG nova.compute.manager [req-fbaf872a-588a-4b4d-ae9f-c437e749d0df req-9a9fb8ce-e2ae-411e-87f7-1845ce9bed2b service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Refreshing instance network info cache due to event network-changed-550bb78f-7337-4bae-90f0-f211ba6121ff. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:08:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fbaf872a-588a-4b4d-ae9f-c437e749d0df req-9a9fb8ce-e2ae-411e-87f7-1845ce9bed2b service nova] Acquiring lock "refresh_cache-1570970a-1b5c-44f6-9326-e7574ce9fe6f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:08:04 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fbaf872a-588a-4b4d-ae9f-c437e749d0df req-9a9fb8ce-e2ae-411e-87f7-1845ce9bed2b service nova] Acquired lock "refresh_cache-1570970a-1b5c-44f6-9326-e7574ce9fe6f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:08:04 user nova-compute[73258]: DEBUG nova.network.neutron [req-fbaf872a-588a-4b4d-ae9f-c437e749d0df req-9a9fb8ce-e2ae-411e-87f7-1845ce9bed2b service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Refreshing network info cache for port 550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:08:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:05 user nova-compute[73258]: DEBUG nova.network.neutron [req-fbaf872a-588a-4b4d-ae9f-c437e749d0df req-9a9fb8ce-e2ae-411e-87f7-1845ce9bed2b service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Updated VIF entry in instance network info cache for port 550bb78f-7337-4bae-90f0-f211ba6121ff. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:08:05 user nova-compute[73258]: DEBUG nova.network.neutron [req-fbaf872a-588a-4b4d-ae9f-c437e749d0df req-9a9fb8ce-e2ae-411e-87f7-1845ce9bed2b service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Updating instance_info_cache with network_info: [{"id": "550bb78f-7337-4bae-90f0-f211ba6121ff", "address": "fa:16:3e:2a:96:e3", "network": {"id": "79c69f6d-d61f-45ee-aa36-bf268f40bb4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995097103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f7776d299af40b8ac39f127185c4da6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550bb78f-73", "ovs_interfaceid": "550bb78f-7337-4bae-90f0-f211ba6121ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:08:05 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fbaf872a-588a-4b4d-ae9f-c437e749d0df req-9a9fb8ce-e2ae-411e-87f7-1845ce9bed2b service nova] Releasing lock "refresh_cache-1570970a-1b5c-44f6-9326-e7574ce9fe6f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:08:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:06 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:08:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:08:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-1570970a-1b5c-44f6-9326-e7574ce9fe6f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:08:06 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-1570970a-1b5c-44f6-9326-e7574ce9fe6f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:08:06 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 07:08:07 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Updating instance_info_cache with network_info: [{"id": "550bb78f-7337-4bae-90f0-f211ba6121ff", "address": "fa:16:3e:2a:96:e3", "network": {"id": "79c69f6d-d61f-45ee-aa36-bf268f40bb4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995097103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f7776d299af40b8ac39f127185c4da6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550bb78f-73", "ovs_interfaceid": "550bb78f-7337-4bae-90f0-f211ba6121ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:08:07 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-1570970a-1b5c-44f6-9326-e7574ce9fe6f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:08:07 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 07:08:07 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:08:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "073ddd85-25de-4765-89e1-2fec03f131b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:08:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "073ddd85-25de-4765-89e1-2fec03f131b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:08:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "073ddd85-25de-4765-89e1-2fec03f131b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:08:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "073ddd85-25de-4765-89e1-2fec03f131b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:08:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "073ddd85-25de-4765-89e1-2fec03f131b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:08:08 user nova-compute[73258]: INFO nova.compute.manager [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Terminating instance
Aug 27 07:08:08 user nova-compute[73258]: DEBUG nova.compute.manager [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 07:08:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-3edee39e-0f06-4e56-840d-6097e869a8cf req-72c4775a-7e17-4e4b-957f-2554e74fc3c7 service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Received event network-vif-unplugged-dda2a49a-710f-4a0b-bfae-401437641410 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:08:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3edee39e-0f06-4e56-840d-6097e869a8cf req-72c4775a-7e17-4e4b-957f-2554e74fc3c7 service nova] Acquiring lock "073ddd85-25de-4765-89e1-2fec03f131b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:08:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3edee39e-0f06-4e56-840d-6097e869a8cf req-72c4775a-7e17-4e4b-957f-2554e74fc3c7 service nova] Lock "073ddd85-25de-4765-89e1-2fec03f131b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:08:08 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3edee39e-0f06-4e56-840d-6097e869a8cf req-72c4775a-7e17-4e4b-957f-2554e74fc3c7 service nova] Lock "073ddd85-25de-4765-89e1-2fec03f131b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:08:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-3edee39e-0f06-4e56-840d-6097e869a8cf req-72c4775a-7e17-4e4b-957f-2554e74fc3c7 service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] No waiting events found dispatching network-vif-unplugged-dda2a49a-710f-4a0b-bfae-401437641410 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:08:08 user nova-compute[73258]: DEBUG nova.compute.manager [req-3edee39e-0f06-4e56-840d-6097e869a8cf req-72c4775a-7e17-4e4b-957f-2554e74fc3c7 service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Received event network-vif-unplugged-dda2a49a-710f-4a0b-bfae-401437641410 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 07:08:08 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:08:08 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 07:08:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:09 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Instance destroyed successfully.
Aug 27 07:08:09 user nova-compute[73258]: DEBUG nova.objects.instance [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lazy-loading 'resources' on Instance uuid 073ddd85-25de-4765-89e1-2fec03f131b7 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-174830906',display_name='tempest-TestVolumeBootPattern-server-174830906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-174830906',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T07:06:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='002188a1020a4181a03ce17d46608664',ramdisk_id='',reservation_id='r-diql7e9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-833647414',owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T07:06:40Z,user_data=None,user_id='75d7a7c63b654c47b9df519798186007',uuid=073ddd85-25de-4765-89e1-2fec03f131b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dda2a49a-710f-4a0b-bfae-401437641410", "address": "fa:16:3e:2e:2a:08", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2a49a-71", "ovs_interfaceid": "dda2a49a-710f-4a0b-bfae-401437641410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converting VIF {"id": "dda2a49a-710f-4a0b-bfae-401437641410", "address": "fa:16:3e:2e:2a:08", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda2a49a-71", "ovs_interfaceid": "dda2a49a-710f-4a0b-bfae-401437641410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=dda2a49a-710f-4a0b-bfae-401437641410,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda2a49a-71') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG os_vif [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=dda2a49a-710f-4a0b-bfae-401437641410,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda2a49a-71') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdda2a49a-71, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:08:09 user nova-compute[73258]: INFO os_vif [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2a:08,bridge_name='br-int',has_traffic_filtering=True,id=dda2a49a-710f-4a0b-bfae-401437641410,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda2a49a-71')
Aug 27 07:08:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sZEfukAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:08:09 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:08:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c19d30a-a513-4186-a195-5b0977feea39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0334c2fd-d84a-4b42-b7e7-ced6df629384]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 (non-flash)
Aug 27 07:08:09 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 (non-flash)
Aug 27 07:08:09 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa410525000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038'): ({'sdc'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Removing single pathed devices sdc {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24545ba-969a-4354-a2f9-69cf8cecad04]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[05642ae2-1adb-45ec-a8ce-d8c86a45cf63]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Flushing IO for device /dev/sdc {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a4266c-2a45-4e1e-8ce8-e16fa7c0d396]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.093s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f0e756-7ba1-463d-b22c-0bd1d81a394b]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ce0b55-d4c7-4c63-8fac-924583d21d87]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c6bc1c-eef1-4b42-989b-c968f008d1f0]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038, portal: 172.16.0.220,3260]
Aug 27 07:08:09 user nova-compute[73258]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038, portal: 172.16.0.220,3260] successful.
Aug 27 07:08:09 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63d8fc8a-1b86-4dee-8d57-8482a9de1038 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5640d494-1fdb-4e2e-9201-965abe6c47f5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] <== disconnect_volume: return (327ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 07:08:09 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Deleting instance files /opt/stack/data/nova/instances/073ddd85-25de-4765-89e1-2fec03f131b7_del
Aug 27 07:08:09 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Deletion of /opt/stack/data/nova/instances/073ddd85-25de-4765-89e1-2fec03f131b7_del complete
Aug 27 07:08:09 user nova-compute[73258]: INFO nova.compute.manager [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:08:09 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:08:09 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Took 0.46 seconds to deallocate network for instance.
Aug 27 07:08:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-99295784-36a5-4600-9868-de6f00f6acd2 req-d33dadcc-29c7-4ed0-8db0-69ec164f4ae0 service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Received event network-vif-deleted-dda2a49a-710f-4a0b-bfae-401437641410 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:08:10 user nova-compute[73258]: INFO nova.compute.manager [req-99295784-36a5-4600-9868-de6f00f6acd2 req-d33dadcc-29c7-4ed0-8db0-69ec164f4ae0 service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Neutron deleted interface dda2a49a-710f-4a0b-bfae-401437641410; detaching it from the instance and deleting it from the info cache
Aug 27 07:08:10 user nova-compute[73258]: DEBUG nova.network.neutron [req-99295784-36a5-4600-9868-de6f00f6acd2 req-d33dadcc-29c7-4ed0-8db0-69ec164f4ae0 service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-99295784-36a5-4600-9868-de6f00f6acd2 req-d33dadcc-29c7-4ed0-8db0-69ec164f4ae0 service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Detach interface failed, port_id=dda2a49a-710f-4a0b-bfae-401437641410, reason: Instance 073ddd85-25de-4765-89e1-2fec03f131b7 could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Acquiring lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG nova.objects.instance [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lazy-loading 'flavor' on Instance uuid 1570970a-1b5c-44f6-9326-e7574ce9fe6f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Acquiring lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:08:10 user nova-compute[73258]: INFO nova.compute.manager [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Attaching volume df4fc403-598a-44be-a6f7-127455b2b691 to /dev/vdb
Aug 27 07:08:10 user nova-compute[73258]: DEBUG os_brick.utils [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.070s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e89f0e-6c35-4de0-a2ed-a1a7ec20e679]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcb3cc5-a075-4508-9484-a5459fc676fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b179aa-5ce5-47c4-974b-506d03b69cb7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e88ef0-dd81-4c1d-8b32-6dd21da84b19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:08:10 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[da12b73f-78d7-48e6-bf34-07d195000375]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG os_brick.utils [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] <== get_connector_properties: return (222ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Updating existing volume attachment record: 7ba7be1c-076a-454b-8a8d-cba6c179f9c9 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-a856f44f-0514-4257-9bd6-50dd09d86d31 req-77d0aef2-c7bf-4f01-a7d2-2ae866bbcfd4 service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Received event network-vif-plugged-dda2a49a-710f-4a0b-bfae-401437641410 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a856f44f-0514-4257-9bd6-50dd09d86d31 req-77d0aef2-c7bf-4f01-a7d2-2ae866bbcfd4 service nova] Acquiring lock "073ddd85-25de-4765-89e1-2fec03f131b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a856f44f-0514-4257-9bd6-50dd09d86d31 req-77d0aef2-c7bf-4f01-a7d2-2ae866bbcfd4 service nova] Lock "073ddd85-25de-4765-89e1-2fec03f131b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-a856f44f-0514-4257-9bd6-50dd09d86d31 req-77d0aef2-c7bf-4f01-a7d2-2ae866bbcfd4 service nova] Lock "073ddd85-25de-4765-89e1-2fec03f131b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:08:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-a856f44f-0514-4257-9bd6-50dd09d86d31 req-77d0aef2-c7bf-4f01-a7d2-2ae866bbcfd4 service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] No waiting events found dispatching network-vif-plugged-dda2a49a-710f-4a0b-bfae-401437641410 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:08:10 user nova-compute[73258]: WARNING nova.compute.manager [req-a856f44f-0514-4257-9bd6-50dd09d86d31 req-77d0aef2-c7bf-4f01-a7d2-2ae866bbcfd4 service nova] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Received unexpected event network-vif-plugged-dda2a49a-710f-4a0b-bfae-401437641410 for instance with vm_state active and task_state deleting.
Aug 27 07:08:11 user nova-compute[73258]: INFO nova.compute.manager [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Took 1.24 seconds to detach 1 volumes for instance.
Aug 27 07:08:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Deleting volume: 63d8fc8a-1b86-4dee-8d57-8482a9de1038 {{(pid=73258) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 07:08:11 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:08:11 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:08:11 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8565MB free_disk=23.86761474609375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1570970a-1b5c-44f6-9326-e7574ce9fe6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 073ddd85-25de-4765-89e1-2fec03f131b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Refreshing inventories for resource provider 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Updating ProviderTree inventory for provider 13f05024-5078-4590-94a5-110d29d864c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Updating inventory in ProviderTree for provider 13f05024-5078-4590-94a5-110d29d864c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Refreshing aggregate associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, aggregates: None {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Refreshing trait associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.274s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:08:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:08:11 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Deleted allocations for instance 073ddd85-25de-4765-89e1-2fec03f131b7
Aug 27 07:08:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-151222af-2b2e-4346-87ff-c05d75c57d54 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "073ddd85-25de-4765-89e1-2fec03f131b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.569s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:08:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:16 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:08:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:19 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:08:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 07:08:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] There are 0 instances to clean {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 07:08:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:24 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693120089.088654, 073ddd85-25de-4765-89e1-2fec03f131b7 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:08:24 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] VM Stopped (Lifecycle Event)
Aug 27 07:08:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-9bba6e12-4937-4f44-a986-dadd0f044c20 None None] [instance: 073ddd85-25de-4765-89e1-2fec03f131b7] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:08:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nDbxMtAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:08:28 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:08:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:08:28 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:08:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:08:28 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34883ad-d128-4804-bc51-4ef04d169ffb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 07:08:28 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[30296062-1aea-4dbd-b275-8f18a5b58b9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691] added
Aug 27 07:08:28 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[83504cc0-59c1-485e-8bb4-1c58c29e3ff1]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b52f31-5a35-466d-a5b3-ccd1b1aaef81]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nDbxMtAl {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nDbxMtAl" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa5c816-ccff-4565-b7e6-749c3096725f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nDbxMtAl'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[26db9f8b-aeab-49b3-9e1d-7c4ada823552]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fa6b3e-2b78-4114-8ad1-e75e8dc24087]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 07:08:28 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:08:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 07:08:28 user nova-compute[73258]:  {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:08:28 user nova-compute[73258]: WARNING os_brick.initiator.connectors.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 07:08:28 user nova-compute[73258]: 
Aug 27 07:08:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b788e0-b20d-4a2a-8fca-384307f3c5c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691, portal: 172.16.0.220,3260]
Aug 27 07:08:29 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691, portal: 172.16.0.220,3260] successful.
Aug 27 07:08:29 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65d2677-987f-45c5-8c9c-6bd1c9d929d1]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62fa1cb-da99-4cf4-89d6-669020a14501]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 (non-flash)
Aug 27 07:08:29 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 (non-flash)
Aug 27 07:08:29 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2766879f-3b8f-483c-bea5-ff51163b3725]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nDbxMtAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:08:29 user nova-compute[73258]: INFO nova.compute.manager [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Terminating instance
Aug 27 07:08:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 07:08:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26237663135343631', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237663135343631', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG nova.objects.instance [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lazy-loading 'flavor' on Instance uuid 1570970a-1b5c-44f6-9326-e7574ce9fe6f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 07:08:30 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:08:30 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 07:08:30 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 07:08:30 user nova-compute[73258]:   <serial>df4fc403-598a-44be-a6f7-127455b2b691</serial>
Aug 27 07:08:30 user nova-compute[73258]: </disk>
Aug 27 07:08:30 user nova-compute[73258]:  {{(pid=73258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-d673e679-ef7e-4df6-8748-a7f74d2a73f9 req-9194c4a2-ff9a-4516-8e7b-48bf63c1cdcf service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received event network-vif-unplugged-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d673e679-ef7e-4df6-8748-a7f74d2a73f9 req-9194c4a2-ff9a-4516-8e7b-48bf63c1cdcf service nova] Acquiring lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d673e679-ef7e-4df6-8748-a7f74d2a73f9 req-9194c4a2-ff9a-4516-8e7b-48bf63c1cdcf service nova] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d673e679-ef7e-4df6-8748-a7f74d2a73f9 req-9194c4a2-ff9a-4516-8e7b-48bf63c1cdcf service nova] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-d673e679-ef7e-4df6-8748-a7f74d2a73f9 req-9194c4a2-ff9a-4516-8e7b-48bf63c1cdcf service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] No waiting events found dispatching network-vif-unplugged-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-d673e679-ef7e-4df6-8748-a7f74d2a73f9 req-9194c4a2-ff9a-4516-8e7b-48bf63c1cdcf service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received event network-vif-unplugged-3adbe18d-bad6-47d6-945a-d961251c1e6c for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] No VIF found with MAC fa:16:3e:2a:96:e3, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e56b8941-5503-406c-96f3-ac303797feba tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.169s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:08:30 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Instance destroyed successfully.
Aug 27 07:08:30 user nova-compute[73258]: DEBUG nova.objects.instance [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lazy-loading 'resources' on Instance uuid 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:03:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-598066848',display_name='tempest-TestMinimumBasicScenario-server-598066848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-598066848',id=45,image_ref='03bb8985-c2cf-4689-b0ac-c76d7e115c44',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYUwsE+wWLocnonNsDrY0mg5BWSHrZf4/cA7vPkbV/B9qwFbwwGIpFTXvnR8nMroeNQR5kZ8s22UQt0sHhiItTh7wKi1WLVRchjLi6Xk/ar3wryqCUl4diCgvyUI5jbfw==',key_name='tempest-TestMinimumBasicScenario-67594116',keypairs=<?>,launch_index=0,launched_at=2023-08-27T07:03:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b34f6a09d79c43c282e56cfda50001d7',ramdisk_id='',reservation_id='r-nh80wh1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='03bb8985-c2cf-4689-b0ac-c76d7e115c44',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1509066975',owner_user_name='tempest-TestMinimumBasicScenario-1509066975-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T07:05:40Z,user_data=None,user_id='8de65612a05142ebb509012c126b89b0',uuid=18b1857e-4abc-48fa-8f77-5152ef8ee3b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "address": "fa:16:3e:f9:70:7e", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3adbe18d-ba", "ovs_interfaceid": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Converting VIF {"id": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "address": "fa:16:3e:f9:70:7e", "network": {"id": "bb0fae2a-36ac-482b-ac76-4cdefc48b12c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-736493944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34f6a09d79c43c282e56cfda50001d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3adbe18d-ba", "ovs_interfaceid": "3adbe18d-bad6-47d6-945a-d961251c1e6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:70:7e,bridge_name='br-int',has_traffic_filtering=True,id=3adbe18d-bad6-47d6-945a-d961251c1e6c,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3adbe18d-ba') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG os_vif [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:70:7e,bridge_name='br-int',has_traffic_filtering=True,id=3adbe18d-bad6-47d6-945a-d961251c1e6c,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3adbe18d-ba') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3adbe18d-ba, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:08:30 user nova-compute[73258]: INFO os_vif [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:70:7e,bridge_name='br-int',has_traffic_filtering=True,id=3adbe18d-bad6-47d6-945a-d961251c1e6c,network=Network(bb0fae2a-36ac-482b-ac76-4cdefc48b12c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3adbe18d-ba')
Aug 27 07:08:30 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Deleting instance files /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6_del
Aug 27 07:08:30 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Deletion of /opt/stack/data/nova/instances/18b1857e-4abc-48fa-8f77-5152ef8ee3b6_del complete
Aug 27 07:08:30 user nova-compute[73258]: INFO nova.compute.manager [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 27 07:08:30 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 07:08:30 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 07:08:31 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:08:31 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Took 0.52 seconds to deallocate network for instance.
Aug 27 07:08:31 user nova-compute[73258]: DEBUG nova.compute.manager [req-8f323f4d-4004-4cd3-a0a5-163e4f6bbe9b req-fdfdf02d-0dba-48ef-9e3e-efce356b9061 service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received event network-vif-deleted-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:08:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:08:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:08:31 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:08:31 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:08:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:08:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Acquiring lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:08:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:08:31 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Deleted allocations for instance 18b1857e-4abc-48fa-8f77-5152ef8ee3b6
Aug 27 07:08:31 user nova-compute[73258]: INFO nova.compute.manager [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Detaching volume df4fc403-598a-44be-a6f7-127455b2b691
Aug 27 07:08:31 user nova-compute[73258]: INFO nova.virt.block_device [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Attempting to driver detach volume df4fc403-598a-44be-a6f7-127455b2b691 from mountpoint /dev/vdb
Aug 27 07:08:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Attempting to detach device vdb from instance 1570970a-1b5c-44f6-9326-e7574ce9fe6f from the persistent domain config. {{(pid=73258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 07:08:32 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:08:32 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 07:08:32 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 07:08:32 user nova-compute[73258]:   <serial>df4fc403-598a-44be-a6f7-127455b2b691</serial>
Aug 27 07:08:32 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 07:08:32 user nova-compute[73258]: </disk>
Aug 27 07:08:32 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 07:08:32 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Successfully detached device vdb from instance 1570970a-1b5c-44f6-9326-e7574ce9fe6f from the persistent domain config.
Aug 27 07:08:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1570970a-1b5c-44f6-9326-e7574ce9fe6f from the live domain config. {{(pid=73258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.guest [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 07:08:32 user nova-compute[73258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:08:32 user nova-compute[73258]:   <source dev="/dev/sdb"/>
Aug 27 07:08:32 user nova-compute[73258]:   <target dev="vdb" bus="virtio"/>
Aug 27 07:08:32 user nova-compute[73258]:   <serial>df4fc403-598a-44be-a6f7-127455b2b691</serial>
Aug 27 07:08:32 user nova-compute[73258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 07:08:32 user nova-compute[73258]: </disk>
Aug 27 07:08:32 user nova-compute[73258]:  {{(pid=73258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-73d6dfed-4d4d-4b39-b0de-7379050db217 tempest-TestMinimumBasicScenario-1509066975 tempest-TestMinimumBasicScenario-1509066975-project-member] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.136s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-66d52d91-749f-4022-bf13-729ea80c173b req-21a5bceb-194d-4caf-b717-9dc83a8c655d service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received event network-vif-plugged-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-66d52d91-749f-4022-bf13-729ea80c173b req-21a5bceb-194d-4caf-b717-9dc83a8c655d service nova] Acquiring lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-66d52d91-749f-4022-bf13-729ea80c173b req-21a5bceb-194d-4caf-b717-9dc83a8c655d service nova] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-66d52d91-749f-4022-bf13-729ea80c173b req-21a5bceb-194d-4caf-b717-9dc83a8c655d service nova] Lock "18b1857e-4abc-48fa-8f77-5152ef8ee3b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-66d52d91-749f-4022-bf13-729ea80c173b req-21a5bceb-194d-4caf-b717-9dc83a8c655d service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] No waiting events found dispatching network-vif-plugged-3adbe18d-bad6-47d6-945a-d961251c1e6c {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:08:32 user nova-compute[73258]: WARNING nova.compute.manager [req-66d52d91-749f-4022-bf13-729ea80c173b req-21a5bceb-194d-4caf-b717-9dc83a8c655d service nova] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Received unexpected event network-vif-plugged-3adbe18d-bad6-47d6-945a-d961251c1e6c for instance with vm_state deleted and task_state None.
Aug 27 07:08:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Received event <DeviceRemovedEvent: 1693120112.4621816, 1570970a-1b5c-44f6-9326-e7574ce9fe6f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73258) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1570970a-1b5c-44f6-9326-e7574ce9fe6f {{(pid=73258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 07:08:32 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Successfully detached device vdb from instance 1570970a-1b5c-44f6-9326-e7574ce9fe6f from the live domain config.
Aug 27 07:08:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nDbxMtAl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:08:32 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:08:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d423a7d-564b-4dda-b92b-b79ef1f11837]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26c9e66-23d8-40e0-b5d1-261ce4c7249b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 (non-flash)
Aug 27 07:08:32 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 (non-flash)
Aug 27 07:08:32 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4107b7400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ac65c7-17f4-40a7-a0eb-05f115a2de53]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f064644d-4682-40a9-8ca1-b48ce7255a3f]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4157d2fe-5166-4b39-b7ad-b204efefc7b9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[967d74bb-ddf9-49c7-b8b6-f36f8d26095c]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[633fb88c-e1b9-4729-ad12-562ad153fdc5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0c9cf6-af21-4989-bc05-cbac080fe928]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691, portal: 172.16.0.220,3260]
Aug 27 07:08:32 user nova-compute[73258]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691, portal: 172.16.0.220,3260] successful.
Aug 27 07:08:32 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df4fc403-598a-44be-a6f7-127455b2b691 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1d2a4e-94b6-4c47-b21f-a9aaca186bcd]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] <== disconnect_volume: return (296ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:08:32 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 07:08:33 user nova-compute[73258]: DEBUG nova.objects.instance [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lazy-loading 'flavor' on Instance uuid 1570970a-1b5c-44f6-9326-e7574ce9fe6f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:08:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-11c9725f-6884-4847-b47a-73422e113443 tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.830s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:08:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:45 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693120110.8049347, 18b1857e-4abc-48fa-8f77-5152ef8ee3b6 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:08:45 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] VM Stopped (Lifecycle Event)
Aug 27 07:08:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-a26942ad-10e4-46cc-a9aa-c858721f1420 None None] [instance: 18b1857e-4abc-48fa-8f77-5152ef8ee3b6] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:08:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:08:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:08:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:08:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:08:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:08:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:08:57 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:09:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:09:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:09:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:09:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:09:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:01 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:09:01 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:09:03 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:09:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:05 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:09:05 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:09:05 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:09:08 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:09:08 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:09:08 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Didn't find any instances for network info cache update. {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 07:09:08 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:09:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:09:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:09:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:09:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:09:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:11 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:09:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:09:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:09:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:09:11 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:09:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:09:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:09:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk --force-share --output=json {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:09:12 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:09:12 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:09:12 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:09:12 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8674MB free_disk=23.894073486328125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:09:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:09:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:09:12 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 1570970a-1b5c-44f6-9326-e7574ce9fe6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:09:12 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:09:12 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:09:12 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:09:12 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:09:12 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:09:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:09:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:22 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:09:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:09:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:09:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 07:09:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:09:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:09:26 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 07:09:26 user nova-compute[73258]: INFO nova.compute.claims [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Claim successful on node user
Aug 27 07:09:26 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:09:26 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:09:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:09:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 07:09:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 07:09:26 user nova-compute[73258]: DEBUG nova.network.neutron [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 07:09:26 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 07:09:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 07:09:27 user nova-compute[73258]: INFO nova.virt.block_device [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Booting with volume f04e17a8-deae-4a95-b511-e2e3cbb51544 at /dev/vda
Aug 27 07:09:27 user nova-compute[73258]: DEBUG nova.policy [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75d7a7c63b654c47b9df519798186007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002188a1020a4181a03ce17d46608664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG os_brick.utils [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97f4ab2-88d6-4772-bcb1-2571b2c5acad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfc4b76-fda8-4df1-88b9-577bc26d5862]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e29ac99-3754-49ce-b88f-b443fe1e596e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1721b2da-c023-45da-81a0-85e2dd52df2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:09:27 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 07:09:27 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4133ecb-6976-4c04-bf20-b30aa24315c4]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG os_brick.utils [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Updating existing volume attachment record: 1aa83c2b-6468-4812-89f4-504e3cea8217 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG nova.network.neutron [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Successfully created port: d8cad33f-3766-4dc0-acb5-bed876f80e54 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 07:09:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:28 user nova-compute[73258]: DEBUG nova.network.neutron [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Successfully updated port: d8cad33f-3766-4dc0-acb5-bed876f80e54 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 07:09:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:09:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquired lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:09:28 user nova-compute[73258]: DEBUG nova.network.neutron [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 07:09:28 user nova-compute[73258]: DEBUG nova.network.neutron [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 07:09:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-d71bdb38-d49f-491a-a8a7-b2ddfa5c4d92 req-e7eaeff4-b6f9-4c8a-933f-75b630f3181d service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Received event network-changed-d8cad33f-3766-4dc0-acb5-bed876f80e54 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:09:28 user nova-compute[73258]: DEBUG nova.compute.manager [req-d71bdb38-d49f-491a-a8a7-b2ddfa5c4d92 req-e7eaeff4-b6f9-4c8a-933f-75b630f3181d service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Refreshing instance network info cache due to event network-changed-d8cad33f-3766-4dc0-acb5-bed876f80e54. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:09:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d71bdb38-d49f-491a-a8a7-b2ddfa5c4d92 req-e7eaeff4-b6f9-4c8a-933f-75b630f3181d service nova] Acquiring lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:09:29 user nova-compute[73258]: DEBUG nova.network.neutron [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Updating instance_info_cache with network_info: [{"id": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "address": "fa:16:3e:88:5e:da", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cad33f-37", "ovs_interfaceid": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:09:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Releasing lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:09:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Instance network_info: |[{"id": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "address": "fa:16:3e:88:5e:da", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cad33f-37", "ovs_interfaceid": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 07:09:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d71bdb38-d49f-491a-a8a7-b2ddfa5c4d92 req-e7eaeff4-b6f9-4c8a-933f-75b630f3181d service nova] Acquired lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:09:29 user nova-compute[73258]: DEBUG nova.network.neutron [req-d71bdb38-d49f-491a-a8a7-b2ddfa5c4d92 req-e7eaeff4-b6f9-4c8a-933f-75b630f3181d service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Refreshing network info cache for port d8cad33f-3766-4dc0-acb5-bed876f80e54 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:09:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Acquiring lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:09:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:09:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Acquiring lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:09:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:09:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:09:29 user nova-compute[73258]: INFO nova.compute.manager [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Terminating instance
Aug 27 07:09:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 07:09:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG nova.network.neutron [req-d71bdb38-d49f-491a-a8a7-b2ddfa5c4d92 req-e7eaeff4-b6f9-4c8a-933f-75b630f3181d service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Updated VIF entry in instance network info cache for port d8cad33f-3766-4dc0-acb5-bed876f80e54. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG nova.network.neutron [req-d71bdb38-d49f-491a-a8a7-b2ddfa5c4d92 req-e7eaeff4-b6f9-4c8a-933f-75b630f3181d service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Updating instance_info_cache with network_info: [{"id": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "address": "fa:16:3e:88:5e:da", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cad33f-37", "ovs_interfaceid": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d71bdb38-d49f-491a-a8a7-b2ddfa5c4d92 req-e7eaeff4-b6f9-4c8a-933f-75b630f3181d service nova] Releasing lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-06d196b4-5681-433d-810b-c231e8308c3e req-09314ddd-485b-464b-8945-3bd3ffae8b60 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Received event network-vif-unplugged-550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-06d196b4-5681-433d-810b-c231e8308c3e req-09314ddd-485b-464b-8945-3bd3ffae8b60 service nova] Acquiring lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-06d196b4-5681-433d-810b-c231e8308c3e req-09314ddd-485b-464b-8945-3bd3ffae8b60 service nova] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-06d196b4-5681-433d-810b-c231e8308c3e req-09314ddd-485b-464b-8945-3bd3ffae8b60 service nova] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-06d196b4-5681-433d-810b-c231e8308c3e req-09314ddd-485b-464b-8945-3bd3ffae8b60 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] No waiting events found dispatching network-vif-unplugged-550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG nova.compute.manager [req-06d196b4-5681-433d-810b-c231e8308c3e req-09314ddd-485b-464b-8945-3bd3ffae8b60 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Received event network-vif-unplugged-550bb78f-7337-4bae-90f0-f211ba6121ff for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:30 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Instance destroyed successfully.
Aug 27 07:09:30 user nova-compute[73258]: DEBUG nova.objects.instance [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lazy-loading 'resources' on Instance uuid 1570970a-1b5c-44f6-9326-e7574ce9fe6f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-89791850',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-89791850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8979185',id=46,image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0KpuyzXusK7mzegOgtnjk0jLroJypO95TAJQOhsgISCFhPWJh2FuU89LfBP9fxMyoiODIWNO/LXIvUqWT1PpPD0Qch7xgNNqb40fG8cDswbm7f6nGVh1hM2KK/6gfcCw==',key_name='tempest-keypair-1391875007',keypairs=<?>,launch_index=0,launched_at=2023-08-27T07:06:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f7776d299af40b8ac39f127185c4da6',ramdisk_id='',reservation_id='r-0cb424qt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1da8f3b-7558-465b-96c4-208255c7b142',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-149034104',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T07:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11fe625c40184074bb14b810ebd03c00',uuid=1570970a-1b5c-44f6-9326-e7574ce9fe6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "550bb78f-7337-4bae-90f0-f211ba6121ff", "address": "fa:16:3e:2a:96:e3", "network": {"id": "79c69f6d-d61f-45ee-aa36-bf268f40bb4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995097103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f7776d299af40b8ac39f127185c4da6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550bb78f-73", "ovs_interfaceid": "550bb78f-7337-4bae-90f0-f211ba6121ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Converting VIF {"id": "550bb78f-7337-4bae-90f0-f211ba6121ff", "address": "fa:16:3e:2a:96:e3", "network": {"id": "79c69f6d-d61f-45ee-aa36-bf268f40bb4c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-995097103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f7776d299af40b8ac39f127185c4da6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550bb78f-73", "ovs_interfaceid": "550bb78f-7337-4bae-90f0-f211ba6121ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:96:e3,bridge_name='br-int',has_traffic_filtering=True,id=550bb78f-7337-4bae-90f0-f211ba6121ff,network=Network(79c69f6d-d61f-45ee-aa36-bf268f40bb4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550bb78f-73') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG os_vif [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:96:e3,bridge_name='br-int',has_traffic_filtering=True,id=550bb78f-7337-4bae-90f0-f211ba6121ff,network=Network(79c69f6d-d61f-45ee-aa36-bf268f40bb4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550bb78f-73') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap550bb78f-73, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:30 user nova-compute[73258]: INFO os_vif [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:96:e3,bridge_name='br-int',has_traffic_filtering=True,id=550bb78f-7337-4bae-90f0-f211ba6121ff,network=Network(79c69f6d-d61f-45ee-aa36-bf268f40bb4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550bb78f-73')
Aug 27 07:09:30 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Deleting instance files /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f_del
Aug 27 07:09:30 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Deletion of /opt/stack/data/nova/instances/1570970a-1b5c-44f6-9326-e7574ce9fe6f_del complete
Aug 27 07:09:30 user nova-compute[73258]: INFO nova.compute.manager [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 27 07:09:30 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 07:09:30 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 07:09:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:09:32 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Took 1.14 seconds to deallocate network for instance.
Aug 27 07:09:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-0dea1ad5-2ce4-4f89-a7b4-b51183405ec5 req-53e49d12-db55-43a1-a6d1-663716d4f1fe service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Received event network-vif-deleted-550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:09:32 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Deleted allocations for instance 1570970a-1b5c-44f6-9326-e7574ce9fe6f
Aug 27 07:09:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Received event network-vif-plugged-550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] Acquiring lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] No waiting events found dispatching network-vif-plugged-550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:09:32 user nova-compute[73258]: WARNING nova.compute.manager [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Received unexpected event network-vif-plugged-550bb78f-7337-4bae-90f0-f211ba6121ff for instance with vm_state deleted and task_state None.
Aug 27 07:09:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Received event network-vif-plugged-550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] Acquiring lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] No waiting events found dispatching network-vif-plugged-550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:09:32 user nova-compute[73258]: WARNING nova.compute.manager [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Received unexpected event network-vif-plugged-550bb78f-7337-4bae-90f0-f211ba6121ff for instance with vm_state deleted and task_state None.
Aug 27 07:09:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Received event network-vif-plugged-550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] Acquiring lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] No waiting events found dispatching network-vif-plugged-550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:09:32 user nova-compute[73258]: WARNING nova.compute.manager [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Received unexpected event network-vif-plugged-550bb78f-7337-4bae-90f0-f211ba6121ff for instance with vm_state deleted and task_state None.
Aug 27 07:09:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Received event network-vif-unplugged-550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] Acquiring lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] No waiting events found dispatching network-vif-unplugged-550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:09:32 user nova-compute[73258]: WARNING nova.compute.manager [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Received unexpected event network-vif-unplugged-550bb78f-7337-4bae-90f0-f211ba6121ff for instance with vm_state deleted and task_state None.
Aug 27 07:09:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Received event network-vif-plugged-550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] Acquiring lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:09:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] No waiting events found dispatching network-vif-plugged-550bb78f-7337-4bae-90f0-f211ba6121ff {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:09:32 user nova-compute[73258]: WARNING nova.compute.manager [req-8cd884cb-667c-4bf2-9529-da16e2a817b2 req-6ae17a98-fdf7-4b98-bdc2-d6830c2b9229 service nova] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Received unexpected event network-vif-plugged-550bb78f-7337-4bae-90f0-f211ba6121ff for instance with vm_state deleted and task_state None.
Aug 27 07:09:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-1b95de7e-d04e-4e19-aef4-1978e5deadac tempest-TestServerVolumeAttachScenarioOldVersion-149034104 tempest-TestServerVolumeAttachScenarioOldVersion-149034104-project-member] Lock "1570970a-1b5c-44f6-9326-e7574ce9fe6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.713s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:09:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 07:09:42 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Creating image(s)
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Did not create local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Ensure instance console log exists: /opt/stack/data/nova/instances/f6e889b1-019d-4b6a-999f-0ef0f0ad2858/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Start _get_guest_xml network_info=[{"id": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "address": "fa:16:3e:88:5e:da", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cad33f-37", "ovs_interfaceid": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbNHRhjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f6e889b1-019d-4b6a-999f-0ef0f0ad2858', 'attached_at': '', 'detached_at': '', 'volume_id': 'f04e17a8-deae-4a95-b511-e2e3cbb51544', 'serial': 'f04e17a8-deae-4a95-b511-e2e3cbb51544'}, 'attachment_id': '1aa83c2b-6468-4812-89f4-504e3cea8217', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 07:09:42 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:09:42 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbNHRhjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:09:42 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:09:42 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:09:42 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf30c5a-08c5-42fb-82d1-e2b9e0f07928]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 07:09:42 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[206cdb0b-1575-48a9-bfcc-28ba99502c3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544] added
Aug 27 07:09:42 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ba228e-1e93-45c3-b705-447ad352900d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c13882-d974-422a-a574-f160b9fb72d5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EbNHRhjU {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EbNHRhjU" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fb8d88-824d-4a02-9398-0e4dcaf56592]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EbNHRhjU'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8610ad6-e3ce-40bb-8701-eb65d7d63fbb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca07c57c-d9a3-40ef-acac-50499e38c5a2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 07:09:42 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 07:09:42 user nova-compute[73258]:  {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:09:42 user nova-compute[73258]: WARNING os_brick.initiator.connectors.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 07:09:42 user nova-compute[73258]: 
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae69cf5-0453-43eb-8602-72334e409284]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544, portal: 172.16.0.220,3260]
Aug 27 07:09:42 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544, portal: 172.16.0.220,3260] successful.
Aug 27 07:09:42 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c76136-506d-48c8-a4fd-1b49e9483c9e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacdbbf9-69dd-44d8-a028-695663ffde74]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 (non-flash)
Aug 27 07:09:42 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 (non-flash)
Aug 27 07:09:42 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9083e6f-d6b6-4e84-b249-70f08af80398]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 07:09:42 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbNHRhjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26561613634613566', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561613634613566', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-754379188',display_name='tempest-TestVolumeBootPattern-volume-backed-server-754379188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-754379188',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIjtNaRmlI45Ypkna4MeLxpYJLeI+orgVQCQ1fbD0C1rmtWy8jOo4NvqTCaI/oQmbhMIY8Dm9NK/rgE9jqx1xbVAZ0Iqi/9HlrXrJXKa/DFc/us1kka6LAmPgnABxTXYQ==',key_name='tempest-keypair-732280238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='002188a1020a4181a03ce17d46608664',ramdisk_id='',reservation_id='r-wt13b3s7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-833647414',owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:09:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75d7a7c63b654c47b9df519798186007',uuid=f6e889b1-019d-4b6a-999f-0ef0f0ad2858,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "address": "fa:16:3e:88:5e:da", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cad33f-37", "ovs_interfaceid": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converting VIF {"id": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "address": "fa:16:3e:88:5e:da", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cad33f-37", "ovs_interfaceid": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:5e:da,bridge_name='br-int',has_traffic_filtering=True,id=d8cad33f-3766-4dc0-acb5-bed876f80e54,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cad33f-37') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG nova.objects.instance [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lazy-loading 'pci_devices' on Instance uuid f6e889b1-019d-4b6a-999f-0ef0f0ad2858 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] End _get_guest_xml xml=<domain type="kvm">
Aug 27 07:09:43 user nova-compute[73258]:   <uuid>f6e889b1-019d-4b6a-999f-0ef0f0ad2858</uuid>
Aug 27 07:09:43 user nova-compute[73258]:   <name>instance-00000030</name>
Aug 27 07:09:43 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 07:09:43 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 07:09:43 user nova-compute[73258]:   <metadata>
Aug 27 07:09:43 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 07:09:43 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 07:09:43 user nova-compute[73258]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-754379188</nova:name>
Aug 27 07:09:43 user nova-compute[73258]:       <nova:creationTime>2023-08-27 07:09:42</nova:creationTime>
Aug 27 07:09:43 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 07:09:43 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 07:09:43 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 07:09:43 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 07:09:43 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 07:09:43 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 07:09:43 user nova-compute[73258]:       </nova:flavor>
Aug 27 07:09:43 user nova-compute[73258]:       <nova:owner>
Aug 27 07:09:43 user nova-compute[73258]:         <nova:user uuid="75d7a7c63b654c47b9df519798186007">tempest-TestVolumeBootPattern-833647414-project-member</nova:user>
Aug 27 07:09:43 user nova-compute[73258]:         <nova:project uuid="002188a1020a4181a03ce17d46608664">tempest-TestVolumeBootPattern-833647414</nova:project>
Aug 27 07:09:43 user nova-compute[73258]:       </nova:owner>
Aug 27 07:09:43 user nova-compute[73258]:       <nova:ports>
Aug 27 07:09:43 user nova-compute[73258]:         <nova:port uuid="d8cad33f-3766-4dc0-acb5-bed876f80e54">
Aug 27 07:09:43 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 07:09:43 user nova-compute[73258]:         </nova:port>
Aug 27 07:09:43 user nova-compute[73258]:       </nova:ports>
Aug 27 07:09:43 user nova-compute[73258]:     </nova:instance>
Aug 27 07:09:43 user nova-compute[73258]:   </metadata>
Aug 27 07:09:43 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 07:09:43 user nova-compute[73258]:     <system>
Aug 27 07:09:43 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 07:09:43 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 07:09:43 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 07:09:43 user nova-compute[73258]:       <entry name="serial">f6e889b1-019d-4b6a-999f-0ef0f0ad2858</entry>
Aug 27 07:09:43 user nova-compute[73258]:       <entry name="uuid">f6e889b1-019d-4b6a-999f-0ef0f0ad2858</entry>
Aug 27 07:09:43 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 07:09:43 user nova-compute[73258]:     </system>
Aug 27 07:09:43 user nova-compute[73258]:   </sysinfo>
Aug 27 07:09:43 user nova-compute[73258]:   <os>
Aug 27 07:09:43 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 07:09:43 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 07:09:43 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 07:09:43 user nova-compute[73258]:   </os>
Aug 27 07:09:43 user nova-compute[73258]:   <features>
Aug 27 07:09:43 user nova-compute[73258]:     <acpi/>
Aug 27 07:09:43 user nova-compute[73258]:     <apic/>
Aug 27 07:09:43 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 07:09:43 user nova-compute[73258]:   </features>
Aug 27 07:09:43 user nova-compute[73258]:   <clock offset="utc">
Aug 27 07:09:43 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 07:09:43 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 07:09:43 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 07:09:43 user nova-compute[73258]:   </clock>
Aug 27 07:09:43 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 07:09:43 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 07:09:43 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 07:09:43 user nova-compute[73258]:   </cpu>
Aug 27 07:09:43 user nova-compute[73258]:   <devices>
Aug 27 07:09:43 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 07:09:43 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:09:43 user nova-compute[73258]:       <source dev="/dev/sdb"/>
Aug 27 07:09:43 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 07:09:43 user nova-compute[73258]:       <serial>f04e17a8-deae-4a95-b511-e2e3cbb51544</serial>
Aug 27 07:09:43 user nova-compute[73258]:     </disk>
Aug 27 07:09:43 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 07:09:43 user nova-compute[73258]:       <mac address="fa:16:3e:88:5e:da"/>
Aug 27 07:09:43 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:09:43 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 07:09:43 user nova-compute[73258]:       <target dev="tapd8cad33f-37"/>
Aug 27 07:09:43 user nova-compute[73258]:     </interface>
Aug 27 07:09:43 user nova-compute[73258]:     <serial type="pty">
Aug 27 07:09:43 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/f6e889b1-019d-4b6a-999f-0ef0f0ad2858/console.log" append="off"/>
Aug 27 07:09:43 user nova-compute[73258]:     </serial>
Aug 27 07:09:43 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 07:09:43 user nova-compute[73258]:     <video>
Aug 27 07:09:43 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:09:43 user nova-compute[73258]:     </video>
Aug 27 07:09:43 user nova-compute[73258]:     <rng model="virtio">
Aug 27 07:09:43 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 07:09:43 user nova-compute[73258]:     </rng>
Aug 27 07:09:43 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 07:09:43 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 07:09:43 user nova-compute[73258]:       <stats period="10"/>
Aug 27 07:09:43 user nova-compute[73258]:     </memballoon>
Aug 27 07:09:43 user nova-compute[73258]:   </devices>
Aug 27 07:09:43 user nova-compute[73258]: </domain>
Aug 27 07:09:43 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-754379188',display_name='tempest-TestVolumeBootPattern-volume-backed-server-754379188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-754379188',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIjtNaRmlI45Ypkna4MeLxpYJLeI+orgVQCQ1fbD0C1rmtWy8jOo4NvqTCaI/oQmbhMIY8Dm9NK/rgE9jqx1xbVAZ0Iqi/9HlrXrJXKa/DFc/us1kka6LAmPgnABxTXYQ==',key_name='tempest-keypair-732280238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='002188a1020a4181a03ce17d46608664',ramdisk_id='',reservation_id='r-wt13b3s7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-833647414',owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:09:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75d7a7c63b654c47b9df519798186007',uuid=f6e889b1-019d-4b6a-999f-0ef0f0ad2858,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "address": "fa:16:3e:88:5e:da", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cad33f-37", "ovs_interfaceid": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converting VIF {"id": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "address": "fa:16:3e:88:5e:da", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cad33f-37", "ovs_interfaceid": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:5e:da,bridge_name='br-int',has_traffic_filtering=True,id=d8cad33f-3766-4dc0-acb5-bed876f80e54,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cad33f-37') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG os_vif [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:5e:da,bridge_name='br-int',has_traffic_filtering=True,id=d8cad33f-3766-4dc0-acb5-bed876f80e54,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cad33f-37') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8cad33f-37, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8cad33f-37, col_values=(('external_ids', {'iface-id': 'd8cad33f-3766-4dc0-acb5-bed876f80e54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:5e:da', 'vm-uuid': 'f6e889b1-019d-4b6a-999f-0ef0f0ad2858'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:43 user nova-compute[73258]: INFO os_vif [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:5e:da,bridge_name='br-int',has_traffic_filtering=True,id=d8cad33f-3766-4dc0-acb5-bed876f80e54,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cad33f-37')
Aug 27 07:09:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:09:43 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] No VIF found with MAC fa:16:3e:88:5e:da, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 07:09:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:45 user nova-compute[73258]: DEBUG nova.compute.manager [req-fcb32783-a0cb-44f1-a519-7a28a7db0592 req-fa27e188-792f-4f55-87ac-f2f7515b07a8 service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Received event network-vif-plugged-d8cad33f-3766-4dc0-acb5-bed876f80e54 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:09:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fcb32783-a0cb-44f1-a519-7a28a7db0592 req-fa27e188-792f-4f55-87ac-f2f7515b07a8 service nova] Acquiring lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:09:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fcb32783-a0cb-44f1-a519-7a28a7db0592 req-fa27e188-792f-4f55-87ac-f2f7515b07a8 service nova] Lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:09:45 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fcb32783-a0cb-44f1-a519-7a28a7db0592 req-fa27e188-792f-4f55-87ac-f2f7515b07a8 service nova] Lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:09:45 user nova-compute[73258]: DEBUG nova.compute.manager [req-fcb32783-a0cb-44f1-a519-7a28a7db0592 req-fa27e188-792f-4f55-87ac-f2f7515b07a8 service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] No waiting events found dispatching network-vif-plugged-d8cad33f-3766-4dc0-acb5-bed876f80e54 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:09:45 user nova-compute[73258]: WARNING nova.compute.manager [req-fcb32783-a0cb-44f1-a519-7a28a7db0592 req-fa27e188-792f-4f55-87ac-f2f7515b07a8 service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Received unexpected event network-vif-plugged-d8cad33f-3766-4dc0-acb5-bed876f80e54 for instance with vm_state building and task_state spawning.
Aug 27 07:09:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:45 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693120170.8058655, 1570970a-1b5c-44f6-9326-e7574ce9fe6f => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:09:45 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] VM Stopped (Lifecycle Event)
Aug 27 07:09:45 user nova-compute[73258]: DEBUG nova.compute.manager [None req-5f308404-720d-4f83-a80a-ae10b1c88edd None None] [instance: 1570970a-1b5c-44f6-9326-e7574ce9fe6f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:09:47 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693120187.2702234, f6e889b1-019d-4b6a-999f-0ef0f0ad2858 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:09:47 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] VM Resumed (Lifecycle Event)
Aug 27 07:09:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 07:09:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 07:09:47 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Instance spawned successfully.
Aug 27 07:09:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 07:09:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:09:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:09:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:09:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:09:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:09:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:09:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:09:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:09:47 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:09:47 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693120187.2719033, f6e889b1-019d-4b6a-999f-0ef0f0ad2858 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:09:47 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] VM Started (Lifecycle Event)
Aug 27 07:09:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:09:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:09:47 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:09:47 user nova-compute[73258]: DEBUG nova.compute.manager [req-077a8d74-9dfd-4fde-95e4-3ccc8ed327d3 req-8bd5bc67-559e-4343-ad00-161f4ea9b104 service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Received event network-vif-plugged-d8cad33f-3766-4dc0-acb5-bed876f80e54 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:09:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-077a8d74-9dfd-4fde-95e4-3ccc8ed327d3 req-8bd5bc67-559e-4343-ad00-161f4ea9b104 service nova] Acquiring lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:09:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-077a8d74-9dfd-4fde-95e4-3ccc8ed327d3 req-8bd5bc67-559e-4343-ad00-161f4ea9b104 service nova] Lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:09:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-077a8d74-9dfd-4fde-95e4-3ccc8ed327d3 req-8bd5bc67-559e-4343-ad00-161f4ea9b104 service nova] Lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:09:47 user nova-compute[73258]: DEBUG nova.compute.manager [req-077a8d74-9dfd-4fde-95e4-3ccc8ed327d3 req-8bd5bc67-559e-4343-ad00-161f4ea9b104 service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] No waiting events found dispatching network-vif-plugged-d8cad33f-3766-4dc0-acb5-bed876f80e54 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:09:47 user nova-compute[73258]: WARNING nova.compute.manager [req-077a8d74-9dfd-4fde-95e4-3ccc8ed327d3 req-8bd5bc67-559e-4343-ad00-161f4ea9b104 service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Received unexpected event network-vif-plugged-d8cad33f-3766-4dc0-acb5-bed876f80e54 for instance with vm_state building and task_state spawning.
Aug 27 07:09:47 user nova-compute[73258]: INFO nova.compute.manager [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Took 5.07 seconds to spawn the instance on the hypervisor.
Aug 27 07:09:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:09:47 user nova-compute[73258]: INFO nova.compute.manager [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Took 20.89 seconds to build instance.
Aug 27 07:09:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-e2e550c5-a0da-431a-b967-89359c43b721 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.990s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:09:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:09:57 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:09:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:10:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:10:03 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:10:03 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:10:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:10:05 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:10:05 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:10:05 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:10:06 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:10:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:10:09 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:10:09 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:10:09 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 07:10:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:10:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:10:09 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 07:10:09 user nova-compute[73258]: DEBUG nova.objects.instance [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lazy-loading 'info_cache' on Instance uuid f6e889b1-019d-4b6a-999f-0ef0f0ad2858 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:10:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:10:10 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Updating instance_info_cache with network_info: [{"id": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "address": "fa:16:3e:88:5e:da", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cad33f-37", "ovs_interfaceid": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:10:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:10:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 07:10:10 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:10:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:10:13 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:10:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:10:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:10:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:10:13 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:10:14 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:10:14 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:10:14 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:10:14 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8623MB free_disk=23.95037841796875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:10:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:10:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:10:14 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance f6e889b1-019d-4b6a-999f-0ef0f0ad2858 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:10:14 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:10:14 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:10:14 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:10:14 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:10:14 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:10:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:10:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:10:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:10:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:10:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:10:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:10:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:10:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:10:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:10:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:10:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:10:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:10:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:10:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:10:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:10:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:10:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:10:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:10:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:10:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:10:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:10:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:10:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:10:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:10:59 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:11:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:05 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:11:05 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:11:05 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:11:06 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:11:06 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:11:07 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:11:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:11 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:11:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:11:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 07:11:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:11:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:11:11 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 07:11:11 user nova-compute[73258]: DEBUG nova.objects.instance [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lazy-loading 'info_cache' on Instance uuid f6e889b1-019d-4b6a-999f-0ef0f0ad2858 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:11:12 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Updating instance_info_cache with network_info: [{"id": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "address": "fa:16:3e:88:5e:da", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cad33f-37", "ovs_interfaceid": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:11:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:11:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 07:11:12 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:11:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:11:13 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:11:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:11:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:11:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:11:13 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:11:13 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:11:14 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:11:14 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:11:14 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8815MB free_disk=23.94915008544922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:11:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:11:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:11:14 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance f6e889b1-019d-4b6a-999f-0ef0f0ad2858 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:11:14 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:11:14 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:11:14 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:11:14 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:11:14 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:11:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:11:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-7576b084-51b2-4470-bb16-45a57b2b2255 req-34004455-fe60-43e4-b87b-bcb69672a024 service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Received event network-changed-d8cad33f-3766-4dc0-acb5-bed876f80e54 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:11:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-7576b084-51b2-4470-bb16-45a57b2b2255 req-34004455-fe60-43e4-b87b-bcb69672a024 service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Refreshing instance network info cache due to event network-changed-d8cad33f-3766-4dc0-acb5-bed876f80e54. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:11:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7576b084-51b2-4470-bb16-45a57b2b2255 req-34004455-fe60-43e4-b87b-bcb69672a024 service nova] Acquiring lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:11:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7576b084-51b2-4470-bb16-45a57b2b2255 req-34004455-fe60-43e4-b87b-bcb69672a024 service nova] Acquired lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:11:17 user nova-compute[73258]: DEBUG nova.network.neutron [req-7576b084-51b2-4470-bb16-45a57b2b2255 req-34004455-fe60-43e4-b87b-bcb69672a024 service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Refreshing network info cache for port d8cad33f-3766-4dc0-acb5-bed876f80e54 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:11:18 user nova-compute[73258]: DEBUG nova.network.neutron [req-7576b084-51b2-4470-bb16-45a57b2b2255 req-34004455-fe60-43e4-b87b-bcb69672a024 service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Updated VIF entry in instance network info cache for port d8cad33f-3766-4dc0-acb5-bed876f80e54. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:11:18 user nova-compute[73258]: DEBUG nova.network.neutron [req-7576b084-51b2-4470-bb16-45a57b2b2255 req-34004455-fe60-43e4-b87b-bcb69672a024 service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Updating instance_info_cache with network_info: [{"id": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "address": "fa:16:3e:88:5e:da", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cad33f-37", "ovs_interfaceid": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:11:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-7576b084-51b2-4470-bb16-45a57b2b2255 req-34004455-fe60-43e4-b87b-bcb69672a024 service nova] Releasing lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:11:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:11:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:11:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:11:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:11:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:25 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:11:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:11:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:11:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 07:11:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:11:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:11:30 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 07:11:30 user nova-compute[73258]: INFO nova.compute.claims [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Claim successful on node user
Aug 27 07:11:30 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:11:30 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:11:30 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:11:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 07:11:31 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 07:11:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 07:11:31 user nova-compute[73258]: DEBUG nova.network.neutron [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 07:11:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 07:11:31 user nova-compute[73258]: INFO nova.virt.block_device [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Booting with volume snapshot cb944acf-cea5-45fd-bc10-876bfc06a53e at /dev/vda
Aug 27 07:11:31 user nova-compute[73258]: DEBUG nova.policy [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75d7a7c63b654c47b9df519798186007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002188a1020a4181a03ce17d46608664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 07:11:31 user nova-compute[73258]: DEBUG nova.network.neutron [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Successfully created port: ff49c5cc-8921-42e3-83e2-5619328d23e4 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 07:11:32 user nova-compute[73258]: DEBUG nova.network.neutron [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Successfully updated port: ff49c5cc-8921-42e3-83e2-5619328d23e4 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 07:11:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "refresh_cache-89edc448-2d1a-4c42-a7a8-22eba9090e4f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:11:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquired lock "refresh_cache-89edc448-2d1a-4c42-a7a8-22eba9090e4f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:11:32 user nova-compute[73258]: DEBUG nova.network.neutron [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 07:11:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-3e16bc77-ab2b-4083-9601-8046249c3191 req-4fd7d4ab-bba9-40e5-aa36-9e5326edd1cb service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Received event network-changed-ff49c5cc-8921-42e3-83e2-5619328d23e4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:11:32 user nova-compute[73258]: DEBUG nova.compute.manager [req-3e16bc77-ab2b-4083-9601-8046249c3191 req-4fd7d4ab-bba9-40e5-aa36-9e5326edd1cb service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Refreshing instance network info cache due to event network-changed-ff49c5cc-8921-42e3-83e2-5619328d23e4. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:11:32 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3e16bc77-ab2b-4083-9601-8046249c3191 req-4fd7d4ab-bba9-40e5-aa36-9e5326edd1cb service nova] Acquiring lock "refresh_cache-89edc448-2d1a-4c42-a7a8-22eba9090e4f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:11:32 user nova-compute[73258]: DEBUG nova.network.neutron [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 07:11:33 user nova-compute[73258]: DEBUG nova.network.neutron [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Updating instance_info_cache with network_info: [{"id": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "address": "fa:16:3e:66:60:5c", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff49c5cc-89", "ovs_interfaceid": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:11:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Releasing lock "refresh_cache-89edc448-2d1a-4c42-a7a8-22eba9090e4f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:11:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Instance network_info: |[{"id": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "address": "fa:16:3e:66:60:5c", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff49c5cc-89", "ovs_interfaceid": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 07:11:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3e16bc77-ab2b-4083-9601-8046249c3191 req-4fd7d4ab-bba9-40e5-aa36-9e5326edd1cb service nova] Acquired lock "refresh_cache-89edc448-2d1a-4c42-a7a8-22eba9090e4f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:11:33 user nova-compute[73258]: DEBUG nova.network.neutron [req-3e16bc77-ab2b-4083-9601-8046249c3191 req-4fd7d4ab-bba9-40e5-aa36-9e5326edd1cb service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Refreshing network info cache for port ff49c5cc-8921-42e3-83e2-5619328d23e4 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:11:33 user nova-compute[73258]: DEBUG nova.network.neutron [req-3e16bc77-ab2b-4083-9601-8046249c3191 req-4fd7d4ab-bba9-40e5-aa36-9e5326edd1cb service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Updated VIF entry in instance network info cache for port ff49c5cc-8921-42e3-83e2-5619328d23e4. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:11:33 user nova-compute[73258]: DEBUG nova.network.neutron [req-3e16bc77-ab2b-4083-9601-8046249c3191 req-4fd7d4ab-bba9-40e5-aa36-9e5326edd1cb service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Updating instance_info_cache with network_info: [{"id": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "address": "fa:16:3e:66:60:5c", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff49c5cc-89", "ovs_interfaceid": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:11:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3e16bc77-ab2b-4083-9601-8046249c3191 req-4fd7d4ab-bba9-40e5-aa36-9e5326edd1cb service nova] Releasing lock "refresh_cache-89edc448-2d1a-4c42-a7a8-22eba9090e4f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:11:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:11:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:11:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:11:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:11:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG os_brick.utils [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1fd931-5901-49d7-b208-b6ffe2f4fb92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad0ab1a-4025-4ce5-a01f-2f452c0a7a21]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb91b4b8-229f-4ae6-820a-8ff9c45be457]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a3472c-47d3-4908-9ba9-ce7ebc8f3d9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:11:36 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 07:11:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7280a4a7-536a-4055-b1ec-91a6df1d7ffa]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG os_brick.utils [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:11:36 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Updating existing volume attachment record: 15d3fc38-a330-44ff-b7af-e05dbcffce0e {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 07:11:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.compute.manager [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 07:11:47 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Creating image(s)
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Did not create local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Ensure instance console log exists: /opt/stack/data/nova/instances/89edc448-2d1a-4c42-a7a8-22eba9090e4f/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Start _get_guest_xml network_info=[{"id": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "address": "fa:16:3e:66:60:5c", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff49c5cc-89", "ovs_interfaceid": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-27T07:11:19Z,direct_url=<?>,disk_format='qcow2',id=362036ae-e39a-4747-9eef-020ae5f5b03c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1742832218',owner='002188a1020a4181a03ce17d46608664',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-27T07:11:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NtfnSevY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '89edc448-2d1a-4c42-a7a8-22eba9090e4f', 'attached_at': '', 'detached_at': '', 'volume_id': '81227c9b-a523-41a2-98a9-d4d9175ece69', 'serial': '81227c9b-a523-41a2-98a9-d4d9175ece69'}, 'attachment_id': '15d3fc38-a330-44ff-b7af-e05dbcffce0e', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 07:11:47 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:11:47 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-27T07:11:19Z,direct_url=<?>,disk_format='qcow2',id=362036ae-e39a-4747-9eef-020ae5f5b03c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1742832218',owner='002188a1020a4181a03ce17d46608664',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-27T07:11:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NtfnSevY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:11:47 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:11:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:11:47 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:11:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:11:47 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 07:11:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d9bf60-e6a9-47e7-8f35-3b31d3ac5a8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 07:11:47 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[02143649-c587-44c0-8825-30387e91890a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69] added
Aug 27 07:11:47 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebcb37a-aa0a-4913-ab47-914a606cf461]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f79b2cb-474b-4835-8454-c9f49f8e0b8f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:11:47 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NtfnSevY {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NtfnSevY" returned: 0 in 0.126s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bd9da2-d13e-47b4-b36f-b2b8194e427e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NtfnSevY'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb07e88a-43d0-424f-9d3d-755908a4e459]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1966d6-252d-473e-9c5a-d631173d804c]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 (non-flash)
Aug 27 07:11:48 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 (non-flash)
Aug 27 07:11:48 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3719569e-4744-48b0-b797-056dc9df7d7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69, portal: 172.16.0.220,3260]
Aug 27 07:11:48 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69, portal: 172.16.0.220,3260] successful.
Aug 27 07:11:48 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2b3d95-bdfb-4b4c-9921-ca4440db5741]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c7fb37-fd18-4365-af8f-58c5c4489b8c]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 (non-flash)
Aug 27 07:11:48 user nova-compute[73258]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 (non-flash)
Aug 27 07:11:48 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 (non-flash)
Aug 27 07:11:48 user nova-compute[73258]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 (non-flash)
Aug 27 07:11:48 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1839e79f-0d62-43b1-a441-dae69f53fc2e]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: None {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:11:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NtfnSevY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23562633838653539', 'path': '/dev/sdc'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562633838653539', 'path': '/dev/sdc'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:11:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-70045307',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-70045307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-70045307',id=49,image_ref='362036ae-e39a-4747-9eef-020ae5f5b03c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvSfql+8tCcR/hfQKp62OLIHBJtLkhgNgl2A4HGLQJTO8chrkeApa5FsJM3dKu0DGlmpPSNyxKfjIjkYo5Jy0qWU7U9BnozH9rkr2bmvJM9Zp9zqb1PSuvhmGtF0vSXLQ==',key_name='tempest-keypair-657698306',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='002188a1020a4181a03ce17d46608664',ramdisk_id='',reservation_id='r-4s2sglnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-833647414',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-833647414',owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:11:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75d7a7c63b654c47b9df519798186007',uuid=89edc448-2d1a-4c42-a7a8-22eba9090e4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "address": "fa:16:3e:66:60:5c", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff49c5cc-89", "ovs_interfaceid": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converting VIF {"id": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "address": "fa:16:3e:66:60:5c", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff49c5cc-89", "ovs_interfaceid": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:60:5c,bridge_name='br-int',has_traffic_filtering=True,id=ff49c5cc-8921-42e3-83e2-5619328d23e4,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff49c5cc-89') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG nova.objects.instance [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lazy-loading 'pci_devices' on Instance uuid 89edc448-2d1a-4c42-a7a8-22eba9090e4f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 07:11:49 user nova-compute[73258]:   <uuid>89edc448-2d1a-4c42-a7a8-22eba9090e4f</uuid>
Aug 27 07:11:49 user nova-compute[73258]:   <name>instance-00000031</name>
Aug 27 07:11:49 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 07:11:49 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 07:11:49 user nova-compute[73258]:   <metadata>
Aug 27 07:11:49 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 07:11:49 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 07:11:49 user nova-compute[73258]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-70045307</nova:name>
Aug 27 07:11:49 user nova-compute[73258]:       <nova:creationTime>2023-08-27 07:11:47</nova:creationTime>
Aug 27 07:11:49 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 07:11:49 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 07:11:49 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 07:11:49 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 07:11:49 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 07:11:49 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 07:11:49 user nova-compute[73258]:       </nova:flavor>
Aug 27 07:11:49 user nova-compute[73258]:       <nova:owner>
Aug 27 07:11:49 user nova-compute[73258]:         <nova:user uuid="75d7a7c63b654c47b9df519798186007">tempest-TestVolumeBootPattern-833647414-project-member</nova:user>
Aug 27 07:11:49 user nova-compute[73258]:         <nova:project uuid="002188a1020a4181a03ce17d46608664">tempest-TestVolumeBootPattern-833647414</nova:project>
Aug 27 07:11:49 user nova-compute[73258]:       </nova:owner>
Aug 27 07:11:49 user nova-compute[73258]:       <nova:root type="image" uuid="362036ae-e39a-4747-9eef-020ae5f5b03c"/>
Aug 27 07:11:49 user nova-compute[73258]:       <nova:ports>
Aug 27 07:11:49 user nova-compute[73258]:         <nova:port uuid="ff49c5cc-8921-42e3-83e2-5619328d23e4">
Aug 27 07:11:49 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 07:11:49 user nova-compute[73258]:         </nova:port>
Aug 27 07:11:49 user nova-compute[73258]:       </nova:ports>
Aug 27 07:11:49 user nova-compute[73258]:     </nova:instance>
Aug 27 07:11:49 user nova-compute[73258]:   </metadata>
Aug 27 07:11:49 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 07:11:49 user nova-compute[73258]:     <system>
Aug 27 07:11:49 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 07:11:49 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 07:11:49 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 07:11:49 user nova-compute[73258]:       <entry name="serial">89edc448-2d1a-4c42-a7a8-22eba9090e4f</entry>
Aug 27 07:11:49 user nova-compute[73258]:       <entry name="uuid">89edc448-2d1a-4c42-a7a8-22eba9090e4f</entry>
Aug 27 07:11:49 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 07:11:49 user nova-compute[73258]:     </system>
Aug 27 07:11:49 user nova-compute[73258]:   </sysinfo>
Aug 27 07:11:49 user nova-compute[73258]:   <os>
Aug 27 07:11:49 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 07:11:49 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 07:11:49 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 07:11:49 user nova-compute[73258]:   </os>
Aug 27 07:11:49 user nova-compute[73258]:   <features>
Aug 27 07:11:49 user nova-compute[73258]:     <acpi/>
Aug 27 07:11:49 user nova-compute[73258]:     <apic/>
Aug 27 07:11:49 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 07:11:49 user nova-compute[73258]:   </features>
Aug 27 07:11:49 user nova-compute[73258]:   <clock offset="utc">
Aug 27 07:11:49 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 07:11:49 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 07:11:49 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 07:11:49 user nova-compute[73258]:   </clock>
Aug 27 07:11:49 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 07:11:49 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 07:11:49 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 07:11:49 user nova-compute[73258]:   </cpu>
Aug 27 07:11:49 user nova-compute[73258]:   <devices>
Aug 27 07:11:49 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 07:11:49 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:11:49 user nova-compute[73258]:       <source dev="/dev/sdc"/>
Aug 27 07:11:49 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 07:11:49 user nova-compute[73258]:       <serial>81227c9b-a523-41a2-98a9-d4d9175ece69</serial>
Aug 27 07:11:49 user nova-compute[73258]:     </disk>
Aug 27 07:11:49 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 07:11:49 user nova-compute[73258]:       <mac address="fa:16:3e:66:60:5c"/>
Aug 27 07:11:49 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:11:49 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 07:11:49 user nova-compute[73258]:       <target dev="tapff49c5cc-89"/>
Aug 27 07:11:49 user nova-compute[73258]:     </interface>
Aug 27 07:11:49 user nova-compute[73258]:     <serial type="pty">
Aug 27 07:11:49 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/89edc448-2d1a-4c42-a7a8-22eba9090e4f/console.log" append="off"/>
Aug 27 07:11:49 user nova-compute[73258]:     </serial>
Aug 27 07:11:49 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 07:11:49 user nova-compute[73258]:     <video>
Aug 27 07:11:49 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:11:49 user nova-compute[73258]:     </video>
Aug 27 07:11:49 user nova-compute[73258]:     <rng model="virtio">
Aug 27 07:11:49 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 07:11:49 user nova-compute[73258]:     </rng>
Aug 27 07:11:49 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 07:11:49 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 07:11:49 user nova-compute[73258]:       <stats period="10"/>
Aug 27 07:11:49 user nova-compute[73258]:     </memballoon>
Aug 27 07:11:49 user nova-compute[73258]:   </devices>
Aug 27 07:11:49 user nova-compute[73258]: </domain>
Aug 27 07:11:49 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:11:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-70045307',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-70045307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-70045307',id=49,image_ref='362036ae-e39a-4747-9eef-020ae5f5b03c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvSfql+8tCcR/hfQKp62OLIHBJtLkhgNgl2A4HGLQJTO8chrkeApa5FsJM3dKu0DGlmpPSNyxKfjIjkYo5Jy0qWU7U9BnozH9rkr2bmvJM9Zp9zqb1PSuvhmGtF0vSXLQ==',key_name='tempest-keypair-657698306',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='002188a1020a4181a03ce17d46608664',ramdisk_id='',reservation_id='r-4s2sglnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-833647414',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-833647414',owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:11:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75d7a7c63b654c47b9df519798186007',uuid=89edc448-2d1a-4c42-a7a8-22eba9090e4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "address": "fa:16:3e:66:60:5c", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff49c5cc-89", "ovs_interfaceid": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converting VIF {"id": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "address": "fa:16:3e:66:60:5c", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff49c5cc-89", "ovs_interfaceid": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:60:5c,bridge_name='br-int',has_traffic_filtering=True,id=ff49c5cc-8921-42e3-83e2-5619328d23e4,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff49c5cc-89') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG os_vif [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:60:5c,bridge_name='br-int',has_traffic_filtering=True,id=ff49c5cc-8921-42e3-83e2-5619328d23e4,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff49c5cc-89') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff49c5cc-89, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff49c5cc-89, col_values=(('external_ids', {'iface-id': 'ff49c5cc-8921-42e3-83e2-5619328d23e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:60:5c', 'vm-uuid': '89edc448-2d1a-4c42-a7a8-22eba9090e4f'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:49 user nova-compute[73258]: INFO os_vif [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:60:5c,bridge_name='br-int',has_traffic_filtering=True,id=ff49c5cc-8921-42e3-83e2-5619328d23e4,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff49c5cc-89')
Aug 27 07:11:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:11:49 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] No VIF found with MAC fa:16:3e:66:60:5c, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 07:11:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:50 user nova-compute[73258]: DEBUG nova.compute.manager [req-1e8f8675-8221-4439-afc9-b11b56560aef req-b559e39f-a8f8-49d6-b3a4-dfc2228d1fd6 service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Received event network-vif-plugged-ff49c5cc-8921-42e3-83e2-5619328d23e4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:11:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1e8f8675-8221-4439-afc9-b11b56560aef req-b559e39f-a8f8-49d6-b3a4-dfc2228d1fd6 service nova] Acquiring lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:11:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1e8f8675-8221-4439-afc9-b11b56560aef req-b559e39f-a8f8-49d6-b3a4-dfc2228d1fd6 service nova] Lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:11:50 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-1e8f8675-8221-4439-afc9-b11b56560aef req-b559e39f-a8f8-49d6-b3a4-dfc2228d1fd6 service nova] Lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:11:50 user nova-compute[73258]: DEBUG nova.compute.manager [req-1e8f8675-8221-4439-afc9-b11b56560aef req-b559e39f-a8f8-49d6-b3a4-dfc2228d1fd6 service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] No waiting events found dispatching network-vif-plugged-ff49c5cc-8921-42e3-83e2-5619328d23e4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:11:50 user nova-compute[73258]: WARNING nova.compute.manager [req-1e8f8675-8221-4439-afc9-b11b56560aef req-b559e39f-a8f8-49d6-b3a4-dfc2228d1fd6 service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Received unexpected event network-vif-plugged-ff49c5cc-8921-42e3-83e2-5619328d23e4 for instance with vm_state building and task_state spawning.
Aug 27 07:11:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:52 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693120312.882009, 89edc448-2d1a-4c42-a7a8-22eba9090e4f => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:11:52 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] VM Resumed (Lifecycle Event)
Aug 27 07:11:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 07:11:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 07:11:52 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Instance spawned successfully.
Aug 27 07:11:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 07:11:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:11:52 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:11:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:11:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:11:52 user nova-compute[73258]: DEBUG nova.compute.manager [req-d9ef6406-208e-48b4-af66-b84868671e28 req-da9d75f2-7be7-4149-a3c0-daec1ab41869 service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Received event network-vif-plugged-ff49c5cc-8921-42e3-83e2-5619328d23e4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:11:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d9ef6406-208e-48b4-af66-b84868671e28 req-da9d75f2-7be7-4149-a3c0-daec1ab41869 service nova] Acquiring lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:11:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d9ef6406-208e-48b4-af66-b84868671e28 req-da9d75f2-7be7-4149-a3c0-daec1ab41869 service nova] Lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:11:52 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-d9ef6406-208e-48b4-af66-b84868671e28 req-da9d75f2-7be7-4149-a3c0-daec1ab41869 service nova] Lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:11:52 user nova-compute[73258]: DEBUG nova.compute.manager [req-d9ef6406-208e-48b4-af66-b84868671e28 req-da9d75f2-7be7-4149-a3c0-daec1ab41869 service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] No waiting events found dispatching network-vif-plugged-ff49c5cc-8921-42e3-83e2-5619328d23e4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:11:52 user nova-compute[73258]: WARNING nova.compute.manager [req-d9ef6406-208e-48b4-af66-b84868671e28 req-da9d75f2-7be7-4149-a3c0-daec1ab41869 service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Received unexpected event network-vif-plugged-ff49c5cc-8921-42e3-83e2-5619328d23e4 for instance with vm_state building and task_state spawning.
Aug 27 07:11:52 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:11:52 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693120312.8838327, 89edc448-2d1a-4c42-a7a8-22eba9090e4f => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:11:52 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] VM Started (Lifecycle Event)
Aug 27 07:11:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:11:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:11:52 user nova-compute[73258]: INFO nova.compute.manager [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Took 5.24 seconds to spawn the instance on the hypervisor.
Aug 27 07:11:52 user nova-compute[73258]: DEBUG nova.compute.manager [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:11:52 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:11:53 user nova-compute[73258]: INFO nova.compute.manager [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Took 22.43 seconds to build instance.
Aug 27 07:11:53 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-aba7b392-6b70-4b96-91ac-5126ce6ea4bc tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.521s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:11:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:11:59 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:12:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:12:05 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:12:06 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:12:06 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:12:06 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:12:07 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:12:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:12:09 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:12:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:12:11 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:12:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:12:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 07:12:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:12:11 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:12:11 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 07:12:11 user nova-compute[73258]: DEBUG nova.objects.instance [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lazy-loading 'info_cache' on Instance uuid f6e889b1-019d-4b6a-999f-0ef0f0ad2858 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:12:12 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Updating instance_info_cache with network_info: [{"id": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "address": "fa:16:3e:88:5e:da", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cad33f-37", "ovs_interfaceid": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:12:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:12:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 07:12:13 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:12:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:12:14 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:12:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:12:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:12:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:12:14 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:12:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:12:15 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:12:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:12:15 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:12:15 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:12:15 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8612MB free_disk=23.947128295898438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:12:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:12:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:12:15 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance f6e889b1-019d-4b6a-999f-0ef0f0ad2858 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:12:15 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 89edc448-2d1a-4c42-a7a8-22eba9090e4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:12:15 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:12:15 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:12:15 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:12:15 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:12:15 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:12:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:12:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:12:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:12:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:12:28 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:12:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:12:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:12:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:12:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:12:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:12:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:12:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Verify base images {{(pid=73258) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 27 07:12:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Image id 362036ae-e39a-4747-9eef-020ae5f5b03c yields fingerprint 0c71ce29ffbed18e620c4443b4c57e80ba2e8580 {{(pid=73258) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 27 07:12:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73258) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 27 07:12:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] f6e889b1-019d-4b6a-999f-0ef0f0ad2858 is a valid instance name {{(pid=73258) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 27 07:12:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] 89edc448-2d1a-4c42-a7a8-22eba9090e4f is a valid instance name {{(pid=73258) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 27 07:12:28 user nova-compute[73258]: WARNING nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Unknown base file: /opt/stack/data/nova/instances/_base/b6952fde14e7ad469fd99033d55acc0138835fb9
Aug 27 07:12:28 user nova-compute[73258]: WARNING nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Unknown base file: /opt/stack/data/nova/instances/_base/c1c527070dbaf8dff9c5a5258ab4c18edf236c1c
Aug 27 07:12:28 user nova-compute[73258]: WARNING nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Unknown base file: /opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21
Aug 27 07:12:28 user nova-compute[73258]: WARNING nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Unknown base file: /opt/stack/data/nova/instances/_base/e94c0107d1099fb6a3bd29951c3382e0c8ff97d3
Aug 27 07:12:28 user nova-compute[73258]: WARNING nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Unknown base file: /opt/stack/data/nova/instances/_base/6865daee479109107a6b910250f800196ee2c601
Aug 27 07:12:28 user nova-compute[73258]: WARNING nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Unknown base file: /opt/stack/data/nova/instances/_base/e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934
Aug 27 07:12:28 user nova-compute[73258]: WARNING nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Unknown base file: /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33
Aug 27 07:12:28 user nova-compute[73258]: WARNING nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Unknown base file: /opt/stack/data/nova/instances/_base/64d4f3a5b62e7993cb9804b202c70a184a8286bc
Aug 27 07:12:28 user nova-compute[73258]: WARNING nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Unknown base file: /opt/stack/data/nova/instances/_base/117aadf2824f7d0ca17e3bfc0cec85d49f77ec31
Aug 27 07:12:28 user nova-compute[73258]: WARNING nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Unknown base file: /opt/stack/data/nova/instances/_base/7d0a114b594dd60f887bb29d9d5f38ee9044b6a6
Aug 27 07:12:28 user nova-compute[73258]: INFO nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Removable base files: /opt/stack/data/nova/instances/_base/b6952fde14e7ad469fd99033d55acc0138835fb9 /opt/stack/data/nova/instances/_base/c1c527070dbaf8dff9c5a5258ab4c18edf236c1c /opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21 /opt/stack/data/nova/instances/_base/e94c0107d1099fb6a3bd29951c3382e0c8ff97d3 /opt/stack/data/nova/instances/_base/6865daee479109107a6b910250f800196ee2c601 /opt/stack/data/nova/instances/_base/e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934 /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33 /opt/stack/data/nova/instances/_base/64d4f3a5b62e7993cb9804b202c70a184a8286bc /opt/stack/data/nova/instances/_base/117aadf2824f7d0ca17e3bfc0cec85d49f77ec31 /opt/stack/data/nova/instances/_base/7d0a114b594dd60f887bb29d9d5f38ee9044b6a6
Aug 27 07:12:28 user nova-compute[73258]: INFO nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b6952fde14e7ad469fd99033d55acc0138835fb9
Aug 27 07:12:28 user nova-compute[73258]: INFO nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c1c527070dbaf8dff9c5a5258ab4c18edf236c1c
Aug 27 07:12:28 user nova-compute[73258]: INFO nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a3c6377784db6f7ca6e26fcd2fda1f5154f43a21
Aug 27 07:12:28 user nova-compute[73258]: INFO nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e94c0107d1099fb6a3bd29951c3382e0c8ff97d3
Aug 27 07:12:28 user nova-compute[73258]: INFO nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6865daee479109107a6b910250f800196ee2c601
Aug 27 07:12:28 user nova-compute[73258]: INFO nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e5a0d27dcf2769ecc7d00c4a2119b2cf3554f934
Aug 27 07:12:28 user nova-compute[73258]: INFO nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/93f2e1ab1d6c088987f6f405f979a976f4e31c33
Aug 27 07:12:28 user nova-compute[73258]: INFO nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/64d4f3a5b62e7993cb9804b202c70a184a8286bc
Aug 27 07:12:28 user nova-compute[73258]: INFO nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/117aadf2824f7d0ca17e3bfc0cec85d49f77ec31
Aug 27 07:12:28 user nova-compute[73258]: INFO nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7d0a114b594dd60f887bb29d9d5f38ee9044b6a6
Aug 27 07:12:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Verification complete {{(pid=73258) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 27 07:12:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Verify swap images {{(pid=73258) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 27 07:12:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.imagecache [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Verify ephemeral images {{(pid=73258) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 27 07:12:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:12:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:12:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:12:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:12:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:12:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:12:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:12:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:12:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:12:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:12:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:12:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:13:01 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:13:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:13:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:13:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:13:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:13:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:05 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:13:08 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:13:08 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:13:08 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:13:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:13:09 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:13:11 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:13:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:13:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-89edc448-2d1a-4c42-a7a8-22eba9090e4f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:13:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-89edc448-2d1a-4c42-a7a8-22eba9090e4f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:13:12 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 07:13:12 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Updating instance_info_cache with network_info: [{"id": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "address": "fa:16:3e:66:60:5c", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff49c5cc-89", "ovs_interfaceid": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:13:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-89edc448-2d1a-4c42-a7a8-22eba9090e4f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:13:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 07:13:12 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:13:13 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:13:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:13:16 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:13:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:13:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:13:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:13:16 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:13:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:13:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:13:17 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:13:17 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:13:17 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8733MB free_disk=23.946407318115234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:13:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:13:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:13:17 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance f6e889b1-019d-4b6a-999f-0ef0f0ad2858 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:13:17 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance 89edc448-2d1a-4c42-a7a8-22eba9090e4f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:13:17 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:13:17 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:13:17 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Refreshing inventories for resource provider 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 07:13:17 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Updating ProviderTree inventory for provider 13f05024-5078-4590-94a5-110d29d864c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 07:13:17 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Updating inventory in ProviderTree for provider 13f05024-5078-4590-94a5-110d29d864c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 07:13:17 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Refreshing aggregate associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, aggregates: None {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 07:13:17 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Refreshing trait associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 07:13:17 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:13:17 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:13:17 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:13:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:13:18 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:13:18 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 07:13:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:13:21 user nova-compute[73258]: DEBUG nova.compute.manager [req-2f538e5d-0736-479c-8d33-d5d89ca64ecd req-b3edf241-df6f-477e-b1ae-e2c594da0d85 service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Received event network-changed-ff49c5cc-8921-42e3-83e2-5619328d23e4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:13:21 user nova-compute[73258]: DEBUG nova.compute.manager [req-2f538e5d-0736-479c-8d33-d5d89ca64ecd req-b3edf241-df6f-477e-b1ae-e2c594da0d85 service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Refreshing instance network info cache due to event network-changed-ff49c5cc-8921-42e3-83e2-5619328d23e4. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:13:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2f538e5d-0736-479c-8d33-d5d89ca64ecd req-b3edf241-df6f-477e-b1ae-e2c594da0d85 service nova] Acquiring lock "refresh_cache-89edc448-2d1a-4c42-a7a8-22eba9090e4f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:13:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2f538e5d-0736-479c-8d33-d5d89ca64ecd req-b3edf241-df6f-477e-b1ae-e2c594da0d85 service nova] Acquired lock "refresh_cache-89edc448-2d1a-4c42-a7a8-22eba9090e4f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:13:21 user nova-compute[73258]: DEBUG nova.network.neutron [req-2f538e5d-0736-479c-8d33-d5d89ca64ecd req-b3edf241-df6f-477e-b1ae-e2c594da0d85 service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Refreshing network info cache for port ff49c5cc-8921-42e3-83e2-5619328d23e4 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:13:22 user nova-compute[73258]: DEBUG nova.network.neutron [req-2f538e5d-0736-479c-8d33-d5d89ca64ecd req-b3edf241-df6f-477e-b1ae-e2c594da0d85 service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Updated VIF entry in instance network info cache for port ff49c5cc-8921-42e3-83e2-5619328d23e4. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:13:22 user nova-compute[73258]: DEBUG nova.network.neutron [req-2f538e5d-0736-479c-8d33-d5d89ca64ecd req-b3edf241-df6f-477e-b1ae-e2c594da0d85 service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Updating instance_info_cache with network_info: [{"id": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "address": "fa:16:3e:66:60:5c", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff49c5cc-89", "ovs_interfaceid": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:13:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-2f538e5d-0736-479c-8d33-d5d89ca64ecd req-b3edf241-df6f-477e-b1ae-e2c594da0d85 service nova] Releasing lock "refresh_cache-89edc448-2d1a-4c42-a7a8-22eba9090e4f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:13:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:13:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:13:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:13:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:13:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:13:23 user nova-compute[73258]: INFO nova.compute.manager [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Terminating instance
Aug 27 07:13:23 user nova-compute[73258]: DEBUG nova.compute.manager [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 07:13:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:23 user nova-compute[73258]: DEBUG nova.compute.manager [req-e9840b72-96b2-4b56-b235-acd3f46129cc req-a23a6b9d-9c7b-41b3-8276-66547474a35b service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Received event network-vif-unplugged-ff49c5cc-8921-42e3-83e2-5619328d23e4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:13:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e9840b72-96b2-4b56-b235-acd3f46129cc req-a23a6b9d-9c7b-41b3-8276-66547474a35b service nova] Acquiring lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:13:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e9840b72-96b2-4b56-b235-acd3f46129cc req-a23a6b9d-9c7b-41b3-8276-66547474a35b service nova] Lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:13:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e9840b72-96b2-4b56-b235-acd3f46129cc req-a23a6b9d-9c7b-41b3-8276-66547474a35b service nova] Lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:13:23 user nova-compute[73258]: DEBUG nova.compute.manager [req-e9840b72-96b2-4b56-b235-acd3f46129cc req-a23a6b9d-9c7b-41b3-8276-66547474a35b service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] No waiting events found dispatching network-vif-unplugged-ff49c5cc-8921-42e3-83e2-5619328d23e4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:13:23 user nova-compute[73258]: DEBUG nova.compute.manager [req-e9840b72-96b2-4b56-b235-acd3f46129cc req-a23a6b9d-9c7b-41b3-8276-66547474a35b service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Received event network-vif-unplugged-ff49c5cc-8921-42e3-83e2-5619328d23e4 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 07:13:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:24 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Instance destroyed successfully.
Aug 27 07:13:24 user nova-compute[73258]: DEBUG nova.objects.instance [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lazy-loading 'resources' on Instance uuid 89edc448-2d1a-4c42-a7a8-22eba9090e4f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:11:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-70045307',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-70045307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-70045307',id=49,image_ref='362036ae-e39a-4747-9eef-020ae5f5b03c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvSfql+8tCcR/hfQKp62OLIHBJtLkhgNgl2A4HGLQJTO8chrkeApa5FsJM3dKu0DGlmpPSNyxKfjIjkYo5Jy0qWU7U9BnozH9rkr2bmvJM9Zp9zqb1PSuvhmGtF0vSXLQ==',key_name='tempest-keypair-657698306',keypairs=<?>,launch_index=0,launched_at=2023-08-27T07:11:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='002188a1020a4181a03ce17d46608664',ramdisk_id='',reservation_id='r-4s2sglnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-833647414',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-833647414',owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T07:11:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75d7a7c63b654c47b9df519798186007',uuid=89edc448-2d1a-4c42-a7a8-22eba9090e4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "address": "fa:16:3e:66:60:5c", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff49c5cc-89", "ovs_interfaceid": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converting VIF {"id": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "address": "fa:16:3e:66:60:5c", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff49c5cc-89", "ovs_interfaceid": "ff49c5cc-8921-42e3-83e2-5619328d23e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:60:5c,bridge_name='br-int',has_traffic_filtering=True,id=ff49c5cc-8921-42e3-83e2-5619328d23e4,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff49c5cc-89') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_vif [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:60:5c,bridge_name='br-int',has_traffic_filtering=True,id=ff49c5cc-8921-42e3-83e2-5619328d23e4,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff49c5cc-89') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff49c5cc-89, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:13:24 user nova-compute[73258]: INFO os_vif [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:60:5c,bridge_name='br-int',has_traffic_filtering=True,id=ff49c5cc-8921-42e3-83e2-5619328d23e4,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff49c5cc-89')
Aug 27 07:13:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NtfnSevY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:13:24 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2531a8f3-d67d-4678-b8dc-c47baa6bdffc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c9fc78-c33e-43c4-9999-19a12c824375]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 (non-flash)
Aug 27 07:13:24 user nova-compute[73258]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 (non-flash)
Aug 27 07:13:24 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 (non-flash)
Aug 27 07:13:24 user nova-compute[73258]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 (non-flash)
Aug 27 07:13:24 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4303471c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69'): ({'sdc'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Removing single pathed devices sdc {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7835138f-7bbd-4631-b3a4-008c1e34e98d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89a1cce-2e9d-4fe0-afd2-4d5e308915c0]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Flushing IO for device /dev/sdc {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f4eec4-b3fa-4abd-8b6e-5e8d676de2b9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3911abfd-b2a5-4d11-a398-8df98b09cda2]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOcf63851d-5bc88e59b69c72d6', '/dev/disk/by-id/scsi-23562633838653539', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_cf63851d') {{(pid=84389) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2067fd83-826c-4c03-bcc4-a0fe563863cf]: (4, None) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3957bb-812e-4854-b84f-192094b21602]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4411ee-8361-4c5c-913e-ff6382151690]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69, portal: 172.16.0.220,3260]
Aug 27 07:13:24 user nova-compute[73258]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69, portal: 172.16.0.220,3260] successful.
Aug 27 07:13:24 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81227c9b-a523-41a2-98a9-d4d9175ece69 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[afff721f-0ad8-485f-8eee-7cd16286ae3c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] <== disconnect_volume: return (300ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 07:13:24 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Deleting instance files /opt/stack/data/nova/instances/89edc448-2d1a-4c42-a7a8-22eba9090e4f_del
Aug 27 07:13:24 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Deletion of /opt/stack/data/nova/instances/89edc448-2d1a-4c42-a7a8-22eba9090e4f_del complete
Aug 27 07:13:24 user nova-compute[73258]: INFO nova.compute.manager [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 27 07:13:24 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 07:13:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:25 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:13:25 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Took 1.12 seconds to deallocate network for instance.
Aug 27 07:13:25 user nova-compute[73258]: DEBUG nova.compute.manager [req-247c4ff2-17f3-4f41-b417-06bfd4d7664f req-2b5aa633-df3a-476c-9623-d257cc7d1bff service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Received event network-vif-plugged-ff49c5cc-8921-42e3-83e2-5619328d23e4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:13:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-247c4ff2-17f3-4f41-b417-06bfd4d7664f req-2b5aa633-df3a-476c-9623-d257cc7d1bff service nova] Acquiring lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:13:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-247c4ff2-17f3-4f41-b417-06bfd4d7664f req-2b5aa633-df3a-476c-9623-d257cc7d1bff service nova] Lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:13:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-247c4ff2-17f3-4f41-b417-06bfd4d7664f req-2b5aa633-df3a-476c-9623-d257cc7d1bff service nova] Lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:13:25 user nova-compute[73258]: DEBUG nova.compute.manager [req-247c4ff2-17f3-4f41-b417-06bfd4d7664f req-2b5aa633-df3a-476c-9623-d257cc7d1bff service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] No waiting events found dispatching network-vif-plugged-ff49c5cc-8921-42e3-83e2-5619328d23e4 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:13:25 user nova-compute[73258]: WARNING nova.compute.manager [req-247c4ff2-17f3-4f41-b417-06bfd4d7664f req-2b5aa633-df3a-476c-9623-d257cc7d1bff service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Received unexpected event network-vif-plugged-ff49c5cc-8921-42e3-83e2-5619328d23e4 for instance with vm_state active and task_state deleting.
Aug 27 07:13:25 user nova-compute[73258]: DEBUG nova.compute.manager [req-247c4ff2-17f3-4f41-b417-06bfd4d7664f req-2b5aa633-df3a-476c-9623-d257cc7d1bff service nova] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Received event network-vif-deleted-ff49c5cc-8921-42e3-83e2-5619328d23e4 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:13:26 user nova-compute[73258]: INFO nova.compute.manager [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Took 0.77 seconds to detach 1 volumes for instance.
Aug 27 07:13:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Deleting volume: 81227c9b-a523-41a2-98a9-d4d9175ece69 {{(pid=73258) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 07:13:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:13:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:13:26 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:13:26 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:13:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:13:26 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Deleted allocations for instance 89edc448-2d1a-4c42-a7a8-22eba9090e4f
Aug 27 07:13:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b71cb1c0-39bb-44be-9f66-856de9f5ca2e tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "89edc448-2d1a-4c42-a7a8-22eba9090e4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.415s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:13:26 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:13:29 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:29 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:13:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 07:13:29 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] There are 0 instances to clean {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 07:13:30 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:13:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:13:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:13:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:13:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:13:34 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:39 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693120404.0618017, 89edc448-2d1a-4c42-a7a8-22eba9090e4f => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:13:39 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] VM Stopped (Lifecycle Event)
Aug 27 07:13:39 user nova-compute[73258]: DEBUG nova.compute.manager [None req-676bd789-5b89-41c3-9d86-86086df5e16f None None] [instance: 89edc448-2d1a-4c42-a7a8-22eba9090e4f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:13:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:13:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:13:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:13:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:13:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:13:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:44 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:13:49 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:13:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:13:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:13:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:13:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:13:54 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:13:59 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:14:03 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:14:04 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:14:05 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:14:08 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:14:08 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:14:08 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:14:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:14:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:14:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:14:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:14:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:14:09 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:14:10 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:14:12 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:14:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:14:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 07:14:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:14:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:14:12 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 07:14:12 user nova-compute[73258]: DEBUG nova.objects.instance [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lazy-loading 'info_cache' on Instance uuid f6e889b1-019d-4b6a-999f-0ef0f0ad2858 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:14:13 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Updating instance_info_cache with network_info: [{"id": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "address": "fa:16:3e:88:5e:da", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cad33f-37", "ovs_interfaceid": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:14:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-f6e889b1-019d-4b6a-999f-0ef0f0ad2858" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:14:13 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 07:14:13 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:14:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:14:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:14:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:14:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:14:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:14:14 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:14:14 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:14:17 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:14:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:14:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:14:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:14:17 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:14:18 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:14:18 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:14:18 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:14:18 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8800MB free_disk=23.94546890258789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:14:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:14:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:14:18 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance f6e889b1-019d-4b6a-999f-0ef0f0ad2858 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:14:18 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:14:18 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:14:18 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:14:18 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:14:18 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:14:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:14:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:14:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:14:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:14:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:14:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:14:19 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:14:20 user nova-compute[73258]: INFO nova.compute.manager [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Terminating instance
Aug 27 07:14:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-31918b3e-b218-40b4-b445-e8652e9ff4d6 req-be4e5370-e014-420a-b021-a1bb87000126 service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Received event network-vif-unplugged-d8cad33f-3766-4dc0-acb5-bed876f80e54 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-31918b3e-b218-40b4-b445-e8652e9ff4d6 req-be4e5370-e014-420a-b021-a1bb87000126 service nova] Acquiring lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-31918b3e-b218-40b4-b445-e8652e9ff4d6 req-be4e5370-e014-420a-b021-a1bb87000126 service nova] Lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-31918b3e-b218-40b4-b445-e8652e9ff4d6 req-be4e5370-e014-420a-b021-a1bb87000126 service nova] Lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-31918b3e-b218-40b4-b445-e8652e9ff4d6 req-be4e5370-e014-420a-b021-a1bb87000126 service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] No waiting events found dispatching network-vif-unplugged-d8cad33f-3766-4dc0-acb5-bed876f80e54 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-31918b3e-b218-40b4-b445-e8652e9ff4d6 req-be4e5370-e014-420a-b021-a1bb87000126 service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Received event network-vif-unplugged-d8cad33f-3766-4dc0-acb5-bed876f80e54 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:14:20 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Instance destroyed successfully.
Aug 27 07:14:20 user nova-compute[73258]: DEBUG nova.objects.instance [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lazy-loading 'resources' on Instance uuid f6e889b1-019d-4b6a-999f-0ef0f0ad2858 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-754379188',display_name='tempest-TestVolumeBootPattern-volume-backed-server-754379188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-754379188',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIjtNaRmlI45Ypkna4MeLxpYJLeI+orgVQCQ1fbD0C1rmtWy8jOo4NvqTCaI/oQmbhMIY8Dm9NK/rgE9jqx1xbVAZ0Iqi/9HlrXrJXKa/DFc/us1kka6LAmPgnABxTXYQ==',key_name='tempest-keypair-732280238',keypairs=<?>,launch_index=0,launched_at=2023-08-27T07:09:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='002188a1020a4181a03ce17d46608664',ramdisk_id='',reservation_id='r-wt13b3s7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-833647414',owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T07:09:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75d7a7c63b654c47b9df519798186007',uuid=f6e889b1-019d-4b6a-999f-0ef0f0ad2858,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "address": "fa:16:3e:88:5e:da", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cad33f-37", "ovs_interfaceid": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converting VIF {"id": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "address": "fa:16:3e:88:5e:da", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cad33f-37", "ovs_interfaceid": "d8cad33f-3766-4dc0-acb5-bed876f80e54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:5e:da,bridge_name='br-int',has_traffic_filtering=True,id=d8cad33f-3766-4dc0-acb5-bed876f80e54,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cad33f-37') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG os_vif [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:5e:da,bridge_name='br-int',has_traffic_filtering=True,id=d8cad33f-3766-4dc0-acb5-bed876f80e54,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cad33f-37') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8cad33f-37, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:14:20 user nova-compute[73258]: INFO os_vif [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:5e:da,bridge_name='br-int',has_traffic_filtering=True,id=d8cad33f-3766-4dc0-acb5-bed876f80e54,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cad33f-37')
Aug 27 07:14:20 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbNHRhjU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:14:20 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:14:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e9a03b-a75e-41e4-93f9-4003e846f14a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bddf856-10b8-4197-bd77-f37d601335d9]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 (non-flash)
Aug 27 07:14:20 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 (non-flash)
Aug 27 07:14:20 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa44d3d5ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3667e2-484c-4605-b2ae-53c216aedda5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b6f0ea-4ea7-46e8-892e-ab79dd85d094]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 07:14:20 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbec8f40-13d8-4319-b7dc-a50f3922408a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb254551-59ae-4e2b-82bb-84ddf5def27d]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4992ba67', '/dev/disk/by-id/scsi-1SCST_BIO4992ba67-eaa64a5f983f14f1', '/dev/disk/by-id/scsi-26561613634613566') {{(pid=84389) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fd5b66-3e7a-486c-b18b-482ab5ecee5e]: (4, None) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e103f5-4f07-4589-88d2-6b31b417609f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[093ed7e7-d3e9-480f-bc70-8846a7a66944]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544, portal: 172.16.0.220,3260]
Aug 27 07:14:21 user nova-compute[73258]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544, portal: 172.16.0.220,3260] successful.
Aug 27 07:14:21 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04e17a8-deae-4a95-b511-e2e3cbb51544 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf37057-f601-4a84-87a4-8a636f5dc70c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] <== disconnect_volume: return (275ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 07:14:21 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Deleting instance files /opt/stack/data/nova/instances/f6e889b1-019d-4b6a-999f-0ef0f0ad2858_del
Aug 27 07:14:21 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Deletion of /opt/stack/data/nova/instances/f6e889b1-019d-4b6a-999f-0ef0f0ad2858_del complete
Aug 27 07:14:21 user nova-compute[73258]: INFO nova.compute.manager [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 27 07:14:21 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 07:14:21 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:14:21 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Took 0.74 seconds to deallocate network for instance.
Aug 27 07:14:21 user nova-compute[73258]: DEBUG nova.compute.manager [req-d162c292-ad11-422e-bf95-eb5f650d5e33 req-c4a8703c-e7c4-4eee-bb61-46389f2d01a8 service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Received event network-vif-deleted-d8cad33f-3766-4dc0-acb5-bed876f80e54 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:14:22 user nova-compute[73258]: DEBUG nova.compute.manager [req-9d9cd511-8478-4bcf-966c-61d9bec7e032 req-4017b48a-f17b-401d-b433-e670dd0ba8f8 service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Received event network-vif-plugged-d8cad33f-3766-4dc0-acb5-bed876f80e54 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:14:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9d9cd511-8478-4bcf-966c-61d9bec7e032 req-4017b48a-f17b-401d-b433-e670dd0ba8f8 service nova] Acquiring lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:14:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9d9cd511-8478-4bcf-966c-61d9bec7e032 req-4017b48a-f17b-401d-b433-e670dd0ba8f8 service nova] Lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:14:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-9d9cd511-8478-4bcf-966c-61d9bec7e032 req-4017b48a-f17b-401d-b433-e670dd0ba8f8 service nova] Lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:14:22 user nova-compute[73258]: DEBUG nova.compute.manager [req-9d9cd511-8478-4bcf-966c-61d9bec7e032 req-4017b48a-f17b-401d-b433-e670dd0ba8f8 service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] No waiting events found dispatching network-vif-plugged-d8cad33f-3766-4dc0-acb5-bed876f80e54 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:14:22 user nova-compute[73258]: WARNING nova.compute.manager [req-9d9cd511-8478-4bcf-966c-61d9bec7e032 req-4017b48a-f17b-401d-b433-e670dd0ba8f8 service nova] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Received unexpected event network-vif-plugged-d8cad33f-3766-4dc0-acb5-bed876f80e54 for instance with vm_state active and task_state deleting.
Aug 27 07:14:22 user nova-compute[73258]: INFO nova.compute.manager [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Took 0.79 seconds to detach 1 volumes for instance.
Aug 27 07:14:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Deleting volume: f04e17a8-deae-4a95-b511-e2e3cbb51544 {{(pid=73258) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 07:14:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:14:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:14:22 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:14:22 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:14:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:14:23 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Deleted allocations for instance f6e889b1-019d-4b6a-999f-0ef0f0ad2858
Aug 27 07:14:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-b15dc27f-9da8-4586-b7f5-f6b2922c7bf1 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "f6e889b1-019d-4b6a-999f-0ef0f0ad2858" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:14:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:14:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:14:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:14:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:14:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:14:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:14:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:14:34 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_power_states {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:14:35 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693120460.8658593, f6e889b1-019d-4b6a-999f-0ef0f0ad2858 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:14:35 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] VM Stopped (Lifecycle Event)
Aug 27 07:14:35 user nova-compute[73258]: DEBUG nova.compute.manager [None req-52526d75-c639-4fe1-85b8-a06a28293443 None None] [instance: f6e889b1-019d-4b6a-999f-0ef0f0ad2858] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:14:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:14:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:14:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:14:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:14:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:14:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:14:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:14:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:14:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:14:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:15:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:15:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:15:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:15:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:04 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:15:05 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:15:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:08 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:15:08 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:15:09 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:15:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:10 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:15:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:13 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:15:14 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:15:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:15:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 07:15:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Didn't find any instances for network info cache update. {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 07:15:14 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:15:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:19 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:15:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:15:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:15:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:15:19 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:15:20 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:15:20 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:15:20 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8939MB free_disk=23.944168090820312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:15:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:15:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:15:20 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:15:20 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:15:20 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:15:20 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:15:20 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:15:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:15:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:15:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:15:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:15:24 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 07:15:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:15:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:15:24 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 07:15:24 user nova-compute[73258]: INFO nova.compute.claims [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Claim successful on node user
Aug 27 07:15:25 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.185s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 07:15:25 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 07:15:25 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG nova.policy [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75d7a7c63b654c47b9df519798186007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002188a1020a4181a03ce17d46608664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 07:15:25 user nova-compute[73258]: INFO nova.virt.block_device [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Booting with volume 2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e at /dev/vda
Aug 27 07:15:25 user nova-compute[73258]: DEBUG os_brick.utils [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2884cbc3-bd41-4392-93bb-12a13b191d5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0d8c78-fc8d-4898-99c2-f49fe5e21eda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c39f8b3-b62e-44e6-a6be-621d99b2f74e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac39f77-37d4-44f3-ad99-62a0175866b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:15:25 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 07:15:25 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1c6cd1-8976-4d85-84d3-3b100744a1ad]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG os_brick.utils [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Updating existing volume attachment record: d71696ef-4af8-49b7-9277-e2c5c4ac9e5b {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:15:25 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Successfully created port: 06086a2f-4034-44fc-b108-f2efb9871134 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 07:15:26 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Successfully updated port: 06086a2f-4034-44fc-b108-f2efb9871134 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 07:15:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "refresh_cache-d78e0386-15c1-455a-960e-e8dbb1d17fcf" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:15:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquired lock "refresh_cache-d78e0386-15c1-455a-960e-e8dbb1d17fcf" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:15:26 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 07:15:26 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 07:15:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-32f65c61-3de7-4dd2-b8a4-c9bfb4221811 req-9a18f3d7-17e1-4caa-95b3-cb17c99a9b66 service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Received event network-changed-06086a2f-4034-44fc-b108-f2efb9871134 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:15:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-32f65c61-3de7-4dd2-b8a4-c9bfb4221811 req-9a18f3d7-17e1-4caa-95b3-cb17c99a9b66 service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Refreshing instance network info cache due to event network-changed-06086a2f-4034-44fc-b108-f2efb9871134. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:15:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-32f65c61-3de7-4dd2-b8a4-c9bfb4221811 req-9a18f3d7-17e1-4caa-95b3-cb17c99a9b66 service nova] Acquiring lock "refresh_cache-d78e0386-15c1-455a-960e-e8dbb1d17fcf" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:15:27 user nova-compute[73258]: DEBUG nova.network.neutron [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Updating instance_info_cache with network_info: [{"id": "06086a2f-4034-44fc-b108-f2efb9871134", "address": "fa:16:3e:c1:14:d0", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06086a2f-40", "ovs_interfaceid": "06086a2f-4034-44fc-b108-f2efb9871134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:15:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Releasing lock "refresh_cache-d78e0386-15c1-455a-960e-e8dbb1d17fcf" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:15:27 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Instance network_info: |[{"id": "06086a2f-4034-44fc-b108-f2efb9871134", "address": "fa:16:3e:c1:14:d0", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06086a2f-40", "ovs_interfaceid": "06086a2f-4034-44fc-b108-f2efb9871134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 07:15:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-32f65c61-3de7-4dd2-b8a4-c9bfb4221811 req-9a18f3d7-17e1-4caa-95b3-cb17c99a9b66 service nova] Acquired lock "refresh_cache-d78e0386-15c1-455a-960e-e8dbb1d17fcf" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:15:27 user nova-compute[73258]: DEBUG nova.network.neutron [req-32f65c61-3de7-4dd2-b8a4-c9bfb4221811 req-9a18f3d7-17e1-4caa-95b3-cb17c99a9b66 service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Refreshing network info cache for port 06086a2f-4034-44fc-b108-f2efb9871134 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:15:27 user nova-compute[73258]: DEBUG nova.network.neutron [req-32f65c61-3de7-4dd2-b8a4-c9bfb4221811 req-9a18f3d7-17e1-4caa-95b3-cb17c99a9b66 service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Updated VIF entry in instance network info cache for port 06086a2f-4034-44fc-b108-f2efb9871134. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:15:27 user nova-compute[73258]: DEBUG nova.network.neutron [req-32f65c61-3de7-4dd2-b8a4-c9bfb4221811 req-9a18f3d7-17e1-4caa-95b3-cb17c99a9b66 service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Updating instance_info_cache with network_info: [{"id": "06086a2f-4034-44fc-b108-f2efb9871134", "address": "fa:16:3e:c1:14:d0", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06086a2f-40", "ovs_interfaceid": "06086a2f-4034-44fc-b108-f2efb9871134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:15:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-32f65c61-3de7-4dd2-b8a4-c9bfb4221811 req-9a18f3d7-17e1-4caa-95b3-cb17c99a9b66 service nova] Releasing lock "refresh_cache-d78e0386-15c1-455a-960e-e8dbb1d17fcf" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:15:28 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:15:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:15:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:15:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:15:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:15:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 07:15:36 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Creating image(s)
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Did not create local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Ensure instance console log exists: /opt/stack/data/nova/instances/d78e0386-15c1-455a-960e-e8dbb1d17fcf/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Start _get_guest_xml network_info=[{"id": "06086a2f-4034-44fc-b108-f2efb9871134", "address": "fa:16:3e:c1:14:d0", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06086a2f-40", "ovs_interfaceid": "06086a2f-4034-44fc-b108-f2efb9871134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rvTJxLVB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd78e0386-15c1-455a-960e-e8dbb1d17fcf', 'attached_at': '', 'detached_at': '', 'volume_id': '2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e', 'serial': '2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e'}, 'attachment_id': 'd71696ef-4af8-49b7-9277-e2c5c4ac9e5b', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 07:15:36 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:15:36 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rvTJxLVB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:15:36 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:15:36 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:15:36 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ce9fe7-fc11-4942-a13d-11066b0ab2ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 07:15:36 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d82dfe6-7e60-4373-b912-e7594947ef1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e] added
Aug 27 07:15:36 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f071ca02-4018-45c3-a069-aaaa9bb65dea]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1075e0ad-b780-4d02-a400-e4cba4a42a99]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rvTJxLVB {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rvTJxLVB" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[167f2dd4-92dd-4437-ac35-88303b6b9a94]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rvTJxLVB'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0cf9cc-4b29-4c0a-af5b-89d32a007340]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ba412e-2ab3-48eb-82f2-31e6f4a31602]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 07:15:36 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 07:15:36 user nova-compute[73258]:  {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:15:36 user nova-compute[73258]: WARNING os_brick.initiator.connectors.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 07:15:36 user nova-compute[73258]: 
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a2b213-39c2-4362-8a98-1e17ad2a6ca8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e, portal: 172.16.0.220,3260]
Aug 27 07:15:36 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e, portal: 172.16.0.220,3260] successful.
Aug 27 07:15:36 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a77afc-320a-42ef-9247-4a4388aa8cc5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7576907b-54ba-40aa-a6ec-cf27b844e411]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)
Aug 27 07:15:36 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)
Aug 27 07:15:36 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f833919d-8ad3-42cf-83e5-613f5c94038b]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:15:36 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rvTJxLVB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23337643866383561', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337643866383561', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1343995980',display_name='tempest-TestVolumeBootPattern-server-1343995980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1343995980',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo/xbbNe5pugCZg6rttcuY3cd+j5BXvTZqbtXYGtXdbHJjMmHnbNi6AcvQmn26/ej5MtnY4axwFKH938p8BxyCO57BkYFUl23uzp1PG94w6lTkTvJDFna0AJYvDX8Futg==',key_name='tempest-TestVolumeBootPattern-2109572928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='002188a1020a4181a03ce17d46608664',ramdisk_id='',reservation_id='r-5hp8tbc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-833647414',owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:15:25Z,user_data=None,user_id='75d7a7c63b654c47b9df519798186007',uuid=d78e0386-15c1-455a-960e-e8dbb1d17fcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06086a2f-4034-44fc-b108-f2efb9871134", "address": "fa:16:3e:c1:14:d0", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06086a2f-40", "ovs_interfaceid": "06086a2f-4034-44fc-b108-f2efb9871134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converting VIF {"id": "06086a2f-4034-44fc-b108-f2efb9871134", "address": "fa:16:3e:c1:14:d0", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06086a2f-40", "ovs_interfaceid": "06086a2f-4034-44fc-b108-f2efb9871134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:14:d0,bridge_name='br-int',has_traffic_filtering=True,id=06086a2f-4034-44fc-b108-f2efb9871134,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06086a2f-40') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG nova.objects.instance [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lazy-loading 'pci_devices' on Instance uuid d78e0386-15c1-455a-960e-e8dbb1d17fcf {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] End _get_guest_xml xml=<domain type="kvm">
Aug 27 07:15:37 user nova-compute[73258]:   <uuid>d78e0386-15c1-455a-960e-e8dbb1d17fcf</uuid>
Aug 27 07:15:37 user nova-compute[73258]:   <name>instance-00000032</name>
Aug 27 07:15:37 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 07:15:37 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 07:15:37 user nova-compute[73258]:   <metadata>
Aug 27 07:15:37 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 07:15:37 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 07:15:37 user nova-compute[73258]:       <nova:name>tempest-TestVolumeBootPattern-server-1343995980</nova:name>
Aug 27 07:15:37 user nova-compute[73258]:       <nova:creationTime>2023-08-27 07:15:36</nova:creationTime>
Aug 27 07:15:37 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 07:15:37 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 07:15:37 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 07:15:37 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 07:15:37 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 07:15:37 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 07:15:37 user nova-compute[73258]:       </nova:flavor>
Aug 27 07:15:37 user nova-compute[73258]:       <nova:owner>
Aug 27 07:15:37 user nova-compute[73258]:         <nova:user uuid="75d7a7c63b654c47b9df519798186007">tempest-TestVolumeBootPattern-833647414-project-member</nova:user>
Aug 27 07:15:37 user nova-compute[73258]:         <nova:project uuid="002188a1020a4181a03ce17d46608664">tempest-TestVolumeBootPattern-833647414</nova:project>
Aug 27 07:15:37 user nova-compute[73258]:       </nova:owner>
Aug 27 07:15:37 user nova-compute[73258]:       <nova:ports>
Aug 27 07:15:37 user nova-compute[73258]:         <nova:port uuid="06086a2f-4034-44fc-b108-f2efb9871134">
Aug 27 07:15:37 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 07:15:37 user nova-compute[73258]:         </nova:port>
Aug 27 07:15:37 user nova-compute[73258]:       </nova:ports>
Aug 27 07:15:37 user nova-compute[73258]:     </nova:instance>
Aug 27 07:15:37 user nova-compute[73258]:   </metadata>
Aug 27 07:15:37 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 07:15:37 user nova-compute[73258]:     <system>
Aug 27 07:15:37 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 07:15:37 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 07:15:37 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 07:15:37 user nova-compute[73258]:       <entry name="serial">d78e0386-15c1-455a-960e-e8dbb1d17fcf</entry>
Aug 27 07:15:37 user nova-compute[73258]:       <entry name="uuid">d78e0386-15c1-455a-960e-e8dbb1d17fcf</entry>
Aug 27 07:15:37 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 07:15:37 user nova-compute[73258]:     </system>
Aug 27 07:15:37 user nova-compute[73258]:   </sysinfo>
Aug 27 07:15:37 user nova-compute[73258]:   <os>
Aug 27 07:15:37 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 07:15:37 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 07:15:37 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 07:15:37 user nova-compute[73258]:   </os>
Aug 27 07:15:37 user nova-compute[73258]:   <features>
Aug 27 07:15:37 user nova-compute[73258]:     <acpi/>
Aug 27 07:15:37 user nova-compute[73258]:     <apic/>
Aug 27 07:15:37 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 07:15:37 user nova-compute[73258]:   </features>
Aug 27 07:15:37 user nova-compute[73258]:   <clock offset="utc">
Aug 27 07:15:37 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 07:15:37 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 07:15:37 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 07:15:37 user nova-compute[73258]:   </clock>
Aug 27 07:15:37 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 07:15:37 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 07:15:37 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 07:15:37 user nova-compute[73258]:   </cpu>
Aug 27 07:15:37 user nova-compute[73258]:   <devices>
Aug 27 07:15:37 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 07:15:37 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:15:37 user nova-compute[73258]:       <source dev="/dev/sdb"/>
Aug 27 07:15:37 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 07:15:37 user nova-compute[73258]:       <serial>2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e</serial>
Aug 27 07:15:37 user nova-compute[73258]:     </disk>
Aug 27 07:15:37 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 07:15:37 user nova-compute[73258]:       <mac address="fa:16:3e:c1:14:d0"/>
Aug 27 07:15:37 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:15:37 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 07:15:37 user nova-compute[73258]:       <target dev="tap06086a2f-40"/>
Aug 27 07:15:37 user nova-compute[73258]:     </interface>
Aug 27 07:15:37 user nova-compute[73258]:     <serial type="pty">
Aug 27 07:15:37 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/d78e0386-15c1-455a-960e-e8dbb1d17fcf/console.log" append="off"/>
Aug 27 07:15:37 user nova-compute[73258]:     </serial>
Aug 27 07:15:37 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 07:15:37 user nova-compute[73258]:     <video>
Aug 27 07:15:37 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:15:37 user nova-compute[73258]:     </video>
Aug 27 07:15:37 user nova-compute[73258]:     <rng model="virtio">
Aug 27 07:15:37 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 07:15:37 user nova-compute[73258]:     </rng>
Aug 27 07:15:37 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 07:15:37 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 07:15:37 user nova-compute[73258]:       <stats period="10"/>
Aug 27 07:15:37 user nova-compute[73258]:     </memballoon>
Aug 27 07:15:37 user nova-compute[73258]:   </devices>
Aug 27 07:15:37 user nova-compute[73258]: </domain>
Aug 27 07:15:37 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1343995980',display_name='tempest-TestVolumeBootPattern-server-1343995980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1343995980',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo/xbbNe5pugCZg6rttcuY3cd+j5BXvTZqbtXYGtXdbHJjMmHnbNi6AcvQmn26/ej5MtnY4axwFKH938p8BxyCO57BkYFUl23uzp1PG94w6lTkTvJDFna0AJYvDX8Futg==',key_name='tempest-TestVolumeBootPattern-2109572928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='002188a1020a4181a03ce17d46608664',ramdisk_id='',reservation_id='r-5hp8tbc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-833647414',owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:15:25Z,user_data=None,user_id='75d7a7c63b654c47b9df519798186007',uuid=d78e0386-15c1-455a-960e-e8dbb1d17fcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06086a2f-4034-44fc-b108-f2efb9871134", "address": "fa:16:3e:c1:14:d0", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06086a2f-40", "ovs_interfaceid": "06086a2f-4034-44fc-b108-f2efb9871134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converting VIF {"id": "06086a2f-4034-44fc-b108-f2efb9871134", "address": "fa:16:3e:c1:14:d0", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06086a2f-40", "ovs_interfaceid": "06086a2f-4034-44fc-b108-f2efb9871134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:14:d0,bridge_name='br-int',has_traffic_filtering=True,id=06086a2f-4034-44fc-b108-f2efb9871134,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06086a2f-40') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG os_vif [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:14:d0,bridge_name='br-int',has_traffic_filtering=True,id=06086a2f-4034-44fc-b108-f2efb9871134,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06086a2f-40') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06086a2f-40, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06086a2f-40, col_values=(('external_ids', {'iface-id': '06086a2f-4034-44fc-b108-f2efb9871134', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:14:d0', 'vm-uuid': 'd78e0386-15c1-455a-960e-e8dbb1d17fcf'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:37 user nova-compute[73258]: INFO os_vif [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:14:d0,bridge_name='br-int',has_traffic_filtering=True,id=06086a2f-4034-44fc-b108-f2efb9871134,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06086a2f-40')
Aug 27 07:15:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:15:37 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] No VIF found with MAC fa:16:3e:c1:14:d0, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 07:15:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:39 user nova-compute[73258]: DEBUG nova.compute.manager [req-5b605779-a764-46d6-9e1d-53eb6010a5c9 req-7cc11588-2f2d-4dff-a546-b0c060cb39f8 service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Received event network-vif-plugged-06086a2f-4034-44fc-b108-f2efb9871134 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:15:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5b605779-a764-46d6-9e1d-53eb6010a5c9 req-7cc11588-2f2d-4dff-a546-b0c060cb39f8 service nova] Acquiring lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:15:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5b605779-a764-46d6-9e1d-53eb6010a5c9 req-7cc11588-2f2d-4dff-a546-b0c060cb39f8 service nova] Lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:15:39 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-5b605779-a764-46d6-9e1d-53eb6010a5c9 req-7cc11588-2f2d-4dff-a546-b0c060cb39f8 service nova] Lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:15:39 user nova-compute[73258]: DEBUG nova.compute.manager [req-5b605779-a764-46d6-9e1d-53eb6010a5c9 req-7cc11588-2f2d-4dff-a546-b0c060cb39f8 service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] No waiting events found dispatching network-vif-plugged-06086a2f-4034-44fc-b108-f2efb9871134 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:15:39 user nova-compute[73258]: WARNING nova.compute.manager [req-5b605779-a764-46d6-9e1d-53eb6010a5c9 req-7cc11588-2f2d-4dff-a546-b0c060cb39f8 service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Received unexpected event network-vif-plugged-06086a2f-4034-44fc-b108-f2efb9871134 for instance with vm_state building and task_state spawning.
Aug 27 07:15:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:39 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:41 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693120541.129505, d78e0386-15c1-455a-960e-e8dbb1d17fcf => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:15:41 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] VM Resumed (Lifecycle Event)
Aug 27 07:15:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 07:15:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 07:15:41 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Instance spawned successfully.
Aug 27 07:15:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 07:15:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:15:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:15:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:15:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:15:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:15:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:15:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:15:41 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:15:41 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:15:41 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693120541.1306412, d78e0386-15c1-455a-960e-e8dbb1d17fcf => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:15:41 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] VM Started (Lifecycle Event)
Aug 27 07:15:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:15:41 user nova-compute[73258]: DEBUG nova.compute.manager [req-018181a9-fa4e-413c-99a3-44aa514a4b2b req-f2fe9256-04c6-459c-a69f-75217154130e service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Received event network-vif-plugged-06086a2f-4034-44fc-b108-f2efb9871134 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:15:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-018181a9-fa4e-413c-99a3-44aa514a4b2b req-f2fe9256-04c6-459c-a69f-75217154130e service nova] Acquiring lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:15:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-018181a9-fa4e-413c-99a3-44aa514a4b2b req-f2fe9256-04c6-459c-a69f-75217154130e service nova] Lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:15:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-018181a9-fa4e-413c-99a3-44aa514a4b2b req-f2fe9256-04c6-459c-a69f-75217154130e service nova] Lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:15:41 user nova-compute[73258]: DEBUG nova.compute.manager [req-018181a9-fa4e-413c-99a3-44aa514a4b2b req-f2fe9256-04c6-459c-a69f-75217154130e service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] No waiting events found dispatching network-vif-plugged-06086a2f-4034-44fc-b108-f2efb9871134 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:15:41 user nova-compute[73258]: WARNING nova.compute.manager [req-018181a9-fa4e-413c-99a3-44aa514a4b2b req-f2fe9256-04c6-459c-a69f-75217154130e service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Received unexpected event network-vif-plugged-06086a2f-4034-44fc-b108-f2efb9871134 for instance with vm_state building and task_state spawning.
Aug 27 07:15:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:15:41 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:15:41 user nova-compute[73258]: INFO nova.compute.manager [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Took 5.12 seconds to spawn the instance on the hypervisor.
Aug 27 07:15:41 user nova-compute[73258]: DEBUG nova.compute.manager [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:15:41 user nova-compute[73258]: INFO nova.compute.manager [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Took 16.58 seconds to build instance.
Aug 27 07:15:41 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-6c536264-41e2-435a-8429-7fce93401fae tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.690s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:15:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:15:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:16:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:16:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:16:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:16:05 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:16:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:16:07 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:16:08 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:16:08 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:16:09 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:16:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:16:11 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:16:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:16:13 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:16:14 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:16:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:16:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 07:16:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-d78e0386-15c1-455a-960e-e8dbb1d17fcf" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:16:14 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-d78e0386-15c1-455a-960e-e8dbb1d17fcf" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:16:14 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 07:16:14 user nova-compute[73258]: DEBUG nova.objects.instance [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lazy-loading 'info_cache' on Instance uuid d78e0386-15c1-455a-960e-e8dbb1d17fcf {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:16:15 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Updating instance_info_cache with network_info: [{"id": "06086a2f-4034-44fc-b108-f2efb9871134", "address": "fa:16:3e:c1:14:d0", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06086a2f-40", "ovs_interfaceid": "06086a2f-4034-44fc-b108-f2efb9871134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:16:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-d78e0386-15c1-455a-960e-e8dbb1d17fcf" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:16:15 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 07:16:16 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:16:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:16:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:16:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:16:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:16:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:16:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:16:21 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:16:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:16:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:16:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:16:21 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:16:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:16:22 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:16:22 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:16:22 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8781MB free_disk=23.93460464477539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:16:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:16:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:16:22 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance d78e0386-15c1-455a-960e-e8dbb1d17fcf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:16:22 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:16:22 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:16:22 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:16:22 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:16:22 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:16:22 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:16:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:16:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:16:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:16:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:16:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:16:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:16:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:16:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:16:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:16:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:16:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:16:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:16:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:16:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:16:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:16:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:16:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:16:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:16:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:16:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:16:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:16:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:16:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:16:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:16:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:16:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:16:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:16:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:16:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:16:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:16:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:16:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:16:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:17:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:17:07 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:17:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:17:08 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:17:08 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:17:09 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:17:09 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:17:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:17:12 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:17:13 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:17:15 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:17:15 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:17:15 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 07:17:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-d78e0386-15c1-455a-960e-e8dbb1d17fcf" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:17:15 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-d78e0386-15c1-455a-960e-e8dbb1d17fcf" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:17:15 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 07:17:15 user nova-compute[73258]: DEBUG nova.objects.instance [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lazy-loading 'info_cache' on Instance uuid d78e0386-15c1-455a-960e-e8dbb1d17fcf {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:17:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:17:16 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Updating instance_info_cache with network_info: [{"id": "06086a2f-4034-44fc-b108-f2efb9871134", "address": "fa:16:3e:c1:14:d0", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06086a2f-40", "ovs_interfaceid": "06086a2f-4034-44fc-b108-f2efb9871134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:17:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-d78e0386-15c1-455a-960e-e8dbb1d17fcf" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:17:16 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 07:17:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-33642be6-7291-44f4-b34b-4b35e826128e req-9dfe55c4-b5f8-4a3f-bde0-94af81fa541e service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Received event network-changed-06086a2f-4034-44fc-b108-f2efb9871134 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:17:17 user nova-compute[73258]: DEBUG nova.compute.manager [req-33642be6-7291-44f4-b34b-4b35e826128e req-9dfe55c4-b5f8-4a3f-bde0-94af81fa541e service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Refreshing instance network info cache due to event network-changed-06086a2f-4034-44fc-b108-f2efb9871134. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:17:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-33642be6-7291-44f4-b34b-4b35e826128e req-9dfe55c4-b5f8-4a3f-bde0-94af81fa541e service nova] Acquiring lock "refresh_cache-d78e0386-15c1-455a-960e-e8dbb1d17fcf" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:17:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-33642be6-7291-44f4-b34b-4b35e826128e req-9dfe55c4-b5f8-4a3f-bde0-94af81fa541e service nova] Acquired lock "refresh_cache-d78e0386-15c1-455a-960e-e8dbb1d17fcf" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:17:17 user nova-compute[73258]: DEBUG nova.network.neutron [req-33642be6-7291-44f4-b34b-4b35e826128e req-9dfe55c4-b5f8-4a3f-bde0-94af81fa541e service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Refreshing network info cache for port 06086a2f-4034-44fc-b108-f2efb9871134 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:17:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:17:17 user nova-compute[73258]: DEBUG nova.network.neutron [req-33642be6-7291-44f4-b34b-4b35e826128e req-9dfe55c4-b5f8-4a3f-bde0-94af81fa541e service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Updated VIF entry in instance network info cache for port 06086a2f-4034-44fc-b108-f2efb9871134. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:17:17 user nova-compute[73258]: DEBUG nova.network.neutron [req-33642be6-7291-44f4-b34b-4b35e826128e req-9dfe55c4-b5f8-4a3f-bde0-94af81fa541e service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Updating instance_info_cache with network_info: [{"id": "06086a2f-4034-44fc-b108-f2efb9871134", "address": "fa:16:3e:c1:14:d0", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06086a2f-40", "ovs_interfaceid": "06086a2f-4034-44fc-b108-f2efb9871134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:17:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-33642be6-7291-44f4-b34b-4b35e826128e req-9dfe55c4-b5f8-4a3f-bde0-94af81fa541e service nova] Releasing lock "refresh_cache-d78e0386-15c1-455a-960e-e8dbb1d17fcf" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:17:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:17:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:17:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:17:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:17:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:17:17 user nova-compute[73258]: INFO nova.compute.manager [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Terminating instance
Aug 27 07:17:18 user nova-compute[73258]: DEBUG nova.compute.manager [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-e8e65277-4117-4289-8df4-ca15a41f07ce req-9517426f-f9db-4614-8f53-7477826a888f service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Received event network-vif-unplugged-06086a2f-4034-44fc-b108-f2efb9871134 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e8e65277-4117-4289-8df4-ca15a41f07ce req-9517426f-f9db-4614-8f53-7477826a888f service nova] Acquiring lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e8e65277-4117-4289-8df4-ca15a41f07ce req-9517426f-f9db-4614-8f53-7477826a888f service nova] Lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-e8e65277-4117-4289-8df4-ca15a41f07ce req-9517426f-f9db-4614-8f53-7477826a888f service nova] Lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-e8e65277-4117-4289-8df4-ca15a41f07ce req-9517426f-f9db-4614-8f53-7477826a888f service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] No waiting events found dispatching network-vif-unplugged-06086a2f-4034-44fc-b108-f2efb9871134 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-e8e65277-4117-4289-8df4-ca15a41f07ce req-9517426f-f9db-4614-8f53-7477826a888f service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Received event network-vif-unplugged-06086a2f-4034-44fc-b108-f2efb9871134 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 07:17:18 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Instance destroyed successfully.
Aug 27 07:17:18 user nova-compute[73258]: DEBUG nova.objects.instance [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lazy-loading 'resources' on Instance uuid d78e0386-15c1-455a-960e-e8dbb1d17fcf {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1343995980',display_name='tempest-TestVolumeBootPattern-server-1343995980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1343995980',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo/xbbNe5pugCZg6rttcuY3cd+j5BXvTZqbtXYGtXdbHJjMmHnbNi6AcvQmn26/ej5MtnY4axwFKH938p8BxyCO57BkYFUl23uzp1PG94w6lTkTvJDFna0AJYvDX8Futg==',key_name='tempest-TestVolumeBootPattern-2109572928',keypairs=<?>,launch_index=0,launched_at=2023-08-27T07:15:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='002188a1020a4181a03ce17d46608664',ramdisk_id='',reservation_id='r-5hp8tbc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-833647414',owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T07:15:41Z,user_data=None,user_id='75d7a7c63b654c47b9df519798186007',uuid=d78e0386-15c1-455a-960e-e8dbb1d17fcf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06086a2f-4034-44fc-b108-f2efb9871134", "address": "fa:16:3e:c1:14:d0", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06086a2f-40", "ovs_interfaceid": "06086a2f-4034-44fc-b108-f2efb9871134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converting VIF {"id": "06086a2f-4034-44fc-b108-f2efb9871134", "address": "fa:16:3e:c1:14:d0", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06086a2f-40", "ovs_interfaceid": "06086a2f-4034-44fc-b108-f2efb9871134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:14:d0,bridge_name='br-int',has_traffic_filtering=True,id=06086a2f-4034-44fc-b108-f2efb9871134,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06086a2f-40') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG os_vif [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:14:d0,bridge_name='br-int',has_traffic_filtering=True,id=06086a2f-4034-44fc-b108-f2efb9871134,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06086a2f-40') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06086a2f-40, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:17:18 user nova-compute[73258]: INFO os_vif [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:14:d0,bridge_name='br-int',has_traffic_filtering=True,id=06086a2f-4034-44fc-b108-f2efb9871134,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06086a2f-40')
Aug 27 07:17:18 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rvTJxLVB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:17:18 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:17:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[77442c03-9435-481d-ae7d-aaf19dfb990c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18a1d6d-9495-4f66-ad92-7d60c697ecf3]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)
Aug 27 07:17:18 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)
Aug 27 07:17:18 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4305c3880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[43641053-e809-4518-bbd0-70c57200c8b0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[94eec59f-e78f-4b9a-b67b-a06a1e09c60c]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2395908e-9913-47ac-b4eb-225f053743e2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3347bdb4-7361-473b-ad87-2642c273799d]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8c45ccfb', '/dev/disk/by-id/scsi-1SCST_BIO8c45ccfb-37d8f85a55e3e4c7', '/dev/disk/by-id/scsi-23337643866383561') {{(pid=84389) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e29a1f-5d9f-4315-9cc3-b7aa00d9d25b]: (4, None) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[557ec56b-5937-4839-831b-88a4481175ad]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:17:18 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:17:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:17:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcc4c24-126a-4ae3-bd06-b2feee0cc7b6]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:17:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e, portal: 172.16.0.220,3260]
Aug 27 07:17:19 user nova-compute[73258]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e, portal: 172.16.0.220,3260] successful.
Aug 27 07:17:19 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:17:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:17:19 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:17:19 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dfd3f8-5a4b-4cbc-be45-89f1a59bb423]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:17:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:17:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:17:19 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] <== disconnect_volume: return (285ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:17:19 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 07:17:19 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Deleting instance files /opt/stack/data/nova/instances/d78e0386-15c1-455a-960e-e8dbb1d17fcf_del
Aug 27 07:17:19 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Deletion of /opt/stack/data/nova/instances/d78e0386-15c1-455a-960e-e8dbb1d17fcf_del complete
Aug 27 07:17:19 user nova-compute[73258]: INFO nova.compute.manager [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 27 07:17:19 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 07:17:19 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 07:17:19 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 07:17:19 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:17:19 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Took 0.67 seconds to deallocate network for instance.
Aug 27 07:17:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-c88103f4-2f97-4a8f-ac18-bf86862ea43a req-755a93b6-d00f-4726-be26-56caba53a9d9 service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Received event network-vif-deleted-06086a2f-4034-44fc-b108-f2efb9871134 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:17:19 user nova-compute[73258]: INFO nova.compute.manager [req-c88103f4-2f97-4a8f-ac18-bf86862ea43a req-755a93b6-d00f-4726-be26-56caba53a9d9 service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Neutron deleted interface 06086a2f-4034-44fc-b108-f2efb9871134; detaching it from the instance and deleting it from the info cache
Aug 27 07:17:19 user nova-compute[73258]: DEBUG nova.network.neutron [req-c88103f4-2f97-4a8f-ac18-bf86862ea43a req-755a93b6-d00f-4726-be26-56caba53a9d9 service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:17:19 user nova-compute[73258]: DEBUG nova.compute.manager [req-c88103f4-2f97-4a8f-ac18-bf86862ea43a req-755a93b6-d00f-4726-be26-56caba53a9d9 service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Detach interface failed, port_id=06086a2f-4034-44fc-b108-f2efb9871134, reason: Instance d78e0386-15c1-455a-960e-e8dbb1d17fcf could not be found. {{(pid=73258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 07:17:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:17:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-32fd8a9d-16bd-4cd7-9d4b-fc9519b16460 req-e00412b5-b18b-4769-8519-d62e7c4b044f service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Received event network-vif-plugged-06086a2f-4034-44fc-b108-f2efb9871134 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:17:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-32fd8a9d-16bd-4cd7-9d4b-fc9519b16460 req-e00412b5-b18b-4769-8519-d62e7c4b044f service nova] Acquiring lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:17:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-32fd8a9d-16bd-4cd7-9d4b-fc9519b16460 req-e00412b5-b18b-4769-8519-d62e7c4b044f service nova] Lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:17:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-32fd8a9d-16bd-4cd7-9d4b-fc9519b16460 req-e00412b5-b18b-4769-8519-d62e7c4b044f service nova] Lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:17:20 user nova-compute[73258]: DEBUG nova.compute.manager [req-32fd8a9d-16bd-4cd7-9d4b-fc9519b16460 req-e00412b5-b18b-4769-8519-d62e7c4b044f service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] No waiting events found dispatching network-vif-plugged-06086a2f-4034-44fc-b108-f2efb9871134 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:17:20 user nova-compute[73258]: WARNING nova.compute.manager [req-32fd8a9d-16bd-4cd7-9d4b-fc9519b16460 req-e00412b5-b18b-4769-8519-d62e7c4b044f service nova] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Received unexpected event network-vif-plugged-06086a2f-4034-44fc-b108-f2efb9871134 for instance with vm_state active and task_state deleting.
Aug 27 07:17:20 user nova-compute[73258]: INFO nova.compute.manager [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Took 0.88 seconds to detach 1 volumes for instance.
Aug 27 07:17:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:17:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:17:20 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:17:20 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:17:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:17:20 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Deleted allocations for instance d78e0386-15c1-455a-960e-e8dbb1d17fcf
Aug 27 07:17:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-0d162736-5618-4f58-8c82-5e06c45c5e69 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "d78e0386-15c1-455a-960e-e8dbb1d17fcf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.026s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:17:23 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:17:23 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:17:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:17:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:17:23 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:17:23 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:17:24 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:17:24 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:17:24 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8909MB free_disk=23.933753967285156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:17:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:17:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:17:24 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:17:24 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:17:24 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:17:24 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:17:24 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:17:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:17:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:17:29 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:17:33 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693120638.7285602, d78e0386-15c1-455a-960e-e8dbb1d17fcf => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:17:33 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] VM Stopped (Lifecycle Event)
Aug 27 07:17:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-ed20b6a8-ec20-44e5-9903-d67ba6a3012f None None] [instance: d78e0386-15c1-455a-960e-e8dbb1d17fcf] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:17:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:17:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:17:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:17:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:17:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:17:33 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:17:38 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:17:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:17:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:17:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:17:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:17:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:17:43 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:17:48 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:17:53 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:17:58 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:03 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:18:06 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:18:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:18:09 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "bb13724a-253e-4daf-b427-9fee9e934220" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "bb13724a-253e-4daf-b427-9fee9e934220" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 07:18:10 user nova-compute[73258]: INFO nova.compute.claims [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Claim successful on node user
Aug 27 07:18:10 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG nova.network.neutron [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 07:18:10 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 07:18:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 07:18:10 user nova-compute[73258]: INFO nova.virt.block_device [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Booting with volume 2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e at /dev/vda
Aug 27 07:18:10 user nova-compute[73258]: DEBUG nova.policy [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75d7a7c63b654c47b9df519798186007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002188a1020a4181a03ce17d46608664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG os_brick.utils [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc56f1f-b4c0-41bc-809b-367b068132f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed24ac74-57c5-4ca6-b978-c3ea912346cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a05c80-74d7-4ada-b5e0-5e0255f1b08c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e948771-a2eb-4f25-8771-afaa506026bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:18:10 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d430c3c0-54e1-419b-9332-f09bd0239dcf]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG os_brick.utils [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Updating existing volume attachment record: 329570df-70bf-4f40-8fca-237db3fd2745 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:18:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:18:11 user nova-compute[73258]: DEBUG nova.network.neutron [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Successfully created port: 7cd34efb-a56d-4040-8b72-a571256e0937 {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 07:18:11 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:18:12 user nova-compute[73258]: DEBUG nova.network.neutron [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Successfully updated port: 7cd34efb-a56d-4040-8b72-a571256e0937 {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 07:18:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:18:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquired lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:18:12 user nova-compute[73258]: DEBUG nova.network.neutron [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 07:18:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-901c8dd0-32a4-47ae-98b4-b50fe5ab3167 req-4beb0bc2-0c7c-4012-b8e0-a5292f902bd5 service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Received event network-changed-7cd34efb-a56d-4040-8b72-a571256e0937 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:18:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-901c8dd0-32a4-47ae-98b4-b50fe5ab3167 req-4beb0bc2-0c7c-4012-b8e0-a5292f902bd5 service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Refreshing instance network info cache due to event network-changed-7cd34efb-a56d-4040-8b72-a571256e0937. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:18:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-901c8dd0-32a4-47ae-98b4-b50fe5ab3167 req-4beb0bc2-0c7c-4012-b8e0-a5292f902bd5 service nova] Acquiring lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:18:12 user nova-compute[73258]: DEBUG nova.network.neutron [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 07:18:12 user nova-compute[73258]: DEBUG nova.network.neutron [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Updating instance_info_cache with network_info: [{"id": "7cd34efb-a56d-4040-8b72-a571256e0937", "address": "fa:16:3e:a4:9f:34", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd34efb-a5", "ovs_interfaceid": "7cd34efb-a56d-4040-8b72-a571256e0937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:18:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Releasing lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:18:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Instance network_info: |[{"id": "7cd34efb-a56d-4040-8b72-a571256e0937", "address": "fa:16:3e:a4:9f:34", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd34efb-a5", "ovs_interfaceid": "7cd34efb-a56d-4040-8b72-a571256e0937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 07:18:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-901c8dd0-32a4-47ae-98b4-b50fe5ab3167 req-4beb0bc2-0c7c-4012-b8e0-a5292f902bd5 service nova] Acquired lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:18:12 user nova-compute[73258]: DEBUG nova.network.neutron [req-901c8dd0-32a4-47ae-98b4-b50fe5ab3167 req-4beb0bc2-0c7c-4012-b8e0-a5292f902bd5 service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Refreshing network info cache for port 7cd34efb-a56d-4040-8b72-a571256e0937 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:18:13 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:18:13 user nova-compute[73258]: DEBUG nova.network.neutron [req-901c8dd0-32a4-47ae-98b4-b50fe5ab3167 req-4beb0bc2-0c7c-4012-b8e0-a5292f902bd5 service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Updated VIF entry in instance network info cache for port 7cd34efb-a56d-4040-8b72-a571256e0937. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:18:13 user nova-compute[73258]: DEBUG nova.network.neutron [req-901c8dd0-32a4-47ae-98b4-b50fe5ab3167 req-4beb0bc2-0c7c-4012-b8e0-a5292f902bd5 service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Updating instance_info_cache with network_info: [{"id": "7cd34efb-a56d-4040-8b72-a571256e0937", "address": "fa:16:3e:a4:9f:34", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd34efb-a5", "ovs_interfaceid": "7cd34efb-a56d-4040-8b72-a571256e0937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:18:13 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-901c8dd0-32a4-47ae-98b4-b50fe5ab3167 req-4beb0bc2-0c7c-4012-b8e0-a5292f902bd5 service nova] Releasing lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:18:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:18:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:18:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:18:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:18:13 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:18:13 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:18:16 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:18:16 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:18:16 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 07:18:16 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Skipping network cache update for instance because it is Building. {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 07:18:16 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Didn't find any instances for network info cache update. {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 07:18:18 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:18:18 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.compute.manager [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 07:18:21 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Creating image(s)
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Did not create local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Ensure instance console log exists: /opt/stack/data/nova/instances/bb13724a-253e-4daf-b427-9fee9e934220/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Start _get_guest_xml network_info=[{"id": "7cd34efb-a56d-4040-8b72-a571256e0937", "address": "fa:16:3e:a4:9f:34", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd34efb-a5", "ovs_interfaceid": "7cd34efb-a56d-4040-8b72-a571256e0937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rvTJxLVB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bb13724a-253e-4daf-b427-9fee9e934220', 'attached_at': '', 'detached_at': '', 'volume_id': '2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e', 'serial': '2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e'}, 'attachment_id': '329570df-70bf-4f40-8fca-237db3fd2745', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 07:18:21 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:18:21 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rvTJxLVB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:18:21 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:18:21 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:18:21 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f0fdbb-ad6f-4fbc-b53f-1bea44e0a969]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 07:18:21 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dabca4a-52e9-4f8f-ab6b-b10a2df066ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e] added
Aug 27 07:18:21 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fe7d14-fa97-4e98-a70a-4e13b29b65f5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[eceb4fd5-8419-4907-8af0-57f114c56ae8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rvTJxLVB {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rvTJxLVB" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a05333a-ad53-48a2-b52c-91531a6b3595]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rvTJxLVB'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e895ee61-7b83-495a-8502-e0d1a5de082a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d138e3eb-1f17-430c-9270-e32a35f58342]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 07:18:21 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 07:18:21 user nova-compute[73258]:  {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:18:21 user nova-compute[73258]: WARNING os_brick.initiator.connectors.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 07:18:21 user nova-compute[73258]: 
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc087837-8314-4432-8c76-a0e4969a28ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e, portal: 172.16.0.220,3260]
Aug 27 07:18:21 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e, portal: 172.16.0.220,3260] successful.
Aug 27 07:18:21 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[700d1799-5f91-422c-a777-5be589a55e7b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[365bcd45-9e54-4136-b01a-26d3e2e773b3]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)
Aug 27 07:18:21 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)
Aug 27 07:18:21 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31fa70f-1323-42fd-b779-eed0c0fefa22]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 07:18:21 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rvTJxLVB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23337643866383561', 'path': '/dev/sdb'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337643866383561', 'path': '/dev/sdb'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:18:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1987452102',display_name='tempest-TestVolumeBootPattern-server-1987452102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1987452102',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo/xbbNe5pugCZg6rttcuY3cd+j5BXvTZqbtXYGtXdbHJjMmHnbNi6AcvQmn26/ej5MtnY4axwFKH938p8BxyCO57BkYFUl23uzp1PG94w6lTkTvJDFna0AJYvDX8Futg==',key_name='tempest-TestVolumeBootPattern-2109572928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='002188a1020a4181a03ce17d46608664',ramdisk_id='',reservation_id='r-347znda0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-833647414',owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:18:11Z,user_data=None,user_id='75d7a7c63b654c47b9df519798186007',uuid=bb13724a-253e-4daf-b427-9fee9e934220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cd34efb-a56d-4040-8b72-a571256e0937", "address": "fa:16:3e:a4:9f:34", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd34efb-a5", "ovs_interfaceid": "7cd34efb-a56d-4040-8b72-a571256e0937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converting VIF {"id": "7cd34efb-a56d-4040-8b72-a571256e0937", "address": "fa:16:3e:a4:9f:34", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd34efb-a5", "ovs_interfaceid": "7cd34efb-a56d-4040-8b72-a571256e0937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9f:34,bridge_name='br-int',has_traffic_filtering=True,id=7cd34efb-a56d-4040-8b72-a571256e0937,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd34efb-a5') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG nova.objects.instance [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lazy-loading 'pci_devices' on Instance uuid bb13724a-253e-4daf-b427-9fee9e934220 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] End _get_guest_xml xml=<domain type="kvm">
Aug 27 07:18:22 user nova-compute[73258]:   <uuid>bb13724a-253e-4daf-b427-9fee9e934220</uuid>
Aug 27 07:18:22 user nova-compute[73258]:   <name>instance-00000033</name>
Aug 27 07:18:22 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 07:18:22 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 07:18:22 user nova-compute[73258]:   <metadata>
Aug 27 07:18:22 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 07:18:22 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 07:18:22 user nova-compute[73258]:       <nova:name>tempest-TestVolumeBootPattern-server-1987452102</nova:name>
Aug 27 07:18:22 user nova-compute[73258]:       <nova:creationTime>2023-08-27 07:18:21</nova:creationTime>
Aug 27 07:18:22 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 07:18:22 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 07:18:22 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 07:18:22 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 07:18:22 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 07:18:22 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 07:18:22 user nova-compute[73258]:       </nova:flavor>
Aug 27 07:18:22 user nova-compute[73258]:       <nova:owner>
Aug 27 07:18:22 user nova-compute[73258]:         <nova:user uuid="75d7a7c63b654c47b9df519798186007">tempest-TestVolumeBootPattern-833647414-project-member</nova:user>
Aug 27 07:18:22 user nova-compute[73258]:         <nova:project uuid="002188a1020a4181a03ce17d46608664">tempest-TestVolumeBootPattern-833647414</nova:project>
Aug 27 07:18:22 user nova-compute[73258]:       </nova:owner>
Aug 27 07:18:22 user nova-compute[73258]:       <nova:ports>
Aug 27 07:18:22 user nova-compute[73258]:         <nova:port uuid="7cd34efb-a56d-4040-8b72-a571256e0937">
Aug 27 07:18:22 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 07:18:22 user nova-compute[73258]:         </nova:port>
Aug 27 07:18:22 user nova-compute[73258]:       </nova:ports>
Aug 27 07:18:22 user nova-compute[73258]:     </nova:instance>
Aug 27 07:18:22 user nova-compute[73258]:   </metadata>
Aug 27 07:18:22 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 07:18:22 user nova-compute[73258]:     <system>
Aug 27 07:18:22 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 07:18:22 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 07:18:22 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 07:18:22 user nova-compute[73258]:       <entry name="serial">bb13724a-253e-4daf-b427-9fee9e934220</entry>
Aug 27 07:18:22 user nova-compute[73258]:       <entry name="uuid">bb13724a-253e-4daf-b427-9fee9e934220</entry>
Aug 27 07:18:22 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 07:18:22 user nova-compute[73258]:     </system>
Aug 27 07:18:22 user nova-compute[73258]:   </sysinfo>
Aug 27 07:18:22 user nova-compute[73258]:   <os>
Aug 27 07:18:22 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 07:18:22 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 07:18:22 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 07:18:22 user nova-compute[73258]:   </os>
Aug 27 07:18:22 user nova-compute[73258]:   <features>
Aug 27 07:18:22 user nova-compute[73258]:     <acpi/>
Aug 27 07:18:22 user nova-compute[73258]:     <apic/>
Aug 27 07:18:22 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 07:18:22 user nova-compute[73258]:   </features>
Aug 27 07:18:22 user nova-compute[73258]:   <clock offset="utc">
Aug 27 07:18:22 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 07:18:22 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 07:18:22 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 07:18:22 user nova-compute[73258]:   </clock>
Aug 27 07:18:22 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 07:18:22 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 07:18:22 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 07:18:22 user nova-compute[73258]:   </cpu>
Aug 27 07:18:22 user nova-compute[73258]:   <devices>
Aug 27 07:18:22 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 07:18:22 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:18:22 user nova-compute[73258]:       <source dev="/dev/sdb"/>
Aug 27 07:18:22 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 07:18:22 user nova-compute[73258]:       <serial>2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e</serial>
Aug 27 07:18:22 user nova-compute[73258]:     </disk>
Aug 27 07:18:22 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 07:18:22 user nova-compute[73258]:       <mac address="fa:16:3e:a4:9f:34"/>
Aug 27 07:18:22 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:18:22 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 07:18:22 user nova-compute[73258]:       <target dev="tap7cd34efb-a5"/>
Aug 27 07:18:22 user nova-compute[73258]:     </interface>
Aug 27 07:18:22 user nova-compute[73258]:     <serial type="pty">
Aug 27 07:18:22 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/bb13724a-253e-4daf-b427-9fee9e934220/console.log" append="off"/>
Aug 27 07:18:22 user nova-compute[73258]:     </serial>
Aug 27 07:18:22 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 07:18:22 user nova-compute[73258]:     <video>
Aug 27 07:18:22 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:18:22 user nova-compute[73258]:     </video>
Aug 27 07:18:22 user nova-compute[73258]:     <rng model="virtio">
Aug 27 07:18:22 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 07:18:22 user nova-compute[73258]:     </rng>
Aug 27 07:18:22 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 07:18:22 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 07:18:22 user nova-compute[73258]:       <stats period="10"/>
Aug 27 07:18:22 user nova-compute[73258]:     </memballoon>
Aug 27 07:18:22 user nova-compute[73258]:   </devices>
Aug 27 07:18:22 user nova-compute[73258]: </domain>
Aug 27 07:18:22 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:18:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1987452102',display_name='tempest-TestVolumeBootPattern-server-1987452102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1987452102',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo/xbbNe5pugCZg6rttcuY3cd+j5BXvTZqbtXYGtXdbHJjMmHnbNi6AcvQmn26/ej5MtnY4axwFKH938p8BxyCO57BkYFUl23uzp1PG94w6lTkTvJDFna0AJYvDX8Futg==',key_name='tempest-TestVolumeBootPattern-2109572928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='002188a1020a4181a03ce17d46608664',ramdisk_id='',reservation_id='r-347znda0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-833647414',owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:18:11Z,user_data=None,user_id='75d7a7c63b654c47b9df519798186007',uuid=bb13724a-253e-4daf-b427-9fee9e934220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cd34efb-a56d-4040-8b72-a571256e0937", "address": "fa:16:3e:a4:9f:34", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd34efb-a5", "ovs_interfaceid": "7cd34efb-a56d-4040-8b72-a571256e0937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converting VIF {"id": "7cd34efb-a56d-4040-8b72-a571256e0937", "address": "fa:16:3e:a4:9f:34", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd34efb-a5", "ovs_interfaceid": "7cd34efb-a56d-4040-8b72-a571256e0937", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9f:34,bridge_name='br-int',has_traffic_filtering=True,id=7cd34efb-a56d-4040-8b72-a571256e0937,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd34efb-a5') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG os_vif [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9f:34,bridge_name='br-int',has_traffic_filtering=True,id=7cd34efb-a56d-4040-8b72-a571256e0937,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd34efb-a5') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cd34efb-a5, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7cd34efb-a5, col_values=(('external_ids', {'iface-id': '7cd34efb-a56d-4040-8b72-a571256e0937', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:9f:34', 'vm-uuid': 'bb13724a-253e-4daf-b427-9fee9e934220'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:22 user nova-compute[73258]: INFO os_vif [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9f:34,bridge_name='br-int',has_traffic_filtering=True,id=7cd34efb-a56d-4040-8b72-a571256e0937,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd34efb-a5')
Aug 27 07:18:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:18:22 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] No VIF found with MAC fa:16:3e:a4:9f:34, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 07:18:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-4e182906-82cb-46d0-a4ac-44a354db7ec2 req-7e1f8db9-96ab-4299-af56-c361da9f6f69 service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Received event network-vif-plugged-7cd34efb-a56d-4040-8b72-a571256e0937 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:18:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4e182906-82cb-46d0-a4ac-44a354db7ec2 req-7e1f8db9-96ab-4299-af56-c361da9f6f69 service nova] Acquiring lock "bb13724a-253e-4daf-b427-9fee9e934220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:18:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4e182906-82cb-46d0-a4ac-44a354db7ec2 req-7e1f8db9-96ab-4299-af56-c361da9f6f69 service nova] Lock "bb13724a-253e-4daf-b427-9fee9e934220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:18:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-4e182906-82cb-46d0-a4ac-44a354db7ec2 req-7e1f8db9-96ab-4299-af56-c361da9f6f69 service nova] Lock "bb13724a-253e-4daf-b427-9fee9e934220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:18:24 user nova-compute[73258]: DEBUG nova.compute.manager [req-4e182906-82cb-46d0-a4ac-44a354db7ec2 req-7e1f8db9-96ab-4299-af56-c361da9f6f69 service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] No waiting events found dispatching network-vif-plugged-7cd34efb-a56d-4040-8b72-a571256e0937 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:18:24 user nova-compute[73258]: WARNING nova.compute.manager [req-4e182906-82cb-46d0-a4ac-44a354db7ec2 req-7e1f8db9-96ab-4299-af56-c361da9f6f69 service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Received unexpected event network-vif-plugged-7cd34efb-a56d-4040-8b72-a571256e0937 for instance with vm_state building and task_state spawning.
Aug 27 07:18:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:24 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:18:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:18:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:18:24 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:18:24 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:18:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:18:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:25 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:18:25 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:18:25 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8879MB free_disk=23.93250274658203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:18:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:18:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:18:25 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bb13724a-253e-4daf-b427-9fee9e934220 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:18:25 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:18:25 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:18:25 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Refreshing inventories for resource provider 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 07:18:25 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Updating ProviderTree inventory for provider 13f05024-5078-4590-94a5-110d29d864c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 07:18:25 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Updating inventory in ProviderTree for provider 13f05024-5078-4590-94a5-110d29d864c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 07:18:25 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Refreshing aggregate associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, aggregates: None {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 07:18:25 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Refreshing trait associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 07:18:25 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:18:25 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:18:25 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:18:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.334s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:18:26 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693120706.4391954, bb13724a-253e-4daf-b427-9fee9e934220 => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:18:26 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bb13724a-253e-4daf-b427-9fee9e934220] VM Resumed (Lifecycle Event)
Aug 27 07:18:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 07:18:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 07:18:26 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Instance spawned successfully.
Aug 27 07:18:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 07:18:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:18:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:18:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:18:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:18:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:18:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:18:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:18:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:18:26 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bb13724a-253e-4daf-b427-9fee9e934220] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:18:26 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693120706.4418871, bb13724a-253e-4daf-b427-9fee9e934220 => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:18:26 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bb13724a-253e-4daf-b427-9fee9e934220] VM Started (Lifecycle Event)
Aug 27 07:18:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:18:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:18:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-caa6f1da-c59a-4373-badb-30d089717e9f req-803eba80-cdee-4a42-af44-0729d61f1ebe service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Received event network-vif-plugged-7cd34efb-a56d-4040-8b72-a571256e0937 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:18:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-caa6f1da-c59a-4373-badb-30d089717e9f req-803eba80-cdee-4a42-af44-0729d61f1ebe service nova] Acquiring lock "bb13724a-253e-4daf-b427-9fee9e934220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:18:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-caa6f1da-c59a-4373-badb-30d089717e9f req-803eba80-cdee-4a42-af44-0729d61f1ebe service nova] Lock "bb13724a-253e-4daf-b427-9fee9e934220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:18:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-caa6f1da-c59a-4373-badb-30d089717e9f req-803eba80-cdee-4a42-af44-0729d61f1ebe service nova] Lock "bb13724a-253e-4daf-b427-9fee9e934220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:18:26 user nova-compute[73258]: DEBUG nova.compute.manager [req-caa6f1da-c59a-4373-badb-30d089717e9f req-803eba80-cdee-4a42-af44-0729d61f1ebe service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] No waiting events found dispatching network-vif-plugged-7cd34efb-a56d-4040-8b72-a571256e0937 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:18:26 user nova-compute[73258]: WARNING nova.compute.manager [req-caa6f1da-c59a-4373-badb-30d089717e9f req-803eba80-cdee-4a42-af44-0729d61f1ebe service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Received unexpected event network-vif-plugged-7cd34efb-a56d-4040-8b72-a571256e0937 for instance with vm_state building and task_state spawning.
Aug 27 07:18:26 user nova-compute[73258]: INFO nova.compute.manager [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 27 07:18:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:18:26 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: bb13724a-253e-4daf-b427-9fee9e934220] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:18:26 user nova-compute[73258]: INFO nova.compute.manager [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Took 16.42 seconds to build instance.
Aug 27 07:18:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-20ade0c5-c0c9-4ddc-8705-14431527a7c3 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "bb13724a-253e-4daf-b427-9fee9e934220" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.513s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:18:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:30 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:18:30 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 07:18:30 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:18:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:33 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:18:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 07:18:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] There are 0 instances to clean {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 07:18:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:18:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:19:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:19:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:19:07 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:19:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:19:11 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:19:11 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:19:11 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:19:11 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:19:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:19:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:19:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:19:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:19:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:19:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:19:13 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:19:15 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:19:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:19:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:19:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:19:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:19:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:19:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:19:18 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:19:18 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:19:18 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 07:19:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:19:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:19:18 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 07:19:18 user nova-compute[73258]: DEBUG nova.objects.instance [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lazy-loading 'info_cache' on Instance uuid bb13724a-253e-4daf-b427-9fee9e934220 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:19:19 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Updating instance_info_cache with network_info: [{"id": "7cd34efb-a56d-4040-8b72-a571256e0937", "address": "fa:16:3e:a4:9f:34", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd34efb-a5", "ovs_interfaceid": "7cd34efb-a56d-4040-8b72-a571256e0937", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:19:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:19:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 07:19:20 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:19:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:19:25 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:19:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:19:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:19:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:19:25 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:19:25 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:19:26 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:19:26 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:19:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=23.931442260742188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:19:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:19:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:19:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bb13724a-253e-4daf-b427-9fee9e934220 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:19:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:19:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:19:26 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:19:26 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:19:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:19:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:19:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:19:31 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:19:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:19:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:19:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:19:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:19:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:19:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:19:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:19:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:19:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:19:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:19:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:01 user nova-compute[73258]: DEBUG nova.compute.manager [req-fcfe9edd-d6f8-4e8c-8b54-9b95c394a204 req-49992084-043e-492a-bb19-6bba2c8bd25f service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Received event network-changed-7cd34efb-a56d-4040-8b72-a571256e0937 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:20:01 user nova-compute[73258]: DEBUG nova.compute.manager [req-fcfe9edd-d6f8-4e8c-8b54-9b95c394a204 req-49992084-043e-492a-bb19-6bba2c8bd25f service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Refreshing instance network info cache due to event network-changed-7cd34efb-a56d-4040-8b72-a571256e0937. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:20:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fcfe9edd-d6f8-4e8c-8b54-9b95c394a204 req-49992084-043e-492a-bb19-6bba2c8bd25f service nova] Acquiring lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:20:01 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fcfe9edd-d6f8-4e8c-8b54-9b95c394a204 req-49992084-043e-492a-bb19-6bba2c8bd25f service nova] Acquired lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:20:01 user nova-compute[73258]: DEBUG nova.network.neutron [req-fcfe9edd-d6f8-4e8c-8b54-9b95c394a204 req-49992084-043e-492a-bb19-6bba2c8bd25f service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Refreshing network info cache for port 7cd34efb-a56d-4040-8b72-a571256e0937 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:20:02 user nova-compute[73258]: DEBUG nova.network.neutron [req-fcfe9edd-d6f8-4e8c-8b54-9b95c394a204 req-49992084-043e-492a-bb19-6bba2c8bd25f service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Updated VIF entry in instance network info cache for port 7cd34efb-a56d-4040-8b72-a571256e0937. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:20:02 user nova-compute[73258]: DEBUG nova.network.neutron [req-fcfe9edd-d6f8-4e8c-8b54-9b95c394a204 req-49992084-043e-492a-bb19-6bba2c8bd25f service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Updating instance_info_cache with network_info: [{"id": "7cd34efb-a56d-4040-8b72-a571256e0937", "address": "fa:16:3e:a4:9f:34", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd34efb-a5", "ovs_interfaceid": "7cd34efb-a56d-4040-8b72-a571256e0937", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:20:02 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fcfe9edd-d6f8-4e8c-8b54-9b95c394a204 req-49992084-043e-492a-bb19-6bba2c8bd25f service nova] Releasing lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:20:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:09 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:20:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:12 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:20:12 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:20:12 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:20:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:20:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:13 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:20:15 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:20:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "fcfe6864-206e-4484-8eec-00ebce15d87f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:20:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "fcfe6864-206e-4484-8eec-00ebce15d87f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:20:16 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Starting instance... {{(pid=73258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 07:20:17 user nova-compute[73258]: INFO nova.compute.claims [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Claim successful on node user
Aug 27 07:20:17 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Start building networks asynchronously for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Allocating IP information in the background. {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG nova.network.neutron [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] allocate_for_instance() {{(pid=73258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 07:20:17 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 07:20:17 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Start building block device mappings for instance. {{(pid=73258) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 07:20:17 user nova-compute[73258]: INFO nova.virt.block_device [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Booting with volume 01e8850a-2438-43c5-ae3c-0e403b3e4ad3 at /dev/vda
Aug 27 07:20:17 user nova-compute[73258]: DEBUG nova.policy [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75d7a7c63b654c47b9df519798186007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002188a1020a4181a03ce17d46608664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73258) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG os_brick.utils [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4703a015-ba18-4e24-aa06-616d2538e4dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e6b28bed096\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ae6b06-536f-4266-a5bc-29dc989deeab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4804547-955c-4efc-a126-1b839d79c03b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[34971eaa-5d96-4906-9643-dbea86983187]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Running cmd (subprocess): nvme version {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] 'nvme version' failed. Not Retrying. {{(pid=73258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] nvme not present on system {{(pid=73258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 07:20:17 user nova-compute[73258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 07:20:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b38b73-226c-427e-89f7-cf1ab53cddfa]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] LIGHTOS: no hostnqn found. {{(pid=73258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG os_brick.utils [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e6b28bed096', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG nova.virt.block_device [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Updating existing volume attachment record: 262f53aa-4f84-461e-9d6c-5446dd0f88b6 {{(pid=73258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG nova.network.neutron [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Successfully created port: 3be17249-ba4f-4354-8ec8-b95fc5b8c40e {{(pid=73258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 07:20:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:20:18 user nova-compute[73258]: DEBUG nova.network.neutron [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Successfully updated port: 3be17249-ba4f-4354-8ec8-b95fc5b8c40e {{(pid=73258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 07:20:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "refresh_cache-fcfe6864-206e-4484-8eec-00ebce15d87f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:20:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquired lock "refresh_cache-fcfe6864-206e-4484-8eec-00ebce15d87f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:20:18 user nova-compute[73258]: DEBUG nova.network.neutron [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Building network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 07:20:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-b683b1a5-7a2c-419b-aebc-89b47e107be1 req-e18c685c-532a-4896-8b90-de54dd25ccdc service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Received event network-changed-3be17249-ba4f-4354-8ec8-b95fc5b8c40e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:20:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-b683b1a5-7a2c-419b-aebc-89b47e107be1 req-e18c685c-532a-4896-8b90-de54dd25ccdc service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Refreshing instance network info cache due to event network-changed-3be17249-ba4f-4354-8ec8-b95fc5b8c40e. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:20:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b683b1a5-7a2c-419b-aebc-89b47e107be1 req-e18c685c-532a-4896-8b90-de54dd25ccdc service nova] Acquiring lock "refresh_cache-fcfe6864-206e-4484-8eec-00ebce15d87f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:20:18 user nova-compute[73258]: DEBUG nova.network.neutron [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Instance cache missing network info. {{(pid=73258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 07:20:18 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:20:18 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:20:18 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 07:20:18 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Skipping network cache update for instance because it is Building. {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 07:20:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:20:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:20:18 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 07:20:18 user nova-compute[73258]: DEBUG nova.objects.instance [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lazy-loading 'info_cache' on Instance uuid bb13724a-253e-4daf-b427-9fee9e934220 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:20:19 user nova-compute[73258]: DEBUG nova.network.neutron [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Updating instance_info_cache with network_info: [{"id": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "address": "fa:16:3e:9a:04:aa", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17249-ba", "ovs_interfaceid": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:20:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Releasing lock "refresh_cache-fcfe6864-206e-4484-8eec-00ebce15d87f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:20:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Instance network_info: |[{"id": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "address": "fa:16:3e:9a:04:aa", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17249-ba", "ovs_interfaceid": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 07:20:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b683b1a5-7a2c-419b-aebc-89b47e107be1 req-e18c685c-532a-4896-8b90-de54dd25ccdc service nova] Acquired lock "refresh_cache-fcfe6864-206e-4484-8eec-00ebce15d87f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:20:19 user nova-compute[73258]: DEBUG nova.network.neutron [req-b683b1a5-7a2c-419b-aebc-89b47e107be1 req-e18c685c-532a-4896-8b90-de54dd25ccdc service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Refreshing network info cache for port 3be17249-ba4f-4354-8ec8-b95fc5b8c40e {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:20:19 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Updating instance_info_cache with network_info: [{"id": "7cd34efb-a56d-4040-8b72-a571256e0937", "address": "fa:16:3e:a4:9f:34", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd34efb-a5", "ovs_interfaceid": "7cd34efb-a56d-4040-8b72-a571256e0937", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:20:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:20:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 07:20:19 user nova-compute[73258]: DEBUG nova.network.neutron [req-b683b1a5-7a2c-419b-aebc-89b47e107be1 req-e18c685c-532a-4896-8b90-de54dd25ccdc service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Updated VIF entry in instance network info cache for port 3be17249-ba4f-4354-8ec8-b95fc5b8c40e. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:20:19 user nova-compute[73258]: DEBUG nova.network.neutron [req-b683b1a5-7a2c-419b-aebc-89b47e107be1 req-e18c685c-532a-4896-8b90-de54dd25ccdc service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Updating instance_info_cache with network_info: [{"id": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "address": "fa:16:3e:9a:04:aa", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17249-ba", "ovs_interfaceid": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:20:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b683b1a5-7a2c-419b-aebc-89b47e107be1 req-e18c685c-532a-4896-8b90-de54dd25ccdc service nova] Releasing lock "refresh_cache-fcfe6864-206e-4484-8eec-00ebce15d87f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:20:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:21 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:20:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:25 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:20:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:20:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:20:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:20:25 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:20:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:20:26 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:20:26 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:20:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8811MB free_disk=23.930335998535156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:20:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:20:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:20:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bb13724a-253e-4daf-b427-9fee9e934220 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:20:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance fcfe6864-206e-4484-8eec-00ebce15d87f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:20:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:20:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:20:26 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:20:26 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:20:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:20:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:20:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Start spawning the instance on the hypervisor. {{(pid=73258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Creating instance directory {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 07:20:28 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Creating image(s)
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Did not create local disks {{(pid=73258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Ensure instance console log exists: /opt/stack/data/nova/instances/fcfe6864-206e-4484-8eec-00ebce15d87f/console.log {{(pid=73258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Start _get_guest_xml network_info=[{"id": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "address": "fa:16:3e:9a:04:aa", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17249-ba", "ovs_interfaceid": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'astyvOIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fcfe6864-206e-4484-8eec-00ebce15d87f', 'attached_at': '', 'detached_at': '', 'volume_id': '01e8850a-2438-43c5-ae3c-0e403b3e4ad3', 'serial': '01e8850a-2438-43c5-ae3c-0e403b3e4ad3'}, 'attachment_id': '262f53aa-4f84-461e-9d6c-5446dd0f88b6', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 07:20:28 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:20:28 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] CPU controller missing on host. {{(pid=73258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.host [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] CPU controller found on host. {{(pid=73258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T06:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Flavor limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Image limits 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Flavor pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Image pref 0:0:0 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Got 1 possible topologies {{(pid=73258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.hardware [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Calling os-brick to attach iSCSI Volume {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'astyvOIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:20:28 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:20:28 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:20:28 user nova-compute[73258]: INFO os_brick.initiator.connectors.iscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6284244-d721-49eb-ade4-e85718fdf31e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 07:20:28 user nova-compute[73258]:  {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c75298-8a83-4e83-9cdf-c9b527c0da95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3] added
Aug 27 07:20:28 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b27dcc-01aa-4b3b-a046-78710f902734]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fde9e1-0a2f-4b8c-beb9-a05c2051ba6a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v astyvOIg {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v astyvOIg" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd6b4cd-9d7b-47d4-8d73-86736a3000b2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'astyvOIg'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dad80aa-6f42-4fef-be88-cc195dc4946a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d48935-79c6-4e18-8c42-a3f99bd28a3f]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)
Aug 27 07:20:28 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)
Aug 27 07:20:28 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a59fc44-9a21-412e-8973-3de2a739eedc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3, portal: 172.16.0.220,3260]
Aug 27 07:20:28 user nova-compute[73258]: Login to [iface: default, target: iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3, portal: 172.16.0.220,3260] successful.
Aug 27 07:20:28 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0cc512-c0e8-446b-ba64-37b419b5522d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5456d282-c778-4a57-bb7e-72ca6c4f628c]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)
Aug 27 07:20:28 user nova-compute[73258]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 (non-flash)
Aug 27 07:20:28 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)
Aug 27 07:20:28 user nova-compute[73258]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 (non-flash)
Aug 27 07:20:28 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Connected to 172.16.0.220:3260 {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=73258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3d9976-15bc-40e9-9585-5266f76746e8]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 07:20:28 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'astyvOIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 07:20:29 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:20:29 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23133646165356235', 'path': '/dev/sdc'} {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:20:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133646165356235', 'path': '/dev/sdc'} {{(pid=73258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 07:20:29 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:20:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2037212677',display_name='tempest-TestVolumeBootPattern-server-2037212677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2037212677',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo/xbbNe5pugCZg6rttcuY3cd+j5BXvTZqbtXYGtXdbHJjMmHnbNi6AcvQmn26/ej5MtnY4axwFKH938p8BxyCO57BkYFUl23uzp1PG94w6lTkTvJDFna0AJYvDX8Futg==',key_name='tempest-TestVolumeBootPattern-2109572928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='002188a1020a4181a03ce17d46608664',ramdisk_id='',reservation_id='r-wub12zjl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-833647414',owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:20:17Z,user_data=None,user_id='75d7a7c63b654c47b9df519798186007',uuid=fcfe6864-206e-4484-8eec-00ebce15d87f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "address": "fa:16:3e:9a:04:aa", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17249-ba", "ovs_interfaceid": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 07:20:29 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converting VIF {"id": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "address": "fa:16:3e:9a:04:aa", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17249-ba", "ovs_interfaceid": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:20:29 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:04:aa,bridge_name='br-int',has_traffic_filtering=True,id=3be17249-ba4f-4354-8ec8-b95fc5b8c40e,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17249-ba') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:20:29 user nova-compute[73258]: DEBUG nova.objects.instance [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lazy-loading 'pci_devices' on Instance uuid fcfe6864-206e-4484-8eec-00ebce15d87f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:20:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 07:20:30 user nova-compute[73258]:   <uuid>fcfe6864-206e-4484-8eec-00ebce15d87f</uuid>
Aug 27 07:20:30 user nova-compute[73258]:   <name>instance-00000034</name>
Aug 27 07:20:30 user nova-compute[73258]:   <memory>524288</memory>
Aug 27 07:20:30 user nova-compute[73258]:   <vcpu>1</vcpu>
Aug 27 07:20:30 user nova-compute[73258]:   <metadata>
Aug 27 07:20:30 user nova-compute[73258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 07:20:30 user nova-compute[73258]:       <nova:package version="0.0.0"/>
Aug 27 07:20:30 user nova-compute[73258]:       <nova:name>tempest-TestVolumeBootPattern-server-2037212677</nova:name>
Aug 27 07:20:30 user nova-compute[73258]:       <nova:creationTime>2023-08-27 07:20:28</nova:creationTime>
Aug 27 07:20:30 user nova-compute[73258]:       <nova:flavor name="m1.tiny">
Aug 27 07:20:30 user nova-compute[73258]:         <nova:memory>512</nova:memory>
Aug 27 07:20:30 user nova-compute[73258]:         <nova:disk>1</nova:disk>
Aug 27 07:20:30 user nova-compute[73258]:         <nova:swap>0</nova:swap>
Aug 27 07:20:30 user nova-compute[73258]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 07:20:30 user nova-compute[73258]:         <nova:vcpus>1</nova:vcpus>
Aug 27 07:20:30 user nova-compute[73258]:       </nova:flavor>
Aug 27 07:20:30 user nova-compute[73258]:       <nova:owner>
Aug 27 07:20:30 user nova-compute[73258]:         <nova:user uuid="75d7a7c63b654c47b9df519798186007">tempest-TestVolumeBootPattern-833647414-project-member</nova:user>
Aug 27 07:20:30 user nova-compute[73258]:         <nova:project uuid="002188a1020a4181a03ce17d46608664">tempest-TestVolumeBootPattern-833647414</nova:project>
Aug 27 07:20:30 user nova-compute[73258]:       </nova:owner>
Aug 27 07:20:30 user nova-compute[73258]:       <nova:ports>
Aug 27 07:20:30 user nova-compute[73258]:         <nova:port uuid="3be17249-ba4f-4354-8ec8-b95fc5b8c40e">
Aug 27 07:20:30 user nova-compute[73258]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 07:20:30 user nova-compute[73258]:         </nova:port>
Aug 27 07:20:30 user nova-compute[73258]:       </nova:ports>
Aug 27 07:20:30 user nova-compute[73258]:     </nova:instance>
Aug 27 07:20:30 user nova-compute[73258]:   </metadata>
Aug 27 07:20:30 user nova-compute[73258]:   <sysinfo type="smbios">
Aug 27 07:20:30 user nova-compute[73258]:     <system>
Aug 27 07:20:30 user nova-compute[73258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 07:20:30 user nova-compute[73258]:       <entry name="product">OpenStack Nova</entry>
Aug 27 07:20:30 user nova-compute[73258]:       <entry name="version">0.0.0</entry>
Aug 27 07:20:30 user nova-compute[73258]:       <entry name="serial">fcfe6864-206e-4484-8eec-00ebce15d87f</entry>
Aug 27 07:20:30 user nova-compute[73258]:       <entry name="uuid">fcfe6864-206e-4484-8eec-00ebce15d87f</entry>
Aug 27 07:20:30 user nova-compute[73258]:       <entry name="family">Virtual Machine</entry>
Aug 27 07:20:30 user nova-compute[73258]:     </system>
Aug 27 07:20:30 user nova-compute[73258]:   </sysinfo>
Aug 27 07:20:30 user nova-compute[73258]:   <os>
Aug 27 07:20:30 user nova-compute[73258]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 07:20:30 user nova-compute[73258]:     <boot dev="hd"/>
Aug 27 07:20:30 user nova-compute[73258]:     <smbios mode="sysinfo"/>
Aug 27 07:20:30 user nova-compute[73258]:   </os>
Aug 27 07:20:30 user nova-compute[73258]:   <features>
Aug 27 07:20:30 user nova-compute[73258]:     <acpi/>
Aug 27 07:20:30 user nova-compute[73258]:     <apic/>
Aug 27 07:20:30 user nova-compute[73258]:     <vmcoreinfo/>
Aug 27 07:20:30 user nova-compute[73258]:   </features>
Aug 27 07:20:30 user nova-compute[73258]:   <clock offset="utc">
Aug 27 07:20:30 user nova-compute[73258]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 07:20:30 user nova-compute[73258]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 07:20:30 user nova-compute[73258]:     <timer name="hpet" present="no"/>
Aug 27 07:20:30 user nova-compute[73258]:   </clock>
Aug 27 07:20:30 user nova-compute[73258]:   <cpu mode="custom" match="exact">
Aug 27 07:20:30 user nova-compute[73258]:     <model>Nehalem</model>
Aug 27 07:20:30 user nova-compute[73258]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 07:20:30 user nova-compute[73258]:   </cpu>
Aug 27 07:20:30 user nova-compute[73258]:   <devices>
Aug 27 07:20:30 user nova-compute[73258]:     <disk type="block" device="disk">
Aug 27 07:20:30 user nova-compute[73258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 07:20:30 user nova-compute[73258]:       <source dev="/dev/sdc"/>
Aug 27 07:20:30 user nova-compute[73258]:       <target dev="vda" bus="virtio"/>
Aug 27 07:20:30 user nova-compute[73258]:       <serial>01e8850a-2438-43c5-ae3c-0e403b3e4ad3</serial>
Aug 27 07:20:30 user nova-compute[73258]:     </disk>
Aug 27 07:20:30 user nova-compute[73258]:     <interface type="ethernet">
Aug 27 07:20:30 user nova-compute[73258]:       <mac address="fa:16:3e:9a:04:aa"/>
Aug 27 07:20:30 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:20:30 user nova-compute[73258]:       <mtu size="1442"/>
Aug 27 07:20:30 user nova-compute[73258]:       <target dev="tap3be17249-ba"/>
Aug 27 07:20:30 user nova-compute[73258]:     </interface>
Aug 27 07:20:30 user nova-compute[73258]:     <serial type="pty">
Aug 27 07:20:30 user nova-compute[73258]:       <log file="/opt/stack/data/nova/instances/fcfe6864-206e-4484-8eec-00ebce15d87f/console.log" append="off"/>
Aug 27 07:20:30 user nova-compute[73258]:     </serial>
Aug 27 07:20:30 user nova-compute[73258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 07:20:30 user nova-compute[73258]:     <video>
Aug 27 07:20:30 user nova-compute[73258]:       <model type="virtio"/>
Aug 27 07:20:30 user nova-compute[73258]:     </video>
Aug 27 07:20:30 user nova-compute[73258]:     <rng model="virtio">
Aug 27 07:20:30 user nova-compute[73258]:       <backend model="random">/dev/urandom</backend>
Aug 27 07:20:30 user nova-compute[73258]:     </rng>
Aug 27 07:20:30 user nova-compute[73258]:     <controller type="usb" index="0" model="none"/>
Aug 27 07:20:30 user nova-compute[73258]:     <memballoon model="virtio">
Aug 27 07:20:30 user nova-compute[73258]:       <stats period="10"/>
Aug 27 07:20:30 user nova-compute[73258]:     </memballoon>
Aug 27 07:20:30 user nova-compute[73258]:   </devices>
Aug 27 07:20:30 user nova-compute[73258]: </domain>
Aug 27 07:20:30 user nova-compute[73258]:  {{(pid=73258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 07:20:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:20:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2037212677',display_name='tempest-TestVolumeBootPattern-server-2037212677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2037212677',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo/xbbNe5pugCZg6rttcuY3cd+j5BXvTZqbtXYGtXdbHJjMmHnbNi6AcvQmn26/ej5MtnY4axwFKH938p8BxyCO57BkYFUl23uzp1PG94w6lTkTvJDFna0AJYvDX8Futg==',key_name='tempest-TestVolumeBootPattern-2109572928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='002188a1020a4181a03ce17d46608664',ramdisk_id='',reservation_id='r-wub12zjl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-833647414',owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T07:20:17Z,user_data=None,user_id='75d7a7c63b654c47b9df519798186007',uuid=fcfe6864-206e-4484-8eec-00ebce15d87f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "address": "fa:16:3e:9a:04:aa", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17249-ba", "ovs_interfaceid": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 07:20:30 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converting VIF {"id": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "address": "fa:16:3e:9a:04:aa", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17249-ba", "ovs_interfaceid": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:20:30 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:04:aa,bridge_name='br-int',has_traffic_filtering=True,id=3be17249-ba4f-4354-8ec8-b95fc5b8c40e,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17249-ba') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:20:30 user nova-compute[73258]: DEBUG os_vif [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:04:aa,bridge_name='br-int',has_traffic_filtering=True,id=3be17249-ba4f-4354-8ec8-b95fc5b8c40e,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17249-ba') {{(pid=73258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 07:20:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:20:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 07:20:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3be17249-ba, may_exist=True, interface_attrs={}) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:20:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3be17249-ba, col_values=(('external_ids', {'iface-id': '3be17249-ba4f-4354-8ec8-b95fc5b8c40e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:04:aa', 'vm-uuid': 'fcfe6864-206e-4484-8eec-00ebce15d87f'}),), if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:20:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:20:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:30 user nova-compute[73258]: INFO os_vif [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:04:aa,bridge_name='br-int',has_traffic_filtering=True,id=3be17249-ba4f-4354-8ec8-b95fc5b8c40e,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17249-ba')
Aug 27 07:20:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] No BDM found with device name vda, not building metadata. {{(pid=73258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 07:20:30 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] No VIF found with MAC fa:16:3e:9a:04:aa, not building metadata {{(pid=73258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 07:20:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:31 user nova-compute[73258]: DEBUG nova.compute.manager [req-15228c9a-7226-4001-9ae1-448d9c2d235d req-06c64eca-72de-4a07-9467-a42c1804312c service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Received event network-vif-plugged-3be17249-ba4f-4354-8ec8-b95fc5b8c40e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:20:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-15228c9a-7226-4001-9ae1-448d9c2d235d req-06c64eca-72de-4a07-9467-a42c1804312c service nova] Acquiring lock "fcfe6864-206e-4484-8eec-00ebce15d87f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:20:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-15228c9a-7226-4001-9ae1-448d9c2d235d req-06c64eca-72de-4a07-9467-a42c1804312c service nova] Lock "fcfe6864-206e-4484-8eec-00ebce15d87f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:20:31 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-15228c9a-7226-4001-9ae1-448d9c2d235d req-06c64eca-72de-4a07-9467-a42c1804312c service nova] Lock "fcfe6864-206e-4484-8eec-00ebce15d87f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:20:31 user nova-compute[73258]: DEBUG nova.compute.manager [req-15228c9a-7226-4001-9ae1-448d9c2d235d req-06c64eca-72de-4a07-9467-a42c1804312c service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] No waiting events found dispatching network-vif-plugged-3be17249-ba4f-4354-8ec8-b95fc5b8c40e {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:20:31 user nova-compute[73258]: WARNING nova.compute.manager [req-15228c9a-7226-4001-9ae1-448d9c2d235d req-06c64eca-72de-4a07-9467-a42c1804312c service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Received unexpected event network-vif-plugged-3be17249-ba4f-4354-8ec8-b95fc5b8c40e for instance with vm_state building and task_state spawning.
Aug 27 07:20:33 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693120833.4864297, fcfe6864-206e-4484-8eec-00ebce15d87f => Resumed> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:20:33 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] VM Resumed (Lifecycle Event)
Aug 27 07:20:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Instance event wait completed in 0 seconds for  {{(pid=73258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 07:20:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Guest created on hypervisor {{(pid=73258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 07:20:33 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Instance spawned successfully.
Aug 27 07:20:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 07:20:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:20:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:20:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Found default for hw_cdrom_bus of ide {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:20:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Found default for hw_disk_bus of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:20:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Found default for hw_input_bus of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:20:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Found default for hw_pointer_model of None {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:20:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Found default for hw_video_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:20:33 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Found default for hw_vif_model of virtio {{(pid=73258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 07:20:33 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:20:33 user nova-compute[73258]: DEBUG nova.virt.driver [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] Emitting event <LifecycleEvent: 1693120833.4896407, fcfe6864-206e-4484-8eec-00ebce15d87f => Started> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:20:33 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] VM Started (Lifecycle Event)
Aug 27 07:20:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:20:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73258) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 07:20:33 user nova-compute[73258]: INFO nova.compute.manager [None req-eb2b1cd8-af06-476e-b318-1b189c93ac8b None None] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 07:20:33 user nova-compute[73258]: INFO nova.compute.manager [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Took 4.99 seconds to spawn the instance on the hypervisor.
Aug 27 07:20:33 user nova-compute[73258]: DEBUG nova.compute.manager [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:20:33 user nova-compute[73258]: DEBUG nova.compute.manager [req-bc644c53-16fe-47b6-ad95-89cd743f655f req-583d47ec-354a-42b7-912a-afbd49b859f7 service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Received event network-vif-plugged-3be17249-ba4f-4354-8ec8-b95fc5b8c40e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:20:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bc644c53-16fe-47b6-ad95-89cd743f655f req-583d47ec-354a-42b7-912a-afbd49b859f7 service nova] Acquiring lock "fcfe6864-206e-4484-8eec-00ebce15d87f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:20:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bc644c53-16fe-47b6-ad95-89cd743f655f req-583d47ec-354a-42b7-912a-afbd49b859f7 service nova] Lock "fcfe6864-206e-4484-8eec-00ebce15d87f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:20:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-bc644c53-16fe-47b6-ad95-89cd743f655f req-583d47ec-354a-42b7-912a-afbd49b859f7 service nova] Lock "fcfe6864-206e-4484-8eec-00ebce15d87f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:20:33 user nova-compute[73258]: DEBUG nova.compute.manager [req-bc644c53-16fe-47b6-ad95-89cd743f655f req-583d47ec-354a-42b7-912a-afbd49b859f7 service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] No waiting events found dispatching network-vif-plugged-3be17249-ba4f-4354-8ec8-b95fc5b8c40e {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:20:33 user nova-compute[73258]: WARNING nova.compute.manager [req-bc644c53-16fe-47b6-ad95-89cd743f655f req-583d47ec-354a-42b7-912a-afbd49b859f7 service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Received unexpected event network-vif-plugged-3be17249-ba4f-4354-8ec8-b95fc5b8c40e for instance with vm_state building and task_state spawning.
Aug 27 07:20:33 user nova-compute[73258]: INFO nova.compute.manager [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Took 16.68 seconds to build instance.
Aug 27 07:20:33 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-f9c6e1f8-eac4-4b03-8164-d09d6a9a42da tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "fcfe6864-206e-4484-8eec-00ebce15d87f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.777s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:20:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:20:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:20:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:20:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:20:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:20:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:20:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:21:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:21:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:21:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:21:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:21:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:21:10 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:21:12 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:21:12 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:21:12 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:21:13 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:21:14 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:21:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:21:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:21:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:21:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:21:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:21:15 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:21:15 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:21:19 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:21:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:21:19 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 07:21:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:21:19 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquired lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:21:19 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Forcefully refreshing network info cache for instance {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 07:21:19 user nova-compute[73258]: DEBUG nova.objects.instance [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lazy-loading 'info_cache' on Instance uuid bb13724a-253e-4daf-b427-9fee9e934220 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:21:20 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:21:20 user nova-compute[73258]: DEBUG nova.network.neutron [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Updating instance_info_cache with network_info: [{"id": "7cd34efb-a56d-4040-8b72-a571256e0937", "address": "fa:16:3e:a4:9f:34", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd34efb-a5", "ovs_interfaceid": "7cd34efb-a56d-4040-8b72-a571256e0937", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:21:20 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Releasing lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:21:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Updated the network info_cache for instance {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 07:21:23 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:21:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:21:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:21:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:21:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:21:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:21:25 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:21:25 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:21:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:21:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:21:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:21:25 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:21:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:21:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:21:26 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:21:26 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:21:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8698MB free_disk=23.928974151611328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:21:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:21:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:21:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bb13724a-253e-4daf-b427-9fee9e934220 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:21:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance fcfe6864-206e-4484-8eec-00ebce15d87f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:21:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:21:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:21:26 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:21:26 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:21:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:21:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:21:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:21:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:21:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:21:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:21:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:21:30 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:21:31 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:21:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:21:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:21:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:21:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:21:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:21:35 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:21:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:21:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:21:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:21:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:21:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:21:40 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:21:45 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:21:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:21:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:21:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:21:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:21:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:21:50 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:21:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:21:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:21:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:21:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:21:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:21:55 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:22:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:22:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:22:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:22:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:22:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:22:00 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:22:05 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:22:08 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:22:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-ee63f5cf-7cb8-4cec-9a90-b730d0929ae8 req-66e19040-1738-4f15-9503-19a1b69ce002 service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Received event network-changed-3be17249-ba4f-4354-8ec8-b95fc5b8c40e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:22:09 user nova-compute[73258]: DEBUG nova.compute.manager [req-ee63f5cf-7cb8-4cec-9a90-b730d0929ae8 req-66e19040-1738-4f15-9503-19a1b69ce002 service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Refreshing instance network info cache due to event network-changed-3be17249-ba4f-4354-8ec8-b95fc5b8c40e. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:22:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ee63f5cf-7cb8-4cec-9a90-b730d0929ae8 req-66e19040-1738-4f15-9503-19a1b69ce002 service nova] Acquiring lock "refresh_cache-fcfe6864-206e-4484-8eec-00ebce15d87f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:22:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ee63f5cf-7cb8-4cec-9a90-b730d0929ae8 req-66e19040-1738-4f15-9503-19a1b69ce002 service nova] Acquired lock "refresh_cache-fcfe6864-206e-4484-8eec-00ebce15d87f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:22:09 user nova-compute[73258]: DEBUG nova.network.neutron [req-ee63f5cf-7cb8-4cec-9a90-b730d0929ae8 req-66e19040-1738-4f15-9503-19a1b69ce002 service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Refreshing network info cache for port 3be17249-ba4f-4354-8ec8-b95fc5b8c40e {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:22:09 user nova-compute[73258]: DEBUG nova.network.neutron [req-ee63f5cf-7cb8-4cec-9a90-b730d0929ae8 req-66e19040-1738-4f15-9503-19a1b69ce002 service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Updated VIF entry in instance network info cache for port 3be17249-ba4f-4354-8ec8-b95fc5b8c40e. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:22:09 user nova-compute[73258]: DEBUG nova.network.neutron [req-ee63f5cf-7cb8-4cec-9a90-b730d0929ae8 req-66e19040-1738-4f15-9503-19a1b69ce002 service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Updating instance_info_cache with network_info: [{"id": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "address": "fa:16:3e:9a:04:aa", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17249-ba", "ovs_interfaceid": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:22:09 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-ee63f5cf-7cb8-4cec-9a90-b730d0929ae8 req-66e19040-1738-4f15-9503-19a1b69ce002 service nova] Releasing lock "refresh_cache-fcfe6864-206e-4484-8eec-00ebce15d87f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-fac1628a-97cb-46f7-947a-b74c365726d0 req-96c3bcfc-4c8d-44fc-b620-6ce56725a50c service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Received event network-changed-3be17249-ba4f-4354-8ec8-b95fc5b8c40e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-fac1628a-97cb-46f7-947a-b74c365726d0 req-96c3bcfc-4c8d-44fc-b620-6ce56725a50c service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Refreshing instance network info cache due to event network-changed-3be17249-ba4f-4354-8ec8-b95fc5b8c40e. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fac1628a-97cb-46f7-947a-b74c365726d0 req-96c3bcfc-4c8d-44fc-b620-6ce56725a50c service nova] Acquiring lock "refresh_cache-fcfe6864-206e-4484-8eec-00ebce15d87f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fac1628a-97cb-46f7-947a-b74c365726d0 req-96c3bcfc-4c8d-44fc-b620-6ce56725a50c service nova] Acquired lock "refresh_cache-fcfe6864-206e-4484-8eec-00ebce15d87f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG nova.network.neutron [req-fac1628a-97cb-46f7-947a-b74c365726d0 req-96c3bcfc-4c8d-44fc-b620-6ce56725a50c service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Refreshing network info cache for port 3be17249-ba4f-4354-8ec8-b95fc5b8c40e {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "fcfe6864-206e-4484-8eec-00ebce15d87f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "fcfe6864-206e-4484-8eec-00ebce15d87f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.008s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "fcfe6864-206e-4484-8eec-00ebce15d87f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "fcfe6864-206e-4484-8eec-00ebce15d87f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "fcfe6864-206e-4484-8eec-00ebce15d87f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:22:10 user nova-compute[73258]: INFO nova.compute.manager [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Terminating instance
Aug 27 07:22:10 user nova-compute[73258]: DEBUG nova.compute.manager [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-b7acf53e-8add-417f-b483-bc155835303a req-62c97ea2-bec4-4468-9574-0a71bc1a28b3 service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Received event network-vif-unplugged-3be17249-ba4f-4354-8ec8-b95fc5b8c40e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b7acf53e-8add-417f-b483-bc155835303a req-62c97ea2-bec4-4468-9574-0a71bc1a28b3 service nova] Acquiring lock "fcfe6864-206e-4484-8eec-00ebce15d87f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b7acf53e-8add-417f-b483-bc155835303a req-62c97ea2-bec4-4468-9574-0a71bc1a28b3 service nova] Lock "fcfe6864-206e-4484-8eec-00ebce15d87f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-b7acf53e-8add-417f-b483-bc155835303a req-62c97ea2-bec4-4468-9574-0a71bc1a28b3 service nova] Lock "fcfe6864-206e-4484-8eec-00ebce15d87f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-b7acf53e-8add-417f-b483-bc155835303a req-62c97ea2-bec4-4468-9574-0a71bc1a28b3 service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] No waiting events found dispatching network-vif-unplugged-3be17249-ba4f-4354-8ec8-b95fc5b8c40e {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG nova.compute.manager [req-b7acf53e-8add-417f-b483-bc155835303a req-62c97ea2-bec4-4468-9574-0a71bc1a28b3 service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Received event network-vif-unplugged-3be17249-ba4f-4354-8ec8-b95fc5b8c40e for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG nova.network.neutron [req-fac1628a-97cb-46f7-947a-b74c365726d0 req-96c3bcfc-4c8d-44fc-b620-6ce56725a50c service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Updated VIF entry in instance network info cache for port 3be17249-ba4f-4354-8ec8-b95fc5b8c40e. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG nova.network.neutron [req-fac1628a-97cb-46f7-947a-b74c365726d0 req-96c3bcfc-4c8d-44fc-b620-6ce56725a50c service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Updating instance_info_cache with network_info: [{"id": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "address": "fa:16:3e:9a:04:aa", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17249-ba", "ovs_interfaceid": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:22:10 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-fac1628a-97cb-46f7-947a-b74c365726d0 req-96c3bcfc-4c8d-44fc-b620-6ce56725a50c service nova] Releasing lock "refresh_cache-fcfe6864-206e-4484-8eec-00ebce15d87f" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:22:10 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Instance destroyed successfully.
Aug 27 07:22:10 user nova-compute[73258]: DEBUG nova.objects.instance [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lazy-loading 'resources' on Instance uuid fcfe6864-206e-4484-8eec-00ebce15d87f {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:20:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2037212677',display_name='tempest-TestVolumeBootPattern-server-2037212677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2037212677',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo/xbbNe5pugCZg6rttcuY3cd+j5BXvTZqbtXYGtXdbHJjMmHnbNi6AcvQmn26/ej5MtnY4axwFKH938p8BxyCO57BkYFUl23uzp1PG94w6lTkTvJDFna0AJYvDX8Futg==',key_name='tempest-TestVolumeBootPattern-2109572928',keypairs=<?>,launch_index=0,launched_at=2023-08-27T07:20:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='002188a1020a4181a03ce17d46608664',ramdisk_id='',reservation_id='r-wub12zjl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-833647414',owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T07:20:34Z,user_data=None,user_id='75d7a7c63b654c47b9df519798186007',uuid=fcfe6864-206e-4484-8eec-00ebce15d87f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "address": "fa:16:3e:9a:04:aa", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17249-ba", "ovs_interfaceid": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converting VIF {"id": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "address": "fa:16:3e:9a:04:aa", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be17249-ba", "ovs_interfaceid": "3be17249-ba4f-4354-8ec8-b95fc5b8c40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:04:aa,bridge_name='br-int',has_traffic_filtering=True,id=3be17249-ba4f-4354-8ec8-b95fc5b8c40e,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17249-ba') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_vif [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:04:aa,bridge_name='br-int',has_traffic_filtering=True,id=3be17249-ba4f-4354-8ec8-b95fc5b8c40e,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17249-ba') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3be17249-ba, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:22:11 user nova-compute[73258]: INFO os_vif [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:04:aa,bridge_name='br-int',has_traffic_filtering=True,id=3be17249-ba4f-4354-8ec8-b95fc5b8c40e,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be17249-ba')
Aug 27 07:22:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'astyvOIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:22:11 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1977738-c687-4a01-ab08-3287f41115bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb590135-3b59-4124-b763-f64a72c5eef0]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)
Aug 27 07:22:11 user nova-compute[73258]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 (non-flash)
Aug 27 07:22:11 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)
Aug 27 07:22:11 user nova-compute[73258]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 (non-flash)
Aug 27 07:22:11 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa4105c8c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3'): ({'sdc'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Removing single pathed devices sdc {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc97c85-df10-4bc8-bf0f-03b800666e70]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[920e6aab-ed39-4b99-af06-8e7cc8975df9]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Flushing IO for device /dev/sdc {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5393017-089b-40af-b31b-4d3fe56ab6ff]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df8d39c-d27d-439b-8033-4e0a2e1ad265]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] SCSI volumes sdc have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOaa5d2639-13dae5b501fd03f0', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_aa5d2639', '/dev/disk/by-id/scsi-23133646165356235') {{(pid=84389) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9db7bef-20aa-4e1d-b50e-94ddd7c70456]: (4, None) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80975af-fef2-44fc-bee0-edfffd98c12c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a799a9-09f3-41ea-98cb-8647b4630f97]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3, portal: 172.16.0.220,3260]
Aug 27 07:22:11 user nova-compute[73258]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3, portal: 172.16.0.220,3260] successful.
Aug 27 07:22:11 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01e8850a-2438-43c5-ae3c-0e403b3e4ad3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fefabef-8ad7-4ada-b346-e4fed967c8e6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] <== disconnect_volume: return (291ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 07:22:11 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Deleting instance files /opt/stack/data/nova/instances/fcfe6864-206e-4484-8eec-00ebce15d87f_del
Aug 27 07:22:11 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Deletion of /opt/stack/data/nova/instances/fcfe6864-206e-4484-8eec-00ebce15d87f_del complete
Aug 27 07:22:11 user nova-compute[73258]: INFO nova.compute.manager [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 07:22:11 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:22:11 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Took 0.45 seconds to deallocate network for instance.
Aug 27 07:22:11 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:22:12 user nova-compute[73258]: INFO nova.compute.manager [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Took 0.76 seconds to detach 1 volumes for instance.
Aug 27 07:22:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:22:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:22:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-3db74453-5c0f-4928-8de2-199dfadd0656 req-436beb80-c3de-454f-b3d1-4dd531f0c645 service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Received event network-vif-plugged-3be17249-ba4f-4354-8ec8-b95fc5b8c40e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:22:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3db74453-5c0f-4928-8de2-199dfadd0656 req-436beb80-c3de-454f-b3d1-4dd531f0c645 service nova] Acquiring lock "fcfe6864-206e-4484-8eec-00ebce15d87f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:22:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3db74453-5c0f-4928-8de2-199dfadd0656 req-436beb80-c3de-454f-b3d1-4dd531f0c645 service nova] Lock "fcfe6864-206e-4484-8eec-00ebce15d87f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:22:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-3db74453-5c0f-4928-8de2-199dfadd0656 req-436beb80-c3de-454f-b3d1-4dd531f0c645 service nova] Lock "fcfe6864-206e-4484-8eec-00ebce15d87f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:22:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-3db74453-5c0f-4928-8de2-199dfadd0656 req-436beb80-c3de-454f-b3d1-4dd531f0c645 service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] No waiting events found dispatching network-vif-plugged-3be17249-ba4f-4354-8ec8-b95fc5b8c40e {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:22:12 user nova-compute[73258]: WARNING nova.compute.manager [req-3db74453-5c0f-4928-8de2-199dfadd0656 req-436beb80-c3de-454f-b3d1-4dd531f0c645 service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Received unexpected event network-vif-plugged-3be17249-ba4f-4354-8ec8-b95fc5b8c40e for instance with vm_state deleted and task_state None.
Aug 27 07:22:12 user nova-compute[73258]: DEBUG nova.compute.manager [req-3db74453-5c0f-4928-8de2-199dfadd0656 req-436beb80-c3de-454f-b3d1-4dd531f0c645 service nova] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Received event network-vif-deleted-3be17249-ba4f-4354-8ec8-b95fc5b8c40e {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:22:12 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:22:12 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:22:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:22:12 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Deleted allocations for instance fcfe6864-206e-4484-8eec-00ebce15d87f
Aug 27 07:22:12 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-76c74a9c-5d9e-47bd-941f-e453db894187 tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "fcfe6864-206e-4484-8eec-00ebce15d87f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.725s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:22:14 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:22:14 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:22:14 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:22:14 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:22:14 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:22:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:22:17 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:22:20 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:22:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:22:20 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Didn't find any instances for network info cache update. {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 07:22:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:22:25 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:22:25 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:22:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:22:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:22:25 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:22:25 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:22:25 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693120930.992498, fcfe6864-206e-4484-8eec-00ebce15d87f => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:22:25 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] VM Stopped (Lifecycle Event)
Aug 27 07:22:26 user nova-compute[73258]: DEBUG nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 07:22:26 user nova-compute[73258]: DEBUG nova.compute.manager [None req-daa19ec3-bd61-4fde-8533-8682addebaa2 None None] [instance: fcfe6864-206e-4484-8eec-00ebce15d87f] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:22:26 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:22:26 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:22:26 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:22:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8795MB free_disk=23.92807388305664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:22:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:22:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:22:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Instance bb13724a-253e-4daf-b427-9fee9e934220 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 07:22:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:22:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:22:26 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:22:26 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:22:26 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:22:26 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:22:31 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:22:36 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:22:41 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:22:46 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:22:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:22:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:22:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:22:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:22:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:22:51 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:22:56 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:23:01 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:23:06 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:23:11 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:23:14 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:23:14 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:23:14 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:23:15 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:23:15 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:23:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:23:16 user nova-compute[73258]: DEBUG nova.compute.manager [req-37e17490-7e55-476b-93e5-a3982d2e9a83 req-0354530c-a0d9-4735-bf51-5f8ba14a1b1e service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Received event network-changed-7cd34efb-a56d-4040-8b72-a571256e0937 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:23:16 user nova-compute[73258]: DEBUG nova.compute.manager [req-37e17490-7e55-476b-93e5-a3982d2e9a83 req-0354530c-a0d9-4735-bf51-5f8ba14a1b1e service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Refreshing instance network info cache due to event network-changed-7cd34efb-a56d-4040-8b72-a571256e0937. {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 07:23:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-37e17490-7e55-476b-93e5-a3982d2e9a83 req-0354530c-a0d9-4735-bf51-5f8ba14a1b1e service nova] Acquiring lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 07:23:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-37e17490-7e55-476b-93e5-a3982d2e9a83 req-0354530c-a0d9-4735-bf51-5f8ba14a1b1e service nova] Acquired lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 07:23:16 user nova-compute[73258]: DEBUG nova.network.neutron [req-37e17490-7e55-476b-93e5-a3982d2e9a83 req-0354530c-a0d9-4735-bf51-5f8ba14a1b1e service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Refreshing network info cache for port 7cd34efb-a56d-4040-8b72-a571256e0937 {{(pid=73258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 07:23:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "bb13724a-253e-4daf-b427-9fee9e934220" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:23:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "bb13724a-253e-4daf-b427-9fee9e934220" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:23:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "bb13724a-253e-4daf-b427-9fee9e934220-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:23:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "bb13724a-253e-4daf-b427-9fee9e934220-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:23:16 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "bb13724a-253e-4daf-b427-9fee9e934220-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:23:16 user nova-compute[73258]: INFO nova.compute.manager [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Terminating instance
Aug 27 07:23:16 user nova-compute[73258]: DEBUG nova.compute.manager [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Start destroying the instance on the hypervisor. {{(pid=73258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 07:23:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:23:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:23:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:23:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:23:16 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:23:16 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG nova.network.neutron [req-37e17490-7e55-476b-93e5-a3982d2e9a83 req-0354530c-a0d9-4735-bf51-5f8ba14a1b1e service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Updated VIF entry in instance network info cache for port 7cd34efb-a56d-4040-8b72-a571256e0937. {{(pid=73258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG nova.network.neutron [req-37e17490-7e55-476b-93e5-a3982d2e9a83 req-0354530c-a0d9-4735-bf51-5f8ba14a1b1e service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Updating instance_info_cache with network_info: [{"id": "7cd34efb-a56d-4040-8b72-a571256e0937", "address": "fa:16:3e:a4:9f:34", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd34efb-a5", "ovs_interfaceid": "7cd34efb-a56d-4040-8b72-a571256e0937", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:23:17 user nova-compute[73258]: INFO nova.virt.libvirt.driver [-] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Instance destroyed successfully.
Aug 27 07:23:17 user nova-compute[73258]: DEBUG nova.objects.instance [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lazy-loading 'resources' on Instance uuid bb13724a-253e-4daf-b427-9fee9e934220 {{(pid=73258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-37e17490-7e55-476b-93e5-a3982d2e9a83 req-0354530c-a0d9-4735-bf51-5f8ba14a1b1e service nova] Releasing lock "refresh_cache-bb13724a-253e-4daf-b427-9fee9e934220" {{(pid=73258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.vif [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T07:18:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1987452102',display_name='tempest-TestVolumeBootPattern-server-1987452102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1987452102',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo/xbbNe5pugCZg6rttcuY3cd+j5BXvTZqbtXYGtXdbHJjMmHnbNi6AcvQmn26/ej5MtnY4axwFKH938p8BxyCO57BkYFUl23uzp1PG94w6lTkTvJDFna0AJYvDX8Futg==',key_name='tempest-TestVolumeBootPattern-2109572928',keypairs=<?>,launch_index=0,launched_at=2023-08-27T07:18:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='002188a1020a4181a03ce17d46608664',ramdisk_id='',reservation_id='r-347znda0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-833647414',owner_user_name='tempest-TestVolumeBootPattern-833647414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T07:18:27Z,user_data=None,user_id='75d7a7c63b654c47b9df519798186007',uuid=bb13724a-253e-4daf-b427-9fee9e934220,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cd34efb-a56d-4040-8b72-a571256e0937", "address": "fa:16:3e:a4:9f:34", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd34efb-a5", "ovs_interfaceid": "7cd34efb-a56d-4040-8b72-a571256e0937", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converting VIF {"id": "7cd34efb-a56d-4040-8b72-a571256e0937", "address": "fa:16:3e:a4:9f:34", "network": {"id": "e25b8d8d-3339-475c-b5a9-19b4d47139ec", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1862131996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "002188a1020a4181a03ce17d46608664", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd34efb-a5", "ovs_interfaceid": "7cd34efb-a56d-4040-8b72-a571256e0937", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG nova.network.os_vif_util [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:9f:34,bridge_name='br-int',has_traffic_filtering=True,id=7cd34efb-a56d-4040-8b72-a571256e0937,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd34efb-a5') {{(pid=73258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_vif [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:9f:34,bridge_name='br-int',has_traffic_filtering=True,id=7cd34efb-a56d-4040-8b72-a571256e0937,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd34efb-a5') {{(pid=73258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cd34efb-a5, bridge=br-int, if_exists=True) {{(pid=73258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:23:17 user nova-compute[73258]: INFO os_vif [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:9f:34,bridge_name='br-int',has_traffic_filtering=True,id=7cd34efb-a56d-4040-8b72-a571256e0937,network=Network(e25b8d8d-3339-475c-b5a9-19b4d47139ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd34efb-a5')
Aug 27 07:23:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] calling os-brick to detach iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa43045ecb0>, {'target_iqns': ['iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rvTJxLVB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 07:23:17 user nova-compute[73258]: WARNING os_brick.initiator.connectors.base [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e', 0)] {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eb450b-567e-4dc8-a8dc-77a894b79d18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2551389-b0ab-43ed-b017-c5885f22bdc2]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)
Aug 27 07:23:17 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e (non-flash)
Aug 27 07:23:17 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa41022b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e'): ({'sdb'}, set())}) {{(pid=73258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Removing single pathed devices sdb {{(pid=73258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de8cfc2-a352-4ae2-8e56-b8748ff5c92c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ef6a3e-9ebe-4fc9-9861-2d76fea864f2]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Flushing IO for device /dev/sdb {{(pid=73258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5f1715-6a31-404a-8037-e0a1c7a2f6ff]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e76d11-8438-4b8c-ae59-c8dfe18035b4]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_brick.initiator.linuxscsi [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] SCSI volumes sdb have been removed. {{(pid=73258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8c45ccfb', '/dev/disk/by-id/scsi-1SCST_BIO8c45ccfb-37d8f85a55e3e4c7', '/dev/disk/by-id/scsi-23337643866383561') {{(pid=84389) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 07:23:17 user nova-compute[73258]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_8c45ccfb
Aug 27 07:23:17 user nova-compute[73258]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO8c45ccfb-37d8f85a55e3e4c7
Aug 27 07:23:17 user nova-compute[73258]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23337643866383561
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[589fbf95-60e2-4b89-b351-1000d57aa16a]: (4, None) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e')] {{(pid=73258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf519e63-f92e-416a-91de-1a350beed949]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b7b200-6431-498b-8e54-c28e984588ce]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e, portal: 172.16.0.220,3260]
Aug 27 07:23:17 user nova-compute[73258]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e, portal: 172.16.0.220,3260] successful.
Aug 27 07:23:17 user nova-compute[73258]:  stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b67661e-41f3-41e1-9b4a-4a3ee7e5df4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca4e085-0a36-42ff-8941-0766977380d4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.base [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG os_brick.initiator.connectors.iscsi [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] <== disconnect_volume: return (261ms) None {{(pid=73258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Disconnected iSCSI Volume {{(pid=73258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 07:23:17 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Deleting instance files /opt/stack/data/nova/instances/bb13724a-253e-4daf-b427-9fee9e934220_del
Aug 27 07:23:17 user nova-compute[73258]: INFO nova.virt.libvirt.driver [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Deletion of /opt/stack/data/nova/instances/bb13724a-253e-4daf-b427-9fee9e934220_del complete
Aug 27 07:23:17 user nova-compute[73258]: INFO nova.compute.manager [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 27 07:23:17 user nova-compute[73258]: DEBUG oslo.service.loopingcall [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG nova.compute.manager [-] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Deallocating network for instance {{(pid=73258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: bb13724a-253e-4daf-b427-9fee9e934220] deallocate_for_instance() {{(pid=73258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 07:23:17 user nova-compute[73258]: DEBUG nova.network.neutron [-] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Updating instance_info_cache with network_info: [] {{(pid=73258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 07:23:17 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Took 0.47 seconds to deallocate network for instance.
Aug 27 07:23:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-f3614a27-cfdb-4b4b-82f1-283c5a394a4d req-6e03dc06-01a5-465b-8e32-282d8a1a676a service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Received event network-vif-unplugged-7cd34efb-a56d-4040-8b72-a571256e0937 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:23:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f3614a27-cfdb-4b4b-82f1-283c5a394a4d req-6e03dc06-01a5-465b-8e32-282d8a1a676a service nova] Acquiring lock "bb13724a-253e-4daf-b427-9fee9e934220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:23:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f3614a27-cfdb-4b4b-82f1-283c5a394a4d req-6e03dc06-01a5-465b-8e32-282d8a1a676a service nova] Lock "bb13724a-253e-4daf-b427-9fee9e934220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:23:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f3614a27-cfdb-4b4b-82f1-283c5a394a4d req-6e03dc06-01a5-465b-8e32-282d8a1a676a service nova] Lock "bb13724a-253e-4daf-b427-9fee9e934220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:23:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-f3614a27-cfdb-4b4b-82f1-283c5a394a4d req-6e03dc06-01a5-465b-8e32-282d8a1a676a service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] No waiting events found dispatching network-vif-unplugged-7cd34efb-a56d-4040-8b72-a571256e0937 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:23:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-f3614a27-cfdb-4b4b-82f1-283c5a394a4d req-6e03dc06-01a5-465b-8e32-282d8a1a676a service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Received event network-vif-unplugged-7cd34efb-a56d-4040-8b72-a571256e0937 for instance with task_state deleting. {{(pid=73258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 07:23:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-f3614a27-cfdb-4b4b-82f1-283c5a394a4d req-6e03dc06-01a5-465b-8e32-282d8a1a676a service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Received event network-vif-plugged-7cd34efb-a56d-4040-8b72-a571256e0937 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:23:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f3614a27-cfdb-4b4b-82f1-283c5a394a4d req-6e03dc06-01a5-465b-8e32-282d8a1a676a service nova] Acquiring lock "bb13724a-253e-4daf-b427-9fee9e934220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:23:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f3614a27-cfdb-4b4b-82f1-283c5a394a4d req-6e03dc06-01a5-465b-8e32-282d8a1a676a service nova] Lock "bb13724a-253e-4daf-b427-9fee9e934220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:23:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [req-f3614a27-cfdb-4b4b-82f1-283c5a394a4d req-6e03dc06-01a5-465b-8e32-282d8a1a676a service nova] Lock "bb13724a-253e-4daf-b427-9fee9e934220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:23:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-f3614a27-cfdb-4b4b-82f1-283c5a394a4d req-6e03dc06-01a5-465b-8e32-282d8a1a676a service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] No waiting events found dispatching network-vif-plugged-7cd34efb-a56d-4040-8b72-a571256e0937 {{(pid=73258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 07:23:18 user nova-compute[73258]: WARNING nova.compute.manager [req-f3614a27-cfdb-4b4b-82f1-283c5a394a4d req-6e03dc06-01a5-465b-8e32-282d8a1a676a service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Received unexpected event network-vif-plugged-7cd34efb-a56d-4040-8b72-a571256e0937 for instance with vm_state active and task_state deleting.
Aug 27 07:23:18 user nova-compute[73258]: DEBUG nova.compute.manager [req-f3614a27-cfdb-4b4b-82f1-283c5a394a4d req-6e03dc06-01a5-465b-8e32-282d8a1a676a service nova] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Received event network-vif-deleted-7cd34efb-a56d-4040-8b72-a571256e0937 {{(pid=73258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 07:23:18 user nova-compute[73258]: INFO nova.compute.manager [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Took 0.78 seconds to detach 1 volumes for instance.
Aug 27 07:23:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:23:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:23:18 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:23:18 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:23:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.104s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:23:18 user nova-compute[73258]: INFO nova.scheduler.client.report [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Deleted allocations for instance bb13724a-253e-4daf-b427-9fee9e934220
Aug 27 07:23:18 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:23:18 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-26279414-5d07-475b-b7b2-5adfda42dd4c tempest-TestVolumeBootPattern-833647414 tempest-TestVolumeBootPattern-833647414-project-member] Lock "bb13724a-253e-4daf-b427-9fee9e934220" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.632s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:23:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:23:22 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:23:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:23:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 07:23:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Didn't find any instances for network info cache update. {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 07:23:25 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:23:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:23:27 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:23:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:23:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:23:27 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:23:27 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:23:28 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:23:28 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:23:28 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8920MB free_disk=23.927173614501953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:23:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:23:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:23:28 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:23:28 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:23:28 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Refreshing inventories for resource provider 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 07:23:28 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Updating ProviderTree inventory for provider 13f05024-5078-4590-94a5-110d29d864c8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 07:23:28 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Updating inventory in ProviderTree for provider 13f05024-5078-4590-94a5-110d29d864c8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 07:23:28 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Refreshing aggregate associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, aggregates: None {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 07:23:28 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Refreshing trait associations for resource provider 13f05024-5078-4590-94a5-110d29d864c8, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_IDE {{(pid=73258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 07:23:28 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:23:28 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:23:28 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:23:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:23:31 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:23:31 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances with incomplete migration  {{(pid=73258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 07:23:32 user nova-compute[73258]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693120997.0293407, bb13724a-253e-4daf-b427-9fee9e934220 => Stopped> {{(pid=73258) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 07:23:32 user nova-compute[73258]: INFO nova.compute.manager [-] [instance: bb13724a-253e-4daf-b427-9fee9e934220] VM Stopped (Lifecycle Event)
Aug 27 07:23:32 user nova-compute[73258]: DEBUG nova.compute.manager [None req-dbb29914-18a4-4a92-b58b-7bb54feb7334 None None] [instance: bb13724a-253e-4daf-b427-9fee9e934220] Checking state {{(pid=73258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 07:23:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:23:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:23:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:23:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:23:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:23:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:23:33 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:23:35 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:23:35 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Cleaning up deleted instances {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 07:23:35 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] There are 0 instances to clean {{(pid=73258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 07:23:35 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:23:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:23:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:23:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:23:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:23:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 07:23:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:23:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 07:23:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:23:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:23:57 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:24:02 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:24:07 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:24:12 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:24:13 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:24:14 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:24:15 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:24:16 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:24:16 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 07:24:17 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:24:18 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:24:18 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:24:21 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:24:22 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:24:22 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:24:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Starting heal instance info cache {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 07:24:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Rebuilding the list of instances to heal {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 07:24:22 user nova-compute[73258]: DEBUG nova.compute.manager [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Didn't find any instances for network info cache update. {{(pid=73258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 07:24:24 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:24:26 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:24:27 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:24:28 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:24:28 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager.update_available_resource {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:24:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:24:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:24:28 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:24:28 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Auditing locally available compute resources for user (node: user) {{(pid=73258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 07:24:29 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:24:29 user nova-compute[73258]: WARNING nova.virt.libvirt.driver [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 07:24:29 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Hypervisor/Node resource view: name=user free_ram=8921MB free_disk=23.925979614257812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 07:24:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 07:24:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 07:24:29 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 07:24:29 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 07:24:29 user nova-compute[73258]: DEBUG nova.compute.provider_tree [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed in ProviderTree for provider: 13f05024-5078-4590-94a5-110d29d864c8 {{(pid=73258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 07:24:29 user nova-compute[73258]: DEBUG nova.scheduler.client.report [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Inventory has not changed for provider 13f05024-5078-4590-94a5-110d29d864c8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 07:24:29 user nova-compute[73258]: DEBUG nova.compute.resource_tracker [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Compute_service record updated for user:user {{(pid=73258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 07:24:29 user nova-compute[73258]: DEBUG oslo_concurrency.lockutils [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.106s {{(pid=73258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 07:24:32 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:24:37 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:24:42 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 07:24:46 user nova-compute[73258]: DEBUG oslo_service.periodic_task [None req-78b0d5a2-86f9-4ed1-a9e2-d9c0bbf5328b None None] Running periodic task ComputeManager._sync_power_states {{(pid=73258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 07:24:47 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 07:24:52 user nova-compute[73258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}